Skip to content

Commit

Permalink
Remove the "NFKC clause" in the reference manual.
Browse files Browse the repository at this point in the history
The reference manual said that code is interpreted as UTF-8 text and a
implementation will normalize it to NFKC. However, rustc doesn't do
any normalization now.

We may want to do any normalization for symbols, but normalizing whole
text seems harmful because doing so loses some sort of information even
if we choose a non-K variant of normalization.

I'd suggest removing "normalized to Unicode normalization form NFKC"
phrase for the present so that the manual represents the current state
properly. When we address the problem (with a RFC?), then the manual
should be updated.

Closes #12388.

Reference: #2253

Signed-off-by: OGINO Masanori <masanori.ogino@gmail.com>
  • Loading branch information
omasanori committed Aug 3, 2014
1 parent 845ff65 commit bf2d98e
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions src/doc/rust.md
Original file line number Diff line number Diff line change
Expand Up @@ -112,8 +112,7 @@ production. See [tokens](#tokens) for more information.

## Input format

Rust input is interpreted as a sequence of Unicode codepoints encoded in UTF-8,
normalized to Unicode normalization form NFKC.
Rust input is interpreted as a sequence of Unicode codepoints encoded in UTF-8.
Most Rust grammar rules are defined in terms of printable ASCII-range codepoints,
but a small number are defined in terms of Unicode properties or explicit
codepoint lists. [^inputformat]
Expand Down

5 comments on commit bf2d98e

@bors
Copy link
Contributor

@bors bors commented on bf2d98e Aug 5, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bors
Copy link
Contributor

@bors bors commented on bf2d98e Aug 5, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

merging omasanori/rust/nfkc = bf2d98e into auto

@bors
Copy link
Contributor

@bors bors commented on bf2d98e Aug 5, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

omasanori/rust/nfkc = bf2d98e merged ok, testing candidate = 157459b

@bors
Copy link
Contributor

@bors bors commented on bf2d98e Aug 5, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fast-forwarding master to auto = 157459b

Please sign in to comment.