Update to Unicode 15.0.0

[elfham]

Ruby core has updated UCD version based on Unicode 14.0.0.

• update Unicode Version to 14.0.0 and Emoji version to 14.0 · ruby/ruby@45e0711 · GitHub

Following this, I updated Reline's East Asian Width table to Unicode 14.0.0 based.

[nobu]

Could you add tests?

[elfham]

Sorry, I don't know what kind of testing is required...

This file was mechanically generated by the script that comes with Reline (reline/generate_east_asian_width), and it seems unlikely that the generated code would be broken if not for a bug in the script.

Also, no specific test code seems to have been created in past updates of EastAsianWidth.txt.

• https://github.com/ruby/reline/commits/master/lib/reline/unicode/east_asian_width.rb

This also seems to be true for Ruby.

• ruby/ruby@45e0711

So, for this PR, I think there is little need for a test case beyond regression testing.

Or does anyone have any ideas as to what kind of testing is needed?

[elfham]

By the way, Unicode 15.0.0 will be released soon, making this PR obsolete...

[ima1zumi]

@nobu As @elfham said, I think this PR does not need testing. What do you think?

[hsbt]

Unicode 15.0 is already merged at ruby core. FYI https://bugs.ruby-lang.org/issues/18639

Should we use Unicode 15.0 instead of 14.0 on reline too?

[ima1zumi]

@hsbt Reline's Unicode support is for character width(especially east asian width), so it must be supported separately from the Ruby core.

[hsbt]

@ima1zumi I didn't say how organize them. Just what's version should we use?

[ima1zumi]

@hsbt
The current reline uses Unicode 13.0.0. We should use Unicode 15.0.0 to match Ruby core.
But I think we don't have to do it right now.

If this file is not updated, the widths of characters added after Unicode 14.0.0, such as Emojis, will not be obtained correctly.
For example, the width of 🫠 added in Unicode 14.0.0 is 2.
But displayed width is 1 and it has been overwritten with a.

However, I do not know how to update this file at present.
I think Unicode 15.0.0 support for Reline doesn't have to do for the Ruby 3.2.0 bundled version.
Because this issue affected only the new character's width. And we don't have much time.

[hsbt]

This is not rush thing. We can update this for Ruby 3.2.1 or others.

[elfham]

As you are discussing, I don't think many people will be troubled if Reline stays at 13.0.0.

By the way, I would like to update this PR to 15.0.0.
Is it OK to push the update to 15.0.0?

[ima1zumi]

@elfham

Is it OK to push the update to 15.0.0?

That would be great. Thank you!

[elfham]

I have updated to 15.0.0 by ba89e85 . (commit date was 3 months ago...)

[ima1zumi]

Looks good to me 🌟
I have confirmed that following process does not produce any differences.

1. Download http://www.unicode.org/Public/UCD/latest/ucd/EastAsianWidth.txt
2. $ bin/generate_east_asian_width EastAsianWidth.txt > lib/reline/unicode/east_asian_width.rb

My terminal (Alacritty 0.10.0-dev (8cda3d14)) is not displaying 🫢️ width correctly, but Reline::Unicode.get_mbchar_width('🫢') returns 2, so I think it is OK.
I think it may be my terminal issue.