Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfixes for zero-width characters #91

Merged
merged 12 commits into from
Oct 30, 2023
Merged

Commits on Oct 19, 2023

  1. Add failing tests about zero-width characters

    - verify-table-integrity.py
    
      BUG! Duplicated characters in both the zero-width and wide eastasian
      tables. This program checks for this exits non-zero in such cases,
      and has been added to the chain of commands in tox. one example output:
    
           ERROR verify-table-integrity.py:86 value 0x302a in table_name=WIDE_EASTASIAN version=10.0.0 is duplicated in other_table_name=ZERO_WIDTH from inclusive range 0x3000-0x303e
    
      The way wcwidth() is written, it will always return zero width.
    
      The discovery with this script is that there are characters defined
      as both zero width (by category code like Me, Mn, and upcoming
      Cf in derived category txt) and zero-width "wide" characters (property 'W' or
      'F' in east asian wide txt).
    
    - new automatic tests for balinese, kr jamo, zero-width emoji,
      devanagari, tamil, kannada. Until bin/update-tables.py is amended to
      correct the zero and wide character tables, these are failing.
    
    - added pytest-benchmark plugin, example use:
    
      tox -epy312 -- --verbose --benchmark-save=original
      tox -epy312 -- --verbose --benchmark-compare=.benchmarks/Linux-CPython-3.12-64bit/0001_original.json
    jquast committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    97843e2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b40fbf3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    84b2db4 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c3cd589 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    0a5aa0d View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    5c1e1ed View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    5e1a1e2 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    58ea34b View commit details
    Browse the repository at this point in the history
  9. docfix

    jquast committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    ff19583 View commit details
    Browse the repository at this point in the history
  10. spacing

    jquast committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    0d85a9e View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. small spec wordfix

    jquast committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    02ce598 View commit details
    Browse the repository at this point in the history
  2. wordfix

    jquast committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    b5c76c8 View commit details
    Browse the repository at this point in the history