Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Copy error cases from reference tokenizer #172

Closed
c42f opened this issue Dec 16, 2022 · 1 comment
Closed

Copy error cases from reference tokenizer #172

c42f opened this issue Dec 16, 2022 · 1 comment

Comments

@c42f
Copy link
Member

c42f commented Dec 16, 2022

The tokenizer is too permissive in some cases, for example some numeric literals

We should survey the reference tokenizer code and make sure all the existing error cases are covered in the new tokenizer. Known problems:

@c42f
Copy link
Member Author

c42f commented Feb 14, 2023

Fixed by #196

@c42f c42f closed this as completed Feb 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant