Test comments in lexer.rs

[jasonwilliams]

lexer.rs now has a test suite, but testing comments are still missing.

Test would ensure single-line and multi-line comments are skipped passed and don't generate any tokens

Contributing

https://github.com/jasonwilliams/boa/blob/master/CONTRIBUTING.md

[akshay5995]

@jasonwilliams I'll take this up :)

[jasonwilliams]

@akshay5995 you still interested in taking this?

[Emanon42]

I am interested in this. Can I take a try?

[Emanon42]

#134

[Emanon42]

CI failed. I read the lexer code and find out that it actually produces a comment token object which contains the comment string. But you said "single-line and multi-line comments are skipped passed and don't generate any tokens", is that a bug or feature?

[Emanon42]

dont get reply yet, I assume this is feature and change tests.

[jasonwilliams]

its a feature, we don't need to generate tokens for comments, they should be ignored.

[jasonwilliams]

if CI fails you can run whatever it does locally

cargo fmt --all -- --check

is what failed, so looks like formatting issues

[Emanon42]

#134 has been fixed.