-
Notifications
You must be signed in to change notification settings - Fork 83
New issue
Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? # to your account
Changed lexers to use Sedlex #392
base: dev-0-1-0
Are you sure you want to change the base?
Conversation
Memo:
|
Thank you so much for developing a lexer using Sedlex! What motivated me to consider re-implemention of the lexer with Sedlex was that it enables us to make every character token in math formulae have exactly one codepoint by replacing Would you mind modifying |
I modified |
Great! This PR will also fixes #312. Would you mind adding parser tests about positions around multi-byte characters? |
I added parser test about multi-byte characters (2c4a50d). |
This PR fixes #313 :
|
Close #398
note:
dune test
has all passedReference: