Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

isopsuffix incomplete #180

Closed
goretkin opened this issue Jun 9, 2021 · 1 comment · Fixed by #181
Closed

isopsuffix incomplete #180

goretkin opened this issue Jun 9, 2021 · 1 comment · Fixed by #181

Comments

@goretkin
Copy link
Contributor

goretkin commented Jun 9, 2021

This works:

julia> collect(Tokenize.tokenize("1 +₂ 2"))
6-element Vector{Tokenize.Tokens.Token}:
 1,1-1,1          INTEGER        "1"
 1,2-1,2          WHITESPACE     " "
 1,3-1,4          OP             "+₂"
 1,5-1,5          WHITESPACE     " "
 1,6-1,6          INTEGER        "2"
 1,7-1,6          ENDMARKER      ""

this should, but does not:

julia> collect(Tokenize.tokenize("1 +̄ 2"))
7-element Vector{Tokenize.Tokens.Token}:
 1,1-1,1          INTEGER        "1"
 1,2-1,2          WHITESPACE     " "
 1,3-1,3          OP             "+"
 1,4-1,4          ERROR          "̄"
 1,5-1,5          WHITESPACE     " "
 1,6-1,6          INTEGER        "2"
 1,7-1,6          ENDMARKER      ""

and I believe it is causing julia-vscode/CSTParser.jl#284

@goretkin
Copy link
Contributor Author

goretkin commented Jun 9, 2021

https://github.com/JuliaLang/julia/blob/e2d647ecdbd657c12314b6d07ab22441db284cc5/src/julia-parser.scm#L66-L73 refers to strip-op-suffix, but I do not see that function's definition.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant