New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Separate tokenization from the building of the TeXExpr #100

Closed

Kolaru opened this issue Mar 9, 2023 · 0 comments · Fixed by #114

Owner

Kolaru commented Mar 9, 2023

Currently the parser tokenize the LaTeX code and parse the result in a single pass.

I now believe this is confusing, and it would be better to have two passes

Use Automa without a stack to tokenize the code into commands.
Go through the tokens with the current stack-logic to create the recursive TeXExpr.

Kolaru changed the title ~~Add a tokenizer pass to the parser~~ Separate tokenization from the building of the TeXExpr

Kolaru mentioned this issue

New parser - simplified with a tokenizer pass #114

Merged

Kolaru closed this as completed in #114

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment