Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The essence of lexer #59706

Merged
merged 1 commit into from
Jul 21, 2019
Merged

The essence of lexer #59706

merged 1 commit into from
Jul 21, 2019

Commits on Jul 20, 2019

  1. Introduce rustc_lexer 

    The idea here is to make a reusable library out of the existing
rust-lexer, by separating out pure lexing and rustc-specific concerns,
like spans, error reporting an interning.

So, rustc_lexer operates directly on `&str`, produces simple tokens
which are a pair of type-tag and a bit of original text, and does not
report errors, instead storing them as flags on the token.
    @matklad
    matklad committed Jul 20, 2019
    Configuration menu
    Copy the full SHA
    395ee0b View commit details
    Browse the repository at this point in the history