Update TDL docstring parsing #167
Milestone
Comments
goodmami
added a commit
that referenced
this issue
Sep 21, 2018
This lexer relies on the group identifiers of a regular expression, and it has support for multiline patterns (comments and docstrings), which are parsed separately from the regex (the regex then picks up where the special parser stops). Yielded tokens include the group identifier of the current and next tokens (helping with lookahead in parsing), the token text, and its line number. Addresses #167 and #168
goodmami
added a commit
that referenced
this issue
Sep 21, 2018
This adds a lot of code to tdl.py, although much of the old stuff will be removed in a future release. The new-style parsing is ~36% slower at reading the ERG's lexicon, but it is better able to deal with malformed TDL, and it handles docstrings and comments in all valid places. Addresses #153, #167, #168, and #170
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
See here: http://lists.delph-in.net/archives/developers/2018/002794.html
And here: http://moin.delph-in.net/TdlRfc
Triple-quoted docstrings, before any top-level term or the final
.character:The text was updated successfully, but these errors were encountered: