mirror of
https://github.com/hanzoai/ast.git
synced 2026-11-02 19:28:21 +00:00
235 B
235 B
The generated parsers use the grammar's token count to distinguish between terminal and non-terminal symbols. When the grammar has unused tokens, these tokens don't appear in the parser, so they need to be omitted from the token count.