]> git.lizzy.rs Git - rust.git/commit
projects / rust.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: cc42134) | patch
lexer: lex WS/COMMENT/SHEBANG rather than skipping
authorCorey Richardson <corey@octayn.net>
Sat, 5 Jul 2014 05:30:39 +0000 (22:30 -0700)
committerCorey Richardson <corey@octayn.net>
Wed, 9 Jul 2014 07:06:29 +0000 (00:06 -0700)
commitf512779554a436d11dd9ffde4c198da6241dfd58
tree6431e33802c11c3ba27484028fb93d2451e3373etree | snapshot
parentcc4213418e3ab225867d8e3911f592481b1bbffccommit | diff
lexer: lex WS/COMMENT/SHEBANG rather than skipping

Now, the lexer will categorize every byte in its input according to the
grammar. The parser skips over these while parsing, thus avoiding their
presence in the input to syntax extensions.
src/librustdoc/html/highlight.rs diff | blob | history
src/libsyntax/parse/attr.rs diff | blob | history
src/libsyntax/parse/lexer/comments.rs diff | blob | history
src/libsyntax/parse/lexer/mod.rs diff | blob | history
src/libsyntax/parse/parser.rs diff | blob | history
src/libsyntax/parse/token.rs diff | blob | history
Empowering everyone to build reliable and efficient software.