Module lexer_rowan 

Rowan-compatible lexer for nginx configuration files.

Produces a flat sequence of (SyntaxKind, &str) pairs where every byte of the input is covered (whitespace and newlines are explicit tokens). This is the input expected by the rowan-based parser.

Functions

tokenize

Tokenise source into a lossless sequence of (SyntaxKind, text) pairs.