parse
public void parse(javax.swing.text.Segment segment,
int ofst,
java.util.List<Token> tokens)
Description copied from interface: Lexer
This is the only method a Lexer needs to implement. It will be passed
a Reader, and it should return non-overlapping Tokens for each recognized token
in the stream.
- Specified by:
parse
in interface Lexer
- Parameters:
segment
- Text to parse.ofst
- offset to add to start of each token (useful for nesting)tokens
- List of Tokens to be added. This is done so that the caller creates the
appropriate List implementation and size. The parse method just adds to the list