Class FilterParserTokenManager
java.lang.Object
it.unimi.dsi.law.warc.filters.parser.FilterParserTokenManager
- All Implemented Interfaces:
FilterParserConstants
public class FilterParserTokenManager extends Object implements FilterParserConstants
Token Manager.
-
Field Summary
Fields Modifier and Type Field Description protected intcurCharPrintStreamdebugStreamDebug output.protected SimpleCharStreaminput_streamstatic int[]jjnewLexStateLex State array.static String[]jjstrLiteralImagesToken literal values.static String[]lexStateNamesLexer state names.Fields inherited from interface it.unimi.dsi.law.warc.filters.parser.FilterParserConstants
AND, ARGS, CLOSEPAREN, DEFAULT, EOF, FALSE, NOT, OPENPAREN, OR, tokenImage, TRUE, WORD -
Constructor Summary
Constructors Constructor Description FilterParserTokenManager(SimpleCharStream stream)Constructor.FilterParserTokenManager(SimpleCharStream stream, int lexState)Constructor. -
Method Summary
Modifier and Type Method Description TokengetNextToken()Get the next Token.protected TokenjjFillToken()voidReInit(SimpleCharStream stream)Reinitialise parser.voidReInit(SimpleCharStream stream, int lexState)Reinitialise parser.voidsetDebugStream(PrintStream ds)Set debug output.voidSwitchTo(int lexState)Switch to specified lex state.
-
Field Details
-
debugStream
Debug output. -
jjstrLiteralImages
Token literal values. -
lexStateNames
Lexer state names. -
jjnewLexState
public static final int[] jjnewLexStateLex State array. -
input_stream
-
curChar
protected int curChar
-
-
Constructor Details
-
FilterParserTokenManager
Constructor. -
FilterParserTokenManager
Constructor.
-
-
Method Details
-
setDebugStream
Set debug output. -
jjFillToken
-
getNextToken
Get the next Token. -
ReInit
Reinitialise parser. -
ReInit
Reinitialise parser. -
SwitchTo
public void SwitchTo(int lexState)Switch to specified lex state.
-