Public Member Functions | |
Object | clone () |
void | define (TokenSymbol ts) |
String | getName () |
String | getTokenStringAt (int idx) |
TokenSymbol | getTokenSymbol (String sym) |
TokenSymbol | getTokenSymbolAt (int idx) |
Enumeration | getTokenSymbolElements () |
Enumeration | getTokenSymbolKeys () |
Vector | getVocabulary () |
boolean | isReadOnly () |
void | mapToTokenSymbol (String name, TokenSymbol sym) |
int | maxTokenType () |
int | nextTokenType () |
void | setName (String n) |
void | setReadOnly (boolean ro) |
boolean | tokenDefined (String symbol) |
Interface that describes the set of defined tokens
Object antlr.TokenManager.clone | ( | ) |
Implemented in antlr.ImportVocabTokenManager, and antlr.SimpleTokenManager.
Referenced by antlr.DefineGrammarSymbols.endOptions().
void antlr.TokenManager.define | ( | TokenSymbol | ts | ) |
define a token symbol
Implemented in antlr.ImportVocabTokenManager, and antlr.SimpleTokenManager.
Referenced by antlr.DefineGrammarSymbols._refStringLiteral(), antlr.DefineGrammarSymbols._refToken(), antlr.DefineGrammarSymbols.defineRuleName(), and antlr.DefineGrammarSymbols.defineToken().
String antlr.TokenManager.getName | ( | ) |
Get the name of the token manager
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.JavaCodeGenerator.gen(), antlr.CppCodeGenerator.genInclude(), and antlr.CSharpCodeGenerator.getTokenTypesClassName().
String antlr.TokenManager.getTokenStringAt | ( | int | idx | ) |
Get a token string by index
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.CppCodeGenerator.genBitsets().
TokenSymbol antlr.TokenManager.getTokenSymbol | ( | String | sym | ) |
Get the TokenSymbol for a string
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.DefineGrammarSymbols._refStringLiteral(), antlr.DefineGrammarSymbols.defineToken(), antlr.PythonCodeGenerator.gen(), antlr.JavaCodeGenerator.gen(), antlr.CSharpCodeGenerator.genBody(), antlr.CppCodeGenerator.genBody(), antlr.CSharpCodeGenerator.genInitFactory(), antlr.CppCodeGenerator.genInitFactory(), antlr.PythonCodeGenerator.genTokenASTNodeMap(), antlr.JavaCodeGenerator.genTokenASTNodeMap(), antlr.PythonCodeGenerator.genTokenStrings(), antlr.JavaCodeGenerator.genTokenStrings(), antlr.CSharpCodeGenerator.genTokenStrings(), antlr.CppCodeGenerator.genTokenStrings(), antlr.PythonCodeGenerator.getASTCreateString(), antlr.JavaCodeGenerator.getASTCreateString(), antlr.CSharpCodeGenerator.getASTCreateString(), antlr.MakeGrammar.refTokensSpecElementOption(), antlr.RuleBlock.setOption(), antlr.StringLiteralElement.StringLiteralElement(), antlr.TokenRangeElement.TokenRangeElement(), and antlr.TokenRefElement.TokenRefElement().
TokenSymbol antlr.TokenManager.getTokenSymbolAt | ( | int | idx | ) |
Implemented in antlr.SimpleTokenManager.
Enumeration antlr.TokenManager.getTokenSymbolElements | ( | ) |
Get an enumerator over the symbol table
Implemented in antlr.SimpleTokenManager.
Enumeration antlr.TokenManager.getTokenSymbolKeys | ( | ) |
Vector antlr.TokenManager.getVocabulary | ( | ) |
Get the token vocabulary (read-only).
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.CppCodeGenerator.genBitsets(), antlr.CppCodeGenerator.genInclude(), antlr.CSharpCodeGenerator.genInitFactory(), antlr.PythonCodeGenerator.genTokenASTNodeMap(), antlr.JavaCodeGenerator.genTokenASTNodeMap(), antlr.PythonCodeGenerator.genTokenStrings(), antlr.JavaCodeGenerator.genTokenStrings(), antlr.CSharpCodeGenerator.genTokenStrings(), antlr.CppCodeGenerator.genTokenStrings(), antlr.HTMLCodeGenerator.printSet(), antlr.DocBookCodeGenerator.printSet(), antlr.DiagnosticCodeGenerator.printSet(), antlr.RuleBlock.toString(), antlr.Lookahead.toString(), and antlr.AlternativeBlock.toString().
boolean antlr.TokenManager.isReadOnly | ( | ) |
Is this token manager read-only?
Implemented in antlr.ImportVocabTokenManager, and antlr.SimpleTokenManager.
Referenced by antlr.PythonCodeGenerator.flushTokens(), antlr.JavaCodeGenerator.gen(), antlr.DiagnosticCodeGenerator.gen(), antlr.CSharpCodeGenerator.gen(), and antlr.CppCodeGenerator.gen().
void antlr.TokenManager.mapToTokenSymbol | ( | String | name, | |
TokenSymbol | sym | |||
) |
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.DefineGrammarSymbols.defineToken().
int antlr.TokenManager.maxTokenType | ( | ) |
Get the highest token type in use
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.PythonCodeGenerator.gen(), antlr.JavaCodeGenerator.gen(), antlr.CSharpCodeGenerator.genBody(), antlr.CppCodeGenerator.genBody(), antlr.CppCodeGenerator.genInclude(), antlr.CSharpCodeGenerator.genInitFactory(), antlr.CppCodeGenerator.genInitFactory(), and antlr.LLkAnalyzer.look().
int antlr.TokenManager.nextTokenType | ( | ) |
Get the next unused token type
Implemented in antlr.ImportVocabTokenManager, and antlr.SimpleTokenManager.
Referenced by antlr.DefineGrammarSymbols._refStringLiteral(), antlr.DefineGrammarSymbols._refToken(), antlr.DefineGrammarSymbols.defineRuleName(), and antlr.DefineGrammarSymbols.defineToken().
void antlr.TokenManager.setName | ( | String | n | ) |
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.DefineGrammarSymbols.endOptions().
void antlr.TokenManager.setReadOnly | ( | boolean | ro | ) |
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.DefineGrammarSymbols.endOptions().
boolean antlr.TokenManager.tokenDefined | ( | String | symbol | ) |
Is a token symbol defined?
Implemented in antlr.SimpleTokenManager.
Referenced by antlr.DefineGrammarSymbols._refToken(), antlr.DefineGrammarSymbols.defineRuleName(), antlr.DefineGrammarSymbols.defineToken(), antlr.CppCodeGenerator.getASTCreateString(), antlr.CSharpCodeGenerator.processStringForASTConstructor(), and antlr.CppCodeGenerator.processStringForASTConstructor().