token_info Class Reference
token information
More...
#include <tokenizer.h>
List of all members.
Detailed Description
token information
Definition at line 63 of file tokenizer.h.
Constructor & Destructor Documentation
| token_info::token_info |
( |
token_type |
type, |
|
|
size_t |
len, |
|
|
size_t |
key | |
|
) |
| | [inline] |
constructor
- Parameters:
-
| type |
token type |
| len |
length in bytes |
| key |
key for regular expression |
Definition at line 67 of file tokenizer.h.
Member Data Documentation
key for regular expression
Definition at line 79 of file tokenizer.h.
The documentation for this class was generated from the following file:
