| Item | Description |
| AtToken() | Returns the position of the n-th token in a string. |
| HB_ATokens() | Splits a string into tokens based on a delimiter. |
| NumToken() | Returns the number of tokens in a string. |
| RestToken() | Restores the global environment of the incremental tokenizer. |
| SaveToken() | Saves the global environment of the incremental tokenizer. |
| Token() | Retrieves the n-th token from a string. |
| TokenAt() | Returns the start and end position of a token. |
| TokenEnd() | Tests if tokens can still be found with TokenNext(). |
| TokenExit() | Releases memory resources of the global tokenizer environment. |
| TokenInit() | Initializes the environment for the incremental tokenizer. |
| TokenLower() | Changes the first character of tokens to lower case. |
| TokenNext() | Retrieves the next token from a string. |
| TokenNum() | Returns the number of tokens in a tokenizer environment. |
| TokenSep() | Retrieves the separating characters of a token. |
| TokenUpper() | Changes the first character of tokens to upper case. |