The compiler's lexical analyzer can be used in your programs to simplify 
parsing.  See Doc Parsing or Parse Opcode File.

See Tokens.