Saturday, January 29, 2011

Lexing and Parsing

Lexing is the process of dividing an input stream into meaningful units, or tokens, which are then processed. Parsing refers to discovering semantic meaning out of a series of tokens according to the rules of a grammar.