- Lexical analysis is the first phase of a compiler.
- It converts the high level input program into a sequence of tokens, by removing any whitespace or comments in the source code.
- In programming language, keywords, constants, identifiers, strings, numbers, operators and punctuations symbols can be considered as tokens.
cosminmoldovan / lexical-analysis Goto Github PK
View Code? Open in Web Editor NEW๐ฌ Lexical Analysis is the first phase of the compiler also known as a scanner. It converts the High level input program into a sequence of Tokens.