8 lines
607 B
Markdown
8 lines
607 B
Markdown
## Lexical Analysis Process
|
|
|
|
The lexical analysis process in AVAP™ consists of several steps:
|
|
|
|
* Scanning: The source code is read sequentially, and the lexical components are identified. Regular expressions are used to recognize patterns corresponding to keywords, identifiers, operators, etc.
|
|
* Tokenization: The identified lexical components are converted into tokens, which are objects representing each component with its associated type and value.
|
|
* Token Generation: The generated tokens are passed to the next step of the compilation or interpretation process for syntactic and semantic analysis.
|