RafaelRuiz
/
assistance-engine
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
assistance-engine/docs/developer.avapframework.com/chapter3_3.md

607 B
Raw Blame History

Lexical Analysis Process

The lexical analysis process in AVAP™ consists of several steps:

  • Scanning: The source code is read sequentially, and the lexical components are identified. Regular expressions are used to recognize patterns corresponding to keywords, identifiers, operators, etc.
  • Tokenization: The identified lexical components are converted into tokens, which are objects representing each component with its associated type and value.
  • Token Generation: The generated tokens are passed to the next step of the compilation or interpretation process for syntactic and semantic analysis.