search

project-langx / X

A placeholder language with shareable bytecode IR.
2 stars 0 forks source link

Add support for operators and numbers in tokenizer, acc to #1 #11

Closed frankhart2018 closed 3 years ago

frankhart2018 commented 3 years ago

Closes #2

Implementation

  1. Identify numbers (int and float) in tokenizer. Support for double will be added in #10.

  2. Identify operators (+, -, *, /) in tokenizer.

  3. Add support for the same in the parser, change the dtype in __number and map the operator tokens to actual operators.