Remove array info on lexer table

[HolyShaq]

Changes:

• removes array info on lexeme and token info on our lexer table
• keeps parser in tact

[HolyShaq]

Smart. Asa biyahe nako tho, irefactor ko nlng sa school

[am-cid]

what I meant was not using re at all and just doing .split('[')[0] since split() is a safe operation (does not raise).

[HolyShaq]

ohhhhhhhhhhhh myb myb yea thats way better

[HolyShaq]

Actually, that may conflict with our double bracket tokens, no? It'd split it unless I make an exception for them

[am-cid]

oh i thought it was specifically just for data types. i see you're enumerating over all tokens. then nvm. approved