occs-compilers-2014-spring / discussion

A place for discussion
0 stars 0 forks source link

What should a scanner accept? #4

Open ikehz opened 10 years ago

ikehz commented 10 years ago

There was some discussion of what a scanner should and should not accept on #2, so I'm opening this issue for further discussion.

dbarella commented 10 years ago

I liked the comments from #2 talking about only rejecting unterminated strings and comments, that seems to make sense. I also am on the fence about totally illegal tokens like =+= but it could be argued that if the language expanded to include that token then it should only be work in the parser to implement it.