search

yus1108 / mcf

This is a toy compiler project named as mcf (making compiler is fun) aiming to make a compiler specialized for game development.
MIT License
1 stars 0 forks source link

[lexer] utf8 valid check #24

Open yus1108 opened 1 month ago

yus1108 commented 1 month ago

valid utf8 문자열인지 확인 필요, 아닌 경우 invalid 토큰을 보내고 토큰 생성 실패 시킵니다.