search

Shopify / liquid

Liquid markup language. Safe, customer facing template language for flexible web apps.
https://shopify.github.io/liquid/
MIT License
11.13k stars 1.39k forks source link

raise syntax error from lexer parser with UTF-8 character #1839

Closed ggmichaelgo closed 2 weeks ago

ggmichaelgo commented 2 weeks ago

With the new Lexer parser, we weren't capturing the entire UTF-8 character in the error message.

Example:

Lexer.new("1 < 1Ø").tokenize
Liquid syntax error: Unexpected character \xC3