search

shlomi-noach / common-schema-legacy

Automatically exported from code.google.com/p/common-schema
5 stars 6 forks source link

tokenizer broken with strings #12

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
Posting this here otherwise I forget the string to reproduce the problem

mysql> call _get_sql_tokens(',''\n''');
+----+-------+-------+-------+--------+
| id | start | level | token | state  |
+----+-------+-------+-------+--------+
|  1 |     2 |     0 | ,     | comma  |
|  2 |     5 |     0 | '
'   | string |
|  3 |     5 |     0 |       | start  |
+----+-------+-------+-------+--------+

Original issue reported on code.google.com by roland.bouman on 15 Sep 2011 at 6:47

GoogleCodeExporter commented 9 years ago

Original comment by roland.bouman on 15 Sep 2011 at 8:52

GoogleCodeExporter commented 9 years ago 
it's not a bug, the output is just confusing. silly me.

Original comment by roland.bouman on 15 Sep 2011 at 8:53