search

tonystone / geofeatures2

A lightweight, high performance geometry library in Swift.
Apache License 2.0
19 stars 4 forks source link

Tokenizer unicode #136

Closed tonystone closed 8 years ago

tonystone commented 8 years ago

Adding tests for unicode support in Tokenizer and adjusting tokenizer code to support it.