dream120 / common-schema

Automatically exported from code.google.com/p/common-schema
0 stars 0 forks source link

get_num_tokens() returns wrong output on multi-chcracter delimiter #8

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
need to divide diff by length of delimiter

Original issue reported on code.google.com by shlomi.n...@gmail.com on 7 Sep 2011 at 9:13

GoogleCodeExporter commented 9 years ago
This issue was closed by revision r72.

Original comment by shlomi.n...@gmail.com on 7 Sep 2011 at 9:14