search

fozziethebeat / S-Space

The S-Space repsitory, from the AIrhead-Research group
GNU General Public License v2.0
203 stars 106 forks source link

In Basis maker, the process document function would only process tokens ... #64

Closed younes-abouelnagah closed 9 years ago

younes-abouelnagah commented 9 years ago

...which should be skipped according to the tokenizer. This is due to checking that the token equals the empty_token rather than not equals.

davidjurgens commented 9 years ago

Nice catch! Thanks so much for the fix too.

younes-abouelnagah commented 9 years ago

You're welcome. Thanks for open sourcing such a great framework.