salesforce / decaNLP

The Natural Language Decathlon: A Multitask Challenge for NLP
BSD 3-Clause "New" or "Revised" License
2.34k stars 474 forks source link

Fix numerical field generation. #28

Closed cristipp closed 6 years ago

cristipp commented 6 years ago

Numerical fields don't get tokenized. Now we can safely process the wikisql_id numerical Field. Bug elusive to notice, because the examples are cached to disk. Fixes https://github.com/salesforce/decaNLP/issues/27

salesforce-cla[bot] commented 6 years ago

Thanks for the contribution! Before we can merge this, we need @cristipp to sign the Salesforce.com Contributor License Agreement.

cristipp commented 6 years ago

847a9dd fixed it. Thanks!