rth / vtext

Simple NLP in Rust with Python bindings
Apache License 2.0
147 stars 11 forks source link

TST Use hypothesis in python tests #58

Closed rth closed 4 years ago

rth commented 4 years ago

Use hypothesis for tests, in particular to ensure that no panic occurs on uncommon unicode inputs in tokenizers.