facebookresearch / fastText

Library for fast text representation and classification.
https://fasttext.cc/
MIT License
25.88k stars 4.71k forks source link

test truncation #361

Open silvioOlivastri opened 6 years ago

silvioOlivastri commented 6 years ago

Hi,

I try to optimize my validation set scores with FastText supervised. I use hyperopt (python) to do this, so I get the output of FastText from c++ version using

$ ./fasttext test my_model.bin my_validation.txt

My ""problem"" is that you truncate the output on the third digit here

Is it possible get more digits?

cpuhrsch commented 6 years ago

Hello @silvioOlivastri,

If you are open to using our Python bindings you could train within Python directly. There you can use the fastText.util.test method that will return to you these numbers in arbitrary precision. The other advantage is also that you're not forced to save the model. This should help you speed up your hyper-parameter exploration as well. Please let me know if this is useful.

Thanks, Christian