knights-analytics / hugot

Huggingface transformer pipelines in Golang
Apache License 2.0
279 stars 13 forks source link

Benchmarks #13

Open riccardopinosio opened 7 months ago

riccardopinosio commented 7 months ago

We should add some benchmarking w.r.t. the python library. For instance, benchmark embedding a big batch of strings with mini LM and compare performance with the default python pipeline, to ensure we are in the same ballpark. Could probably combine this work with the work on testing directly against the python implementation.