search

daulet / tokenizers

Go bindings for HuggingFace Tokenizer
MIT License
89 stars 23 forks source link

fix cross compilation #9

Closed jpekmez closed 10 months ago

jpekmez commented 1 year ago

it's slow but it works (used for release v0.5.1)

daulet commented 1 year ago

but what problem does it solve? What this does not verify that it actually works with Go library on each platform. The release container runs a sample program with each artifact to confirm they are valid (had problems with compatibility before).