search

HomebrewNLP / Olmax

HomebrewNLP in JAX flavour for maintable TPU-Training
BSD 2-Clause "Simplified" License
45 stars 6 forks source link

Inference CLI #18

Closed ClashLuke closed 2 years ago

ClashLuke commented 2 years ago

We currently have a basic CLI for inference of our models, but it doesn't support newlines or large-scale embeddings:

https://github.com/HomebrewNLP/HomebrewNLP-Jax/blob/b4a7afa8da619af47c0e661baddf581d7f8a2cce/src/inference.py#L98-L103

It would be nice to have a dedicated command-line interface for inference, as this would help improve the useability of our models.

ClashLuke commented 2 years ago

Solved in #27