Batch embedding request

deepinfra / deepinfra-node

Official TypeScript wrapper for DeepInfra Inference API

https://deepinfra.com/

MIT License

8 stars 0 forks source link

Open ovuruska opened 4 months ago

ovuruska commented 4 months ago

Chunk all embedding requests to 1024-sized batches in order to get rid of Unprocessable Entity errors.