search

petals-infra / chat.petals.dev

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
https://chat.petals.dev
308 stars 79 forks source link

Python client implementation #11

Open slush0 opened 1 year ago

slush0 commented 1 year ago

Hi there, I've implemented simple Python client. Feel free to merge it if you find it useful.

slush0 commented 1 year ago

Please do NOT merge if you want to merge #9. After merging #9, I'll add support for stop generation into API.

Sharpz7 commented 1 year ago

This is great! Thank you :))

Maybe we can add it to an examples folder?