Open Jack-Khuu opened 1 month ago
PR 995 addresses some initial concerns. Responses should now be formatted in JSON using the API dataclasses. Here are our functional gaps so far:
Behavior Issues
Hello there! I'm curious if supporting OpenAI Vision API is also something you're interested in since it looks like the team does plan to support vision language models from the discussion in #988
If you do, happy to help!
Hey Roger, thanks for reaching out! We do plan on adding LLaVA support in the coming weeks, and we'd appreciate your help on the API/server components.
I'm still working on bringing the initial version of the API and server up to spec, but I'll keep this issue updated with my progress.
Landed pulls #1035 #1034 #1042 which prove that the basic completion API works as expected with the Python OpenAI API.
🚀 The feature, motivation and pitch
The OpenAI API support in torchchat is actively in development and will be one of the main entry point for interacting with torchchat
https://github.com/pytorch/torchchat?tab=readme-ov-file#server
Alternatives
No response
Additional context
No response
RFC (Optional)
No response