search

pytorch / torchchat

Run PyTorch LLMs locally on servers, desktop and mobile
BSD 3-Clause "New" or "Revised" License
3.26k stars 206 forks source link

[Feature request] Langchain Support - Chat Model #1009

Open raymon-io opened 2 months ago

raymon-io commented 2 months ago

🚀 The feature, motivation and pitch

Requesting to support Langchain by creating a ChatModel for Langchain. Since Torchchat already supports OpenAI compatible chat apis they should be very similar to chat models like ChatOllama, ChatLlamaCpp.

I know this has to be done in Langchain's repository and I created a discussion there but it would be great if someone knowledgeable in both Langchain and TorchChat is willing to take initiative on it.

Jack-Khuu commented 1 month ago

Good call out, with the recent OpenAI API polished in TC, this can be an easy win

cc: @vmpuri