ruankie / ecrivai

Fully automated AI blog writer that uses LangChain and GPT type LLMs for topic selection and content generation
MIT License
69 stars 17 forks source link

@shubham8550 I imagine this only depended on some Langchain integration once the model ran. Please feel free to share more details about how you managed to get it working if you're able. #9

Closed shubham8550 closed 10 months ago

shubham8550 commented 10 months ago
          @shubham8550 I imagine this only depended on some Langchain integration once the model ran. Please feel free to share more details about how you managed to get it working if you're able.

Originally posted by @ruankie in https://github.com/ruankie/ecrivai/issues/7#issuecomment-1869544533

there isnt much you need to doo to runn open source models

just get model from hugging face and swap this

(refer) https://python.langchain.com/docs/integrations/llms/llamacpp