Closed yuvraj123-verma closed 7 months ago
Does runpod offer an OpenAI-compatible API? The 404 error below indicates that the API endpoint Zep expects is not available.
SummaryExtractor summarize failed (original error: API returned unexpected status code: 404:
I want to use custom llm model (TheBloke/Airoboros-L2-70B-GPT4-m2.0-AWQ) for Summary Extraction and Intent Extraction instead of using openai llm model.
I am using below modifyed file to run custom llm model. and i am getting an error Error:- level=error msg="SummaryExtractor extract failed: extractor error: SummaryExtractor summarize failed (original error: API returned unexpected status code: 404: )" please provide solution on this issue.
######### Config.yaml #########
######### docker-compose.yaml #########
####### .env ##########