Closed mongodben closed 1 year ago
there's a basic POC here - https://github.com/mongodben/mongodb-oracle/blob/main/pre-skunk-poc/generate-index/lib/test-query.ts
for LLM summary, this script uses "text-davinci-003"
, which is based on OpenAI GPT-3. it works fine.
we could likely get better results using:
more than 90% sure we can marginally improve the results quality while reducing cost 10x by using the model "gpt-3.5-turbo"
with 0 other changes.
TypeScript/Next.js server routes with endpoint to respond to natural language user queries in natural language response with accurate data from the indexed site. Format answers in Markdown with links to relevant content on the site.