sandbox-ai / ali

el Asistente Legal Inteligente
3 stars 1 forks source link

add follow up question recommendations #2

Open tatakof opened 6 months ago

tatakof commented 6 months ago

use 'gpt-3.5-turbo-0125', ask it to generate 3 questions based on the initial question and the response (and the top_k?)

tatakof commented 6 months ago

follow up questions should be created with only 1 api call and should be extracted either with a fuzzy search (because the structure might not be consistent) or with 'gpt-3.5-turbo-instruct'

tatakof commented 6 months ago

evaluate if the question generator should use some form of memory (compressed llm-output) instead of zero-shoting everything