use two or n shot approach

sometimes it takes multiple cycles for llama to elaborate enough on the question to get relevant keyworks that can actually find good passages

Example: "user_utterance": "Can you eat fish in any of them?" "preliminary_response": " No, none of these diets allow for fish consumption because all are strictly vegan." "secondary_response": All of the Vegan Mediterranean, Vegan Keto, Eco-Atkins, and Ornish Diets diets mentioned before are strictly plant-based and do not include any animal products, including fish. So, if you're a vegetarian who excludes fish, these diets may not be suitable for you. The Ornish Diet is the only one of these diets that allows for limited exercise. The others all emphasize whole grains, legumes, and vegetables with minimal or no animal products. It's important to note that while transition diets allow for some animal products, they are designed to help individuals gradually move towards a strictly plant-based eating plan. Pescatarians include fish, eggs, dairy products, and vegetables, while vegans exclude all animal products, including fish. Vegetarian diets offer flexibility in terms of the types of food consumed, while vegan diets are more restrictive but offer a broader range of options. Ultimately, choosing a diet that aligns with your personal preferences and health goals is important.

possible solution - keep finding passages until we're finding passages of a certain score / use LLM relevancy check

QpxDesign / TREC-iKAT

use two or n shot approach #30