Ensure Optimized Prompts (Snacks & Kitchen)

[fayvor]

Referring to the Prompt Guide, ensure optimized prompts in these recipes:

• Summary Snack
• RAG with Langchain
• Recipes in Granite Kitchen

In addition, investigate how the Langchain Replicate client assembles its prompt string:

• Using roles from a ChatPromptTemplate

Out of scope for this ticket:

• Legal RAG with NH Caselaw

[fayvor]

Here is an example of the Prompt Guide style: https://replicate.com/p/jw1vb5af4srm60cjjpk8ftv7h8

<|start_of_role|>user<|end_of_role|>
    Show me a SQL query that fetches all columns for the first 50 rows
    in a table named 'users'.<|end_of_text|>
<|start_of_role|>assistant<|end_of_role|>

Here is how Langchain stringifies a ChatPromptTemplate: https://replicate.com/p/a037rbxpsxrm00cjjpjr8t4zsc

System: You are a helpful AI bot. Your name is Bob.
Human: Hello, how are you doing?
AI: I'm doing well, thanks!
Human: What is your name?

[fayvor]

Langchain Hub is a community exchange for prompt designs for various purposes. You can filter by task type and model (I saw the model filter in a video but don't see it in the hub).

This may be worthwhile publishing the Prompt Guide templates to.

[fayvor]

Granite Kitchen PR here.

[fayvor]

Snack PR here.