search

hegelai / prompttools

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
http://prompttools.readthedocs.io
Apache License 2.0
2.56k stars 216 forks source link

Add streamlit playground #33

Closed steventkrawczyk closed 11 months ago

github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 6.1e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.6e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 6e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.9e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 7e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 3.1e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.5e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 6.6e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 3.5e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.3e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 5.6e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.4e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.8e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.4e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 7.2e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 3e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.7e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.9e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 6.6e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.8e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.4e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.8e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 4.7e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.6e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.9e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.6e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 6e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.8e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.4e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 6.3e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 3.1e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.4e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.1e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 7.1e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 3.2e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.4e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.8e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 5.9e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.901e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.2e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.6e-06 gpt-4
github-actions[bot] commented 11 months ago
messages response latency model
0 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 5.4e-06 gpt-3.5-turbo
1 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 2.8e-06 gpt-3.5-turbo
2 [{'role': 'system', 'content': 'You are a helpful assistant.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.9e-06 gpt-4
3 [{'role': 'system', 'content': 'You are a math tutor.'}, {'role': 'user', 'content': 'Is 17077 a prime number?'}] George Washington 1.8e-06 gpt-4