issues
search
alan-turing-institute
/
prompto
An open source library for asynchronous querying of LLM endpoints
https://alan-turing-institute.github.io/prompto/
MIT License
15
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Automatic scorer
#97
rchan26
closed
1 week ago
1
Automatic judge
#96
rchan26
closed
1 week ago
2
Automatic judge
#95
rchan26
closed
2 weeks ago
1
Evaluation functions
#94
EdwinB12
closed
1 week ago
6
Adding Gemini and VertexAI tests
#93
rchan26
closed
2 weeks ago
1
Prompt expansion feature
#92
rchan26
opened
1 month ago
2
Add test for Quart
#91
rchan26
opened
1 month ago
0
Add test for HF TGI
#90
rchan26
opened
1 month ago
0
Add test for Ollama
#89
rchan26
opened
1 month ago
0
Add test for Azure OpenAI
#88
rchan26
opened
1 month ago
0
Add test for OpenAI
#87
rchan26
opened
1 month ago
0
Add test for VertexAI API
#86
rchan26
closed
2 weeks ago
0
Add test for Gemini API
#85
rchan26
closed
2 weeks ago
0
Improve evaluation functionalities
#84
rchan26
opened
1 month ago
0
Add automatic scoring functionality for evaluation
#83
rchan26
closed
1 week ago
2
Streamline LLM-as-judge functionality
#82
rchan26
closed
1 week ago
0
Add tests for creating ASYNC_APIS and importing
#81
rchan26
closed
1 month ago
0
Add Anthropic API tests
#80
rchan26
closed
1 month ago
1
Add tests for all APIs
#79
EdwinB12
opened
1 month ago
0
Add Anthropic API Support
#78
EdwinB12
closed
1 month ago
1
Add system demo examples
#77
rchan26
closed
1 month ago
1
Add Cohere API
#76
rchan26
opened
2 months ago
0
Add api class doc
#75
rchan26
closed
2 months ago
1
Pypi publishing
#74
rchan26
closed
2 months ago
2
Readme update
#73
rchan26
closed
2 months ago
1
Add multimodal example for OpenAI
#72
rchan26
opened
2 months ago
0
Add example notebook for quart API
#71
rchan26
opened
2 months ago
0
Add example notebook for huggingface-tgi model
#70
rchan26
opened
2 months ago
0
Add multimodal example notebooks for Gemini
#69
rchan26
opened
2 months ago
0
Add OpenAI multimodal prompting
#68
rchan26
opened
2 months ago
0
Remove model name def and gemini
#67
rchan26
closed
2 months ago
1
Remove option of default model name
#66
rchan26
closed
2 months ago
0
Add Gemini API option
#65
rchan26
closed
2 months ago
0
Ollama example
#64
rchan26
closed
2 months ago
1
Organise examples
#63
rchan26
closed
2 months ago
1
Add documentation on how to add a API class
#62
rchan26
closed
2 months ago
0
Add minimal example in README
#61
rchan26
closed
2 months ago
0
Add tests
#60
rchan26
closed
3 months ago
1
Separate ExperimentPipeline and running experiments
#59
rchan26
closed
3 months ago
3
Add upload to PyPI on publishing in CI
#58
rchan26
closed
2 months ago
0
Add readthedocs for Python class documentation
#57
rchan26
closed
2 months ago
0
process_experiment method in ExperimentPipeline should be in Experiment class
#56
rchan26
closed
3 months ago
0
Different rate limits implementation
#55
rchan26
closed
3 months ago
1
Fix dependencies error when loading APIs
#54
rchan26
closed
3 months ago
1
Ollama sort
#53
rchan26
closed
3 months ago
1
Documentation update
#52
rchan26
closed
3 months ago
0
Minimise model loading for ollama API
#51
rchan26
closed
3 months ago
0
Update README and documentation
#50
rchan26
closed
3 months ago
0
Experiment run command
#49
rchan26
closed
4 months ago
3
Add docstrings to all functions, methods and classes
#48
rchan26
closed
3 months ago
0
Next