search

BerriAI / reliableGPT

Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
MIT License
623 stars 33 forks source link

Guys, please try a msft guidance / promptfoo integration -- good packages that we use everyday #35

Closed akshhack closed 1 year ago

akshhack commented 1 year ago

I love the stuff you've built to make system level robustness. This will be super useful to me if it can also have quality level robustness. Check promptfoo and msft guidance. NVIDIA has published similar stuff as part of nemo, I think, guardrails?

krrishdholakia commented 1 year ago

why can't you use this with those already? we wrap the base openai endpoint, that shouldn't stop you from using testing libraries like promptfoo, etc.?

Have you faced any errors? @akshhack