search

aryn-ai / sycamore

🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
https://sycamore.readthedocs.io
Apache License 2.0
352 stars 39 forks source link

Add Helicone support. #584

Closed mdwelsh closed 2 months ago

mdwelsh commented 2 months ago

This PR adds support for an environment variable, SYCAMORE_HELICONE_API_KEY, which, when set, will cause the OpenAI client to use Helicone (https://helicone.ai) to issue LLM calls. This allows for greater visibility and debugging, and things like cost tracking etc. It is completely optional.

To use this, one must set up a Helicone account, and get a Helicone API key, and set the env var to this value.

mdwelsh commented 2 months ago

I think there should be a way to turn this off programmatically (other than dropping the env var). Like if someone has this in dotfiles that they export without thinking and sticks it in a box in a restricted env then there could be issues

Fair enough, though I think there are a lot of configuration params already here. I added another param disable_helicone to disable this.