Any way to user commet_llm as object?

[DmitriiShubin]

example: a = comet_llm.init() a.start_chain(...)

My agent has multiple files and complex module structure, super inconvenient to use rn as a global variable

[Lothiraldan]

Hi @DmitriiShubin, thank you for raising your pain point. The usage of a global variable is meant to making it easier for you to use our LLM SDK and not requiring your to update all functions in your call stack to pass the LLM SDKs around. Could you share a bit more information about your use-case and agent setup? Does your agent runs across multiple threads, coroutines or processes?

[DmitriiShubin]

Hi Boris,

We need to track the performance of the multi-agent system, ideally end2end, which consists of multiple classes and dozens of API calls.

Also, how are you guys compliant with the security? do you use/review logs/prompts?

On Wed, Jun 19, 2024 at 5:11 AM Boris Feld @.***> wrote:

Hi @DmitriiShubin https://github.com/DmitriiShubin, thank you for raising your pain point. The usage of a global variable is meant to making it easier for you to use our LLM SDK and not requiring your to update all functions in your call stack to pass the LLM SDKs around. Could you share a bit more information about your use-case and agent setup? Does your agent runs across multiple threads, coroutines or processes?

— Reply to this email directly, view it on GitHub https://github.com/comet-ml/comet-llm/issues/137#issuecomment-2178169136, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALBPUJZU7K4YGJOHGISMPS3ZIFDL7AVCNFSM6AAAAABIUIU4SGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNZYGE3DSMJTGY . You are receiving this because you were mentioned.Message ID: @.***>

[DmitriiShubin]

Does your agent runs across multiple threads, coroutines or processes? Rn it isn't but we're planning to add multi-threading in a near future

[Lothiraldan]

Also, how are you guys compliant with the security? do you use/review logs/prompts?

Our terms of service https://www.comet.com/site/terms-of-service/ and Privacy Policy https://www.comet.com/site/privacy-policy/ cover this. In general user owns their data stored in comet unless they set it to public. In addition for security we are SOC2 and ISO 27001 complaint.

Rn it isn't but we're planning to add multi-threading in a near future

Sounds good, would you be willing to jump on a call to explore what the best API would be for your use-case?

[DmitriiShubin]

sure, please feel free to reach out shubin.dmitrii@gmail.com

[DmitriiShubin]

and thanks for the info!

[Nimrod007]

Hi @DmitriiShubin , we are moving to a new product opik https://github.com/comet-ml/opik/ which will replace comet-llm.

You can find the old comet-llm project here: https://github.com/comet-ml/comet-llm-legacy