search

comet-ml / comet-llm

Log, Track, and Visualize your LLM Prompts and Chains
MIT License
487 stars 29 forks source link

Any way to user commet_llm as object? #137

Open DmitriiShubin opened 1 month ago

DmitriiShubin commented 1 month ago

example: a = comet_llm.init() a.start_chain(...)

My agent has multiple files and complex module structure, super inconvenient to use rn as a global variable

Lothiraldan commented 2 weeks ago

Hi @DmitriiShubin, thank you for raising your pain point. The usage of a global variable is meant to making it easier for you to use our LLM SDK and not requiring your to update all functions in your call stack to pass the LLM SDKs around. Could you share a bit more information about your use-case and agent setup? Does your agent runs across multiple threads, coroutines or processes?

DmitriiShubin commented 2 weeks ago

Hi Boris,

We need to track the performance of the multi-agent system, ideally end2end, which consists of multiple classes and dozens of API calls.

Also, how are you guys compliant with the security? do you use/review logs/prompts?

On Wed, Jun 19, 2024 at 5:11 AM Boris Feld @.***> wrote:

Hi @DmitriiShubin https://github.com/DmitriiShubin, thank you for raising your pain point. The usage of a global variable is meant to making it easier for you to use our LLM SDK and not requiring your to update all functions in your call stack to pass the LLM SDKs around. Could you share a bit more information about your use-case and agent setup? Does your agent runs across multiple threads, coroutines or processes?

— Reply to this email directly, view it on GitHub https://github.com/comet-ml/comet-llm/issues/137#issuecomment-2178169136, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALBPUJZU7K4YGJOHGISMPS3ZIFDL7AVCNFSM6AAAAABIUIU4SGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNZYGE3DSMJTGY . You are receiving this because you were mentioned.Message ID: @.***>

DmitriiShubin commented 2 weeks ago

Does your agent runs across multiple threads, coroutines or processes? Rn it isn't but we're planning to add multi-threading in a near future

Lothiraldan commented 2 weeks ago

Also, how are you guys compliant with the security? do you use/review logs/prompts?

Our terms of service https://www.comet.com/site/terms-of-service/ and Privacy Policy https://www.comet.com/site/privacy-policy/ cover this. In general user owns their data stored in comet unless they set it to public. In addition for security we are SOC2 and ISO 27001 complaint.

Rn it isn't but we're planning to add multi-threading in a near future

Sounds good, would you be willing to jump on a call to explore what the best API would be for your use-case?

DmitriiShubin commented 2 weeks ago

sure, please feel free to reach out shubin.dmitrii@gmail.com

DmitriiShubin commented 2 weeks ago

and thanks for the info!