comet-ml / opik

Open-source end-to-end LLM Development Platform
Apache License 2.0
1.35k stars 73 forks source link

gidim/ add 'get_or_create_dataset()' method #324

Open gidim opened 1 day ago

gidim commented 1 day ago

Details

The process of creating dataset is iterative. At the moment it's super painful because every time you run your code you have to check whether the dataset exists or not and then decide if to create it. The goal is to make this seamless to the user.

In addition to the the above we will need to add backend functionality that doesn't that check for duplicates before saving a new dataset item

Issues

Resolves #

Testing

@alexkuzmik please let me know how you want me to test this (e2e/unit with mocks)

Documentation