search

neighthan / cometml_api

Python bindings for the CometML REST API.
MIT License
3 stars 1 forks source link

Add new endpoints #2

Open neighthan opened 5 years ago

neighthan commented 5 years ago

Several endpoints have been added since I wrote the Python API here. It would be good to go through and add the new ones at some point.

dsblank commented 5 years ago

We have also released our own REST API at comet.ml BTW. If we can do anything there so you don't have to maintain this, let us know! https://www.comet.ml/docs/python-sdk/Comet-REST-API/ Or, if there is anything we can add to better support yours, let us know that too!

neighthan commented 5 years ago

Thanks for the note! I'll make sure to take a look at the official Python API before making any updates here; that probably won't be right away, though, as I'm busy with other things. From a quick glance over the page you linked, it looks like it would be good for me to let your library handle the lower-level calls to the REST endpoints so that I don't duplicate the work there and because your library will be better maintained when there are updates.

I'll probably keep this library around for higher-level calls, unless you're interested in PRs to add functionality to your library (well, not exactly a PR if it's closed-source, but I could send reference implementations). I understand that what higher-level functions one wants could get too specific for different users, though. For me, for example, the most common use case is wanting to get all experiments that match some query based on their hyperparameters and then return certain metrics from those experiments in a dataframe that can easily be aggregated and plotted. Once the charting in Comet can handle aggregating experiments, I probably won't use this library much myself either.

dsblank commented 5 years ago

Probably best would be to send descriptions of behaviors (or syntax) that you would like, if we don't support that already.

We also have a query API planned that will allow fast, specific searches from the SDK, and more advanced charting options from the UI. Stay tuned!