togethercomputer / together-python

The Official Python Client for Together's API
https://pypi.org/project/together/
Apache License 2.0
31 stars 7 forks source link

together.Model.ready(model_name) #29

Closed clam004 closed 1 year ago

clam004 commented 1 year ago

This PR fixes https://github.com/togethercomputer/planning/issues/2254. It allows users to check if their newly finetuned model is finished deploying and ready for completeions using our inference API:

together.Model.ready("user/ft-dd93c727-f35e-41c2-a370-7d55b54128fa-2023-08-16-10-15-09")
# {'ready': 'model is ready for start, status code:1'}
# {"ready":"model is not ready for start, status code:0"}
# {"ready":f"No matching model name found for user/ft-dd93c727-f35e-41c2-a370-7d55b54128fa-2023-08-16-10-15-09."}

the status code is our depth_num_asks

clam004 commented 1 year ago

we decided to create a new API instead of do this via CLI

clam004 commented 1 year ago

Sorry for the false PR, the issue was updated that we should do this from the API end and not from the python library CLI end.