Not able to train the mistral model

lamini-ai / lamini

The Official Python Client for Lamini's API

https://lamini.ai/

Apache License 2.0

2.52k stars 151 forks source link

Not able to train the mistral model #52

Closed teja0508 closed 6 months ago

teja0508 commented 7 months ago

Seeing above error

teja0508 commented 7 months ago

@sharonzhou @greg1232 Details:: Job ID 5932

Model ID 32ec8321e2d3cde284cd89fc554ea9584f859a456e5ecb29e298c5da6282819c

Dataset ID 1a6ae24964be6fee9d29b42523f463efc39840ce61f3849067dbfc1b5ec2fcfa

teja0508 commented 7 months ago

And every time if i refresh the browser. it is asking for auth. it doesn't require every time right. it should have some timeout. please check this issue also.

reference img:

edamamez commented 7 months ago

Looking into it, thank you for reporting! 🙌

edamamez commented 7 months ago

For the training failure, you should still be able to run inference on the model -- it looks like it failed during eval after the model was checkpointed.

We are working on a fix.

teja0508 commented 6 months ago

@edamamez can you please show me the sample code for to inference already trained model. is there any code link. please share here.

edamamez commented 6 months ago

Hi @teja0508! On the job in the train tab, you can use the Playground UI:

If you prefer using Python, you can instantiate and call generate on the model: https://lamini-ai.github.io/lamini_python_class/__call__/

For your model it would be this:

from lamini import Lamini

llm = Lamini(model_name="32ec8321e2d3cde284cd89fc554ea9584f859a456e5ecb29e298c5da6282819c")

prompt = "What are llamas?"
response = llm.generate(prompt)
print(response)

edamamez commented 6 months ago

The training bug has been fixed as well, please try running the job again! Thank you for reporting 🙌

Feel free to reach out to info@lamini.ai with your email to get some credits as thanks!