search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
18.42k stars 1.29k forks source link

colab: with BentoML #1117

Closed aarnphm closed 1 month ago

aarnphm commented 1 month ago

Hi @danielhanchen @shimmyshimmer,

Thanks for calling us out. We shouldn’t have mentioned our commercial platform in this Colab. We have since updated the Colab and removed commercial offering, leaving only the integration with BentoML open source. Do you think this would make us meet the bar?

Aaron

darkacorn commented 1 month ago

idk why that needs to be in the repo really - mind me asking as a raw contributor what the benefit to unsloth are ? seems to be you get way more out of that .. - ollama makes sense but that is just raw promoting a other company for little gain

shimmyshimmer commented 1 month ago

Hi Aaron appreciate your contributions however at this time our main table is already quite crowded and so we will not be accepting any 3rd party integrations at this time.

aarnphm commented 1 month ago

Thank you @shimmyshimmer for considering the PR. Our intention was to help the BentoML community to fine tune models with unsloth. Hope we can collaborate at a later time.