feat: MobileLLM - Githubissues

janhq / models

Models support in Jan and Cortex

MIT License

5 stars 2 forks source link

feat: MobileLLM #51

Open hahuyhoang411 opened 3 weeks ago

hahuyhoang411 commented 3 weeks ago

Model Name

mobilellm

Model Source

facebook/MobileLLM-1B

Model Cortexso HuggingFace Repo

https://huggingface.co/cortexso/mobilellm

Model Description

MobileLLM is introduced: "MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases", published in ICML 2024.

Requested Formats

[X] GGUF (llama.cpp)
[ ] TensorRT (TensorRT-LLM)
[ ] ONNX (Onnx Runtime)

Additional Information

No response

Confirmation

[ ] I have created model.yml and metadata.yml files on cortex.so HugginFace repo
[ ] I have run the model through the model conversion pipeline
[ ] I have tested the model

hahuyhoang411 commented 3 weeks ago

Error: https://github.com/janhq/models/issues/52