search

ollama / ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.
https://ollama.com
MIT License
94.8k stars 7.5k forks source link

molmo by allen ai support #6958

Open olumolu opened 4 weeks ago

olumolu commented 4 weeks ago

GYVKif8XoAAFLAw https://huggingface.co/allenai/Molmo-7B-D-0924 https://huggingface.co/allenai/Molmo-72B-0924 This models are really good and have potential and fully open-source please give support for them.

thanks.

AlgorithmicKing commented 4 weeks ago

WE REALLY REALLY NEED THAT MODEL!!!!!!

olumolu commented 4 weeks ago

https://github.com/ggerganov/llama.cpp/issues/9645

3unnycheung commented 4 weeks ago

yes

Streamweaver commented 4 weeks ago

Fully agree.

someshfengde commented 4 weeks ago

yess !!

Owen718 commented 3 weeks ago

Fully agree +1. REALLY NEED.

ParthaPRay commented 3 weeks ago

Please give support for 1B model for edge deployment

someshfengde commented 3 weeks ago

Hi @ParthaPRay I don't think so we will be able to run that model on edge. I tried running over L4 GPU but no luck. Though after quantization I think I might be able to run it over L4 .

--from documentation MolmoE-1B is a multimodal Mixture-of-Experts LLM with 1.5B active and 7.2B total parameters

Documentation link:

https://huggingface.co/allenai/MolmoE-1B-0924

t3chn0m4g3 commented 3 weeks ago

100% +1

ParthaPRay commented 3 weeks ago

Dear @Streamweaver , I think it is doable. Currently I am trying various small LLMs quantized pieces to run on edge. I found success, If you can provide support for 1B for MolmoE with Q4_M or Q4_0 it would suffice.

ashisdeveloper commented 3 weeks ago

10000% yes

arthurwolf commented 3 weeks ago

Please.

hudijiang commented 3 weeks ago

yes

Amazon90 commented 3 weeks ago

PLEASE PLEASE PLEASE

olumolu commented 3 weeks ago

What is the status

maxruby commented 3 weeks ago

Thank you ollama Team for your great work :)

Is this task dependent on resolution of https://github.com/ggerganov/llama.cpp/issues/9645? Any estimate on how long it might take to support Molmo-72B-0924 via ollama?

ParthaPRay commented 3 weeks ago

Help on molmo 1B

ParthaPRay commented 3 weeks ago

Include Molmo 1B via ollama. It helps for edge deployment.

xSNYPSx commented 3 weeks ago

+1 for molmo 7b D

sfdkiaei commented 2 weeks ago

and https://huggingface.co/allenai/Molmo-7B-D-0924 please.

olumolu commented 4 days ago

What is the status for supporting this model. Why ollama does not support proper open-source models instead of supporting so called opensource llama meta or Microsoft models. @dhiltgen

I-I-IT commented 4 days ago

Since Molmo has not made available gguf weights, it is difficult to include it in ollama or any other AI client for that matter.

arthurwolf commented 4 days ago

Why ollama does not support proper open-source models instead of supporting so called opensource llama meta or Microsoft models.

You're talking to volunteers spending their free time doing something nice for you, for free, instead of spending time with their friends, or family, or making money, or doing something fun.

Maybe calm down with the attitude? How about you do it?