-
Great work! One quick question: in the paper you've reproduced the results from Llava. Additionally, for the Prismatic models experiments, you are fine-tuning the whole LM. I'm wondering did you try u…
-
When attempting to merge LoRA weights into the TinyLLaVA-Gemma-SigLIP-2.4B model, I encountered a RuntimeError due to a missing key lm_head.weight in the GemmaForCausalLM state_dict. The specific erro…
-
Hey,
I'm new to NanoLLM, so please forgive me if my question seems basic. I couldn't find any discussion group for NanoLLM so I am posting my question here. In the NanoLLM documentation, I have see…
-
Paper : [https://arxiv.org/pdf/2406.16860](https://arxiv.org/pdf/2406.16860)
Website : [https://cambrian-mllm.github.io](https://cambrian-mllm.github.io)
Code : [https://github.com/cambrian-mllm/cam…
-
### What model would you like?
Can you add support for the various new promising Idefics V2 from huggingface
https://huggingface.co/HuggingFaceM4/idefics2-8b
https://huggingface.co/blog/idefics2
i…
OLH21 updated
2 months ago
-
I've conducted additional evaluations for the various model configurations available in the Robin repository. My intention is to provide these results to the community for further insights and potenti…
-
### Feature request
With reference to the new Idefics2 model- https://huggingface.co/HuggingFaceM4/idefics2-8b
I would like to export it to ONNX which is currently not possible.
Please enable conv…
-
Error occurred when executing MoondreamQueryCaptions:
Unknown model (vit_so400m_patch14_siglip_384)
File "E:\Comfyui\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui…
-
Python3.11在使用Min2_6、Joy_caption_load、CXH_DownloadAndLoadFlorence2Model时均报权限错误(Python3.10中Min2_6、Joy_caption_load报错,仅CXH_DownloadAndLoadFlorence2Model正常)
Joy_caption_load错误信息如下:
!!! Exception dur…
-
I try to reproduce the results under base recipe. I basically get the results in the paper on VQAv2, GQA, ScienceQA and POPE. But there is almost 1% gap on TextVQA, MMMU, and MM-Vet, and the gap on MM…