-
Excellent speed improvements with this, thank you for the great work!
I noticed quite a few results are being cut off mid sentence. Using the image at the [top of this article](https://www.linkedin…
-
Can I fine tune the model with the images using coordinates to detect the object?
If it is possible, how can achieve it?
At what image size the model take to fine tune with?
-
Getting the following error when using gradient checkpointing with PEFT LoRA training.
> NotImplementedError
> self.get_input_embeddings()
```
Traceback (most recent call last):
File "/home…
-
### What is the issue?
I'm receiving this message when running moondream on a few jpg images:
[GIN] 2024/08/14 - 22:17:49 | 200 | 407.4667ms | 127.0.0.1 | POST "/api/chat"
time=2024-…
-
Hello, great work first of all, secondly i would like to know if it is possible to use a large language model like llama inside moondream to make it able to write promotional material from images, suc…
-
The inference code provided in this repository forces moondream to run on CPU. We should allow the user to leverage GPUs and Flash Attention for faster inference if they want to.
-
```
model = AutoModelForCausalLM.from_pretrained(
File "/home/user/.local/lib/python3.8/site-packages/transformers/models/auto/auto_factory.py", line 561, in from_pretrained
return model_…
-
### What happened?
export LLAMA_CUDA=1 # only if for NViDiA CUDA
export CUDA_DOCKER_ARCH=compute_86
make -j$(nproc) NVCC=/usr/local/cuda/bin/nvcc
./llama-llava-cli -m ./m2/moondream2-text-model-…
-
Just opening a feature request to track this.
Previously mentioned in #24
DrJKL updated
1 month ago
-
why does the moondream model not unload when done processing? ksampler takes 3 times as long when I use it. And when I look in task manager the memory on my gpu exceeds the dedicated memory and starts…