-
Hello everyone, thank you for the great job!
I am trying to further fine-tune the LLaVA architecture using your implementation with LLaMA 3 Instruct 8B. I can already fine-tune the Vicuna model usi…
-
Hi 👋🏻 Do you have any inference examples that I could use?
-
**Describe the bug**
What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图)
```
swift infer --model_type internvl2-8b-awq --infer_backend lmdeploy
```
```
WARNING:ro…
-
```bash
(graphrag-ollama-local) $ python3 -m graphrag.query --data ./ragtest/output/20240709-054243/artifacts/ --method local "What is machine learning?"
INFO: Reading settings from environment va…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [x] 2. The bug has not been fixed in the latest version.
### Describe the bug
I try loading and make infere…
-
Looks like a good project and I would like to try this, would it be possible to add HF / Gemini options? HF has more diversity and Gemini is smarter, neither has "customer noncompete clause" like this…
-
Tracker issue for adding [LayerSkip](https://arxiv.org/abs/2404.16710) to AO.
This is a training and inference optimization that is similar to layer-wise pruning. It's particularly interesting for…
jcaip updated
1 month ago
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
## Describe the bug
Have a look :-)
https://github.com/user-attachments/assets/321dbb21-2403-4330-9ce1-091902298888
## Latest commit or version
0.22
MBP M3 Max
-
### Check for existing issues
- [X] Completed
### Describe the bug / provide steps to reproduce it
When testing out the "Assistant Panel" I've noticed that after querying a model that's runni…