-
multi image inference for "OpenGVLab/InternVL2-8B" not working
I got this inference code from here https://github.com/vllm-project/vllm/blob/main/examples/offline_inference_vision_language_multi_…
-
### Your current environment
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: CentOS Linux release 7.9.2009 (Core) (x86_64…
-
- [ ] [At the Intersection of LLMs and Kernels - Research Roundup](https://charlesfrye.github.io/programming/2023/11/10/llms-systems.html)
# At the Intersection of LLMs and Kernels - Research Roundup…
-
### Your current environment
The output of `python collect_env.py`
```text
Your output of `python collect_env.py` here
```
### 🐛 Describe the bug
The below command does not work
```
…
-
Hello everyone, I'm using Claude-3-sonnet as a model for the multimodal chatbot. If I upload the image using the appropriate button in the chat, the model works fine.
However, if I wanted to query t…
-
### Your current environment
I use vllm to serve like
`vllm serve OpenGVLab/InternVL2-8B --max-model-len 4096 --trust-remote-code --limit-mm-per-prompt image=2`
but it raise error
Process Spa…
-
- [ ] [skorokithakis/ez-openai: Ez API, ez life.](https://github.com/skorokithakis/ez-openai)
# TITLE: skorokithakis/ez-openai: Ez API, ez life
**DESCRIPTION:**
AGPL-3.0 license
Ez OpenAI
My opi…
-
## [LangChain Development](https://app.pluralsight.com/library/courses/langchain-development/table-of-contents)
by [Tom Taulli](https://app.pluralsight.com/profile/author/tom-taulli)
founder : H…
-
### OpenVINO Version
2023.0.2
### Operating System
macOS Systems for Apple Silicon
### Device used for inference
CPU
### Framework
None
### Model used
LLaVA
### Issue description
I followed…
-
issues left for screenpi.pe:
- ✅ concurrency issue (db request through api while running)
- need more testing on audio, video, if everything properly recorded
- indexes, speed
- no memory leak
…