-
### Context
This task regards enabling tests for **baichuan2-7b-chat**. You can find more details under openvino_notebooks [LLM chatbot README.md](https://github.com/openvinotoolkit/openvino_notebook…
-
I tried to do model conversion in windows and encountered different errors in both attempts. The errors are reported as below, how can I fix these problems?
First:
(openvino_env) C:\Users\dell\c…
-
### Context
Tried to isntall openvino on an Intel core ultra 155h with Ubuntu 24.04 using the prebuilt wheels and instructions as well as by trying to build it from scratch,both failed
### What need…
-
### Description
## **TL;DR**:
Discussions in #305 and #312 have led me to believe that we need to update our interfaces and that in doing so we can resolve a lot of issues with the current desig…
-
- [ ] [py-shiny/README.md at main · posit-dev/py-shiny](https://github.com/posit-dev/py-shiny/blob/main/README.md?plain=1)
# py-shiny/README.md at main · posit-dev/py-shiny
## Description
"# …
-
### Request description
I am running an end-to-end workload and I find that running iree-benchmark-module with `--device_allocator=caching` results in a 15-20% speedup. After subsequent optimizations…
-
![image](https://github.com/opea-project/GenAIComps/assets/115651903/73bb82a7-f438-436b-bcaf-eb63cac972c0)
vLLM-openVINO is failing to build
-
### System Info / 系統信息
2024-05-28 02:13:29.805993: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-of…
-
I've used https://github.com/openvinotoolkit/openvino.genai/tree/master/llm_bench/python to test llama3's perf, which is a little low.
python benchmark.py -d GPU -m D:/AIGC/llama/models/Meta-Llama-3-…
-
### What happened + What you expected to happen
(_train_tune pid=59932) /Users/leo/web3/LLM/langchain/venv/lib/python3.10/site-packages/ray/tune/integration/pytorch_lightning.py:198: `ray.tune.integr…