-
With the ipex-llm docker container,
intelanalytics/ipex-llm-serving-vllm-xpu-experiment:2.1.0b2
it successfully load model in 4 ARC. But when load model in 8 ARC, it will have the following error…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### OS
Linux
### GPU
cuda
### VRAM
24GB
### What version did you experience this issue on?
3.6.0
### What h…
-
I've got some STM32F103C8's from Alieexpress. I have a project to monitor air quality and originally used a DS3232 to provide a timestamp. Then I thought I'd try to use the STM32's built in rtc to fre…
-
Hi,
I am using ThingsBoard 3.4.1, OS is Linux 20.04.
I had previously used ThingsBoard where the GW or RaspberryPi is connected to the ThingsBoard. One single device is connected to the GW and…
-
Gradio clients that run local language models such as “OobaBooga” and allow api support should be a major consideration for the roadmap process. Creating usable model swapping with a cache functionali…
-
### Issue you'd like to raise.
Hi,
I am trying to fine-tune the Falcon model. Here are my parameters:
```
model_name: "nomic-ai/gpt4all-falcon" # add model here
tokenizer_name: "nomic-ai/gpt…
-
I'm very happy that RNode now supports SX1280 modems. I want to try to use these modems for linking amateur radio repeaters using asterisk and the app_rpt functionality built into it. I want to try li…
-
Zigbee is becoming the de facto standard in home automation. It would be great if `OpenMQTTGateway` could support this protocol. Below I have a write up about the most promising solution at the moment…
-
1、launch model时配置request limit参数
2、使用locust发起性能测试
3、触发限流后,应用假死,登录ui页面,点击Launch Model->CUSTOM MODELS显示为空,点击Running Models无法查看到模型,但是执行nvidia-smi能够看到显存仍被占用
-
### Category
Hardware Compatibility, Other
### Hardware
CDEBYTE_EORA_S3
### Firmware Version
2.3.10
### Description
My test environment has three devices which are: 1. v3 mqtt net…