-
Hi,
After I updated h2ogpt code to latest (commit 6a7283eb66096d188f796760f58680c1d9c16dbc) I started to get ggml_allocr_alloc: not enough space in the buffer , using Nvidia A10 with 24GB VRAM. It wa…
-
OS: windows 11, 13900H
bigdl 0815
long 2nd Avg latency from No.2 chat.
```
******* 1 ******* Write a Python function to generate the nth Fibonacci number
********** Switch model from None to S…
-
original issue, supposedly fixed: https://github.com/gradio-app/gradio/issues/4092
streaming may be blocker, seems to get slower near end of generation, or may be above only.
Maybe can batch too…
-
I followed the [CPU tutorial ](https://github.com/h2oai/h2ogpt/blob/main/docs/README_CPU.md) and at the last step I get this error.
This issue was also [raised by](https://github.com/h2oai/h2ogpt/…
-
(wenglm) D:\LLM\WebGLM>python web_demo.py
WebGLM Initializing...
Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████…
-
I tried to create embedding of the new document using "BAAI/bge-large-en" instead of "hkunlp/instructor-large" and i used the following cli command for running it:
`python generate.py --base_model=…
-
### 这个bug是否已存在现有issue了?
- [X] 我确认没有已有issue。
### 错误表现
D:\ChuanhuChatGPT\ChuanhuChatGPT>python ChuanhuChatbot.py
Traceback (most recent call last):
File "ChuanhuChatbot.py", line 10, in
…
-
Hi,
I generated db with my emails, downloaded from Gmail, and I can use UserData data source , or I can use LLM / ChatLLM data sources. Is there any option combine them ? As UserData contains only my…
-
# Use MiniGPT-4 in Colab
If you want to use miniGPT-4 in Google Colab, You must **use GPU and you are a Google Colab Pro user**, Otherwise you will not be able to use colab!
1. I provided a [Minig…
-
您好,我的电脑是intel的集成显卡,不过CPU是i5-11400 @ 2.60GHz ,内存64G;
运行时告知我找不到nvcuda.dll,模型无法运行;
装了几个Gnvidia的开发者包后,还是同样报错。网上找了nvcuda.dll,都太旧;全C盘搜索了这个文件,找不到。
请问如何直接用CPU运行,而绕过nvcuda这个要求呢?
已经将两处的选择项写死:
EMB…