-
I meet this problem when I am running model facebook/opt-125m with MII. I am using Tesla V100, Driver Version: 470.82.01 CUDA Version: 12.1
```
Python 3.10.13 (main, Sep 11 2023, 13:44:35) [GCC…
-
我也遇到了类似的问题,找不到stdatomic.h,不过我是在linux平台
```
root@n1 ~/z/PowerInfer (main) [2]# cmake --build build --config Release …
-
```bash
ERROR: Could not find a version that satisfies the requirement sherpa_onnx==1.5.4 (from versions: 1.8.9, 1.8.10, 1.8.11, 1.8.14, 1.9.0, 1.9.1, 1.9.3, 1.9.4)
ERROR: No matching distribution f…
-
How are the gguf weights quantized to INT4? is there a script similar to llama.cpp to convert to fp16 weigths to q4_0?
Please share more details about INT4 model.
-
Package: json-c[core]:x64-windows -> 2022-06-26#2
**Host Environment**
- Host: x64-windows
- Compiler: MSVC 19.36.32532.0
- vcpkg-tool version: 2023-03-29-664f8bb619b752430368d0f30a8289b761…
-
othrer dependences packages work well
Julia Version 1.9.3 Commit bed2cd540a (2023-08-24 14:43 UTC)
Build Info: Official https://julialang.org/ release Platform Info:
OS: Windows (x86_64-w64…
-
-
### 先决条件 (Prerequisites)
- [X] 我已确认这个问题没有在[其他 issues](https://github.com/mirrorz-org/mirrorz-help/issues)中提出过。
I am sure that this problem has NEVER been discussed in [other issues](https://github.co…
-
Hi, brainpy team:
Based on the source code (https://brainpy.readthedocs.io/en/latest/_modules/brainpy/_src/math/activations.html#softplus):
```python
def softplus(x, beta=1, threshold=20):
x =…
-
GitHub new**
![Uploading photo_2021-03-04_17-04-40.jpg…]()
**