-
On my system, which doesn't have native `Float16`, the method for `rounding(Float16)` doesn't exist. As far as I see effectively the rounding mode is `RoundNearest`, no? So I guess the method should b…
-
I see that #52 adds support for `_Float{32, 64, 128}` which all seem to work, but there seems to be no support for `_Float16`. Is this something that can be added in?
-
ValueError: Requested float16 compute type, but the target device or backend do not support efficient float16 computation.
-
This is on mac-arm64 running macOS 15.0 24A335 with Xcode 16.0 16A242d. I expect that this would also occur targeting mac-arm64 on macOS 14 as long as Xcode 16 is used.
While bootstrapping gcc-12.4…
-
### What happened?
I tried to use the [jini model](https://huggingface.co/jinaai/jina-embeddings-v2-small-en) with mean pooling, [sbert](https://huggingface.co/ai-forever/sbert_large_nlu_ru) like in …
-
Float mismatch error after float16 quantization :Data in initializer 'onnx::Add_2877' has element type tensor(float16) but usage of initializer in graph expects tensor(float)
`model_fp16 = float16.…
-
Hello,
I tried to run a fast tuning of GEMM with float16:
```python
from bitblas.base.roller.policy import TensorCorePolicy, DefaultPolicy
from bitblas.base.arch import CUDA
from bitblas.base.uti…
-
```
PS F:\whisperX-main> whisperx audio.mp4 --model large-v2 --diarize --highlight_words True --min_speakers 5 --max_speakers 5 --hf_token hf_x
C:\Users\kc01\AppData\Roaming\Python\Python310\site-pa…
-
## 🐛 Bug
## To Reproduce
Using this model [Phi-3-vision-128k-instruct](https://huggingface.co/microsoft/Phi-3-vision-128k-instruct)
I got some bugs, need your help !!!
For phi3-v problem, w…
-
Can we add [half](https://half.sourceforge.net/) as a dependency to support half precision floating point number?
I've done a bit of simple test, it seems work fine.