-
We noticed there's a tiny implementation difference that makes `transformer_engine.pytorch.module.rmsnorm` and also `TELayerNormColumnParallelLinear` generate results from HF implementation.
And th…
-
We tried to improve vertex/texture precision in Sodium 0.6, but it seems to not work correctly in all cases.
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
### Describe the bug
There are a few rounding/precision errors when using the search input as a calculator.
### Steps to reproduce
1. Try pi*0, result is 0E-15 (0 would be a more useful answer)
2.…
-
As of recently, the temperature inputs of the Cerbo GX Mk2 are being calibrated. However, the temperature is shown with 0 decimals precision. In the device page, there is actually 1 decimal, but its a…
-
### 🐛 Describe the bug
We will use this issue to track the failures caused by precision issue, that could because different compiler or package have different implementations.
- [ ] https://githu…
-
Good morning,
I would like to obtain information on how precision works.
Model precision set to 1e9:
```c#
private const double _eps = 1.0e9;
var precisionModel = new PrecisionMode…
-
**Describe the bug**
Precision loss of The shape and rotation of the ores, and when rotating the screen it will lag.
**To Reproduce**
Steps to reproduce the behavior:
go > 2^5 on any axis.
**…
-
Hi, thank you for your contributions!
Can you please share the ultra-high precision Emotion model ?
My email: 1835190258@qq.com
Thank you very much!
-
At the moment, a lack of type-bound procedure in the metadata implies an interface and the interface information needs to be examined by PSyclone. This does not play nicely with metadata reading and w…