-
C11/C++11 added[hexfloat](https://en.cppreference.com/w/c/language/floating_constant) as alternative floating point representation.
The underlying reason is that machines represent floats in base 2, …
-
* I would suggest to have a flag that enforces standard compliant JSON on output and raise an exception if not.
Users that care about performance can keep that flag off, but users that care about cor…
-
### Description
This RFC proposes adding support for computing the complementary error function for single-precision floating-point numbers.
The package is the single-precision analogue to `@stdli…
-
Took me a while to figure out while the [ColorJitter](https://pytorch.org/vision/stable/transforms.html#torchvision.transforms.ColorJitter) transform produced strange results (mostly fully saturated i…
-
**Summary of the new feature**
When you use bigint and add or multiply a floating point number, the result is wrong.
I discussed it with the PowerShell team but they don't want to fix it.
https:/…
-
Right now we consider all non-fastmath floating point intrinsics (other than muladd, which LLVM may implement as either an fma or a multiply add) as `:consistent`. However, as discussed in https://dis…
-
We observe this error in v1.1.9
If I replace the binary response variable with a qualitative one step2 runs successfully. Additionally, if I use plink inputs to step2 instead of imputed bgen files …
-
When displaying the value of a fractional float constant in the status bar, there appears to be some decimal separator issue.
```
CON
LOL = 44.1
```
leads to
![image](https://user-images.githubu…
-
The BSON and Avro formats support encoding decimal floating-point numbers which cannot be exactly represented by a `float64`. Currently, neither the `bson` or `avro` decoder packages actually support …
-
This test fails in Firefox on Linux. Does not fail in Firefox on Windows, or in Chrome at all.
http://localhost:8080/Specs/SpecRunner.html?spec=Renderer%2FFramebuffer%20draws%20to%20a%20half%20floa…