-
It's not urgent but we will need it soon.
-
%%render param
n = 0.3 - 3 * 0.1
renders as `-5.551e-17`. Personally I zero values below `1e-8`, to match the behavior of `np.isclose(n, 0)`, but I suspect our physicist friends would want…
-
`IsotopeQuantity.decays_from` and `IsotopeQuantity.from_decays` can suffer in precision if halflife >> time interval. This is because the calculations involve a `1 - np.exp(-decay_const * time)` kind …
-
I have a test that looks like:
```c
assert_that(isinf(isect.t));
```
When this test fails, I get something like this on macOS using Clang 12 installed with MacPorts:
```c
/Users/sfp/LocalWorkspa…
-
Hi,
I am trying to run DBG2OLC on contigs produced by 10x genomics supernova, with Nanopore reads. However, at some point, the log prints "0 reads loaded." and then the program throws a floating ex…
-
the dashed path is not playing nice with doubles. here's a gif that shows the repainting going on when doubles are provided. i have had to enforce a list of integers in the mean time. toward that end,…
-
Redis replication is based on an assumption that all write operation is deterministic. However, I think there is some problem with the floating point arithmetic.
My previous job is networked game pr…
-
> utop # -. 1;;
> - : int = -1
In contrast, ocaml underlines 1 and reports
> Error: This expression has type int but an expression was expected of type
> float
-
```
What steps will reproduce the problem?
1. Running the translated C++ program
What is the expected output? What do you see instead?
I'm expecting the program to work. I see a floating point except…
-
```
In "Add a Work Item", it is not possible to insert a double precision number in
"Duration" field
```
Original issue reported on code.google.com by `moz...@gmail.com` on 11 Oct 2010 at 8:05