Closed fkleedorfer closed 3 months ago
I actually tried to allow trailing zeroes. There is a case with one trailing zero, which passes, if I am not mistaken... It's one regex that does that. First we have to figure out what behavior we want, then we can change the regex
Agreed. Let's see what others think. I was going to test adding some non-zeroes beyond the resolution of xsd:double to see if it would pass, but didn't get that far. My thought is that a deviation beyond the resolution of xsd:double is fine. We should consider the xsd:decimal as the "master value", and the xsd:double as a human-readable approximation.
Here is what I think we all want:
Hence, trim trailing zeros behind the decimal point except for the first, in both SN and ctual value before comparing.
I'm a little unclear on your trimming. Would this be how you might trim?
0.00100 trims to 0.001 1.00E-3 trims to 1.0E-3
...and then you compare?
That's what I meant
Updated the shapes to do exactly what's described above:
Constraints added for