awslabs / deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Apache License 2.0
3.18k stars 519 forks source link

numerical statistical indicators have lost precision #527

Open huwujingling opened 6 months ago

huwujingling commented 6 months ago

hi masters, when I was doing basic indicator statistics to obtain the max of the NumericComlunProfile type, I found that a long integer number with a length of 19 digits was converted to a Double, and the accuracy was lost. I found that there was a similar feedback before Incorrect Mean calculation #426, his I think the suggestion is more reasonable.

### Tasks