non accurate float representation

questdb / ui

Monorepo of QuestDB UI packages

https://questdb.io

16 stars 24 forks source link

non accurate float representation #351

Open superichmann opened 1 month ago

superichmann commented 1 month ago

the float data isnt shown correctly on ui. i have a table with CAST(0.000000001 as FLOAT) value inside. ui shows value: 0 csv download value: 0.0000 npgsql .NET value: 1E-09 // exact and correct.

Maybe consider to show the correct value as well on the ui ;] qdb 8.1.1

bluestreak01 commented 1 month ago

as a workaround you can configure this parameter to improve float scaling:

http.json.query.float.scale=10

The default value is 4 - we will consider bumping it.