[Matrix] The vis does not allow to distinguish numeric values that are very close

[loichuder]

Is your feature request related to a problem?

I happened to find a dataset (link below) with only 2 values that are extremely close numerically but yet different. When looking at the Line vis (see screenshots below), I see that the two values are different (the line is not horizontal).

But the numeric precision of the tooltip and of the Matrix vis does not allow me to see this difference.

Requested solution or feature

Not sure. Perhaps a way of specifying the number of digits in fixed-point notation as suggested earlier in #1175 ?

Alternatives you've considered

Export as CSV and reading the values there but that is really convoluted.

Additional context

Dataset:

/1.1/instrument/positioners/obpitch in strain.hdf5

Screenshots

Line vis:

Matrix vis:

[axelboc]

I'd be okay with adding a "Precision" field in the toolbar. Only problem I see is that we would have to pick a default precision that works for all notations out of the box. Currently we use the following numeric formats:

• Fixed-point: .3f (or .2f for complex members)
• Scientific: .3e (or .3~e for complex members)
• Auto: .5~g (or .3~g for complex members)