Atmelfan / scpi-rs

Rust SCPI parser
Apache License 2.0
37 stars 6 forks source link

Integer loss of precision #2

Closed Atmelfan closed 4 years ago

Atmelfan commented 4 years ago

Parsing of decimal data uses a f32 intermediate. This results in a loss when converting to large integers.