search

gtg922r / obsidian-numerals

An obsidian plugin which turns a math code block into a full featured calculator
Other
389 stars 7 forks source link

Issues with rounding and numbers less than 0.0005 #42

Open awsharif opened 1 year ago

awsharif commented 1 year ago

Hi thanks for the development of numerals.

I just want to flag an issue - it appears you are unable to get accuracy more than 3 decimal places. This does not impact calculations but when the result is less than 0.0005 it will render as 0. Additionally round() function did not seem to help. Rounding greater than 3 decimal places does not register. Is this a known bug? Screenshot below. Issue persists across math, math-tex and math-plain.

Thanks!

Screenshot_20230410_045111_Obsidian.jpg

publicvirtualvoid commented 6 months ago

Having the same problem, is there any way to address this?

gtg922r commented 6 months ago

@publicvirtualvoid can you provide some example math blocks where you were seeing this to help me debug

over2sd commented 4 months ago

image I'm experiencing the same problem. See the lines where m,p,d, and e are defined for the start of the problem, and lines for k and l for the resulting 0 delta.

gtg922r commented 3 months ago

I believe this is a result of using default System Formatting. If you change the "Rendered Number Format" option you can force it to show results in engineering or scientific notation:

image

Does this solve your need? Is there a different solution you want to see?

over2sd commented 3 months ago

No. I tried each of the format options. None of them result in anything over three digits of precision.