You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi and thanks for reporting. This is unfortunately by design, due to using double value type internally and how we first convert from one unit to a base unit (Meter in this case) and then to the target unit.
We do have some ideas to improve this in #478 and in #588.
Describe the bug
Loss of precision when converting from Micrometer to Nanometer.
To Reproduce
Steps to reproduce the behavior:
Build:
Expected behavior
Converting 5100 micrometer to nanometer should yield 51000000
Screenshots

The text was updated successfully, but these errors were encountered: