Rounding weirdness with scientific notation formatString | Jon (LabKey DevOps) | 2016-03-02 22:22 |
Status: Closed | ||
Hi Will, This definitely isn't a LabKey thing that is causing the unusual rounding, but something that is tied to Java. https://docs.oracle.com/javase/7/docs/api/java/text/DecimalFormat.html I tried to use CAST to have those numbers use DECIMAL, but nothing changed. However, floating point numbers are not exact representations of decimal numbers, so you'll always get this kind of odd behavior, regardless of programming languages. Regards, Jon |
||