Forum Discussion
Solved
FREQUENCY() bug or floating point error?
I think this is an easy-to-reproduce bug with frequency() function in Excel. Please also look at the screenshot at the end. ---- PPS: As the Dellef_Lewin confirmed in his response below towards...
When I save the workbook and look into the XML data I see numbers like this:
1.1000000000000001
1.3000000000000003
1.5000000000000004
2.2999999999999998
3.9000000000000026
Definitely floating point error.
(EDITED)
Is this a floating point error really? because when I checked numbers displayed in 30 precision digits, it shows correctly!
Probably looking at the underlying XML files is the only way.
Thanks to @Detlef_Lewin for confirming. I can consider the alternative workarounds that use 15 digits only.
When I save the workbook and look into the XML data I see numbers like this:
1.1000000000000001
1.3000000000000003
1.5000000000000004
2.2999999999999998
3.9000000000000026
Definitely floating point error.