Forum Discussion
brewsdltn
Jan 08, 2021Copper Contributor
strange addition??
I am setting up a column with 6000 rows with values from 150 to 750 by increments of 0.1 so I put 150 in row 2 (cell A2) , 150.1 in row 3, 150.2 in row 4 & then selected the series and sent down to 6...
JMB17
Jan 08, 2021Bronze Contributor
It's precision error due to floating point math and binary fractions.
https://docs.microsoft.com/en-us/office/troubleshoot/excel/floating-point-arithmetic-inaccurate-result
https://docs.microsoft.com/en-us/office/troubleshoot/excel/floating-point-arithmetic-inaccurate-result