Forum Discussion
Phil_Couzens
Nov 07, 2023Copper Contributor
Calculation error in spreadsheet
I am having a problem with fraction calculations using the sum function. For Example: Cells a1 and b1 formatted as time values Cells c1, d1, e1 in number format c1 sum(b1-a1)*24 hourly rate e...
mibrady
Microsoft
Nov 07, 2023Ah! It just occurred to me. It is a rounding error. So, I realize that 58.74 is 2.67*22. However, 2.67 is a rounded number for 2 2/3. Thus, 58.67 is actually the more accurate number as it doesn't round until the end of the equation.
Phil_Couzens
Nov 07, 2023Copper Contributor
If I enter the 2.67 in an extra cell manually, and then formulate the final cell. The result is 58.74.
Could it be a format error in cells a & b
Could it be a format error in cells a & b
- mibradyNov 07, 2023
Microsoft
So, the actual solution to 4:40-2:00 in hours as a number is 2.66666666..... not 2.67. That is why I was referencing 2 and 2/3 as that is the more exact representation. 40 minutes is 2/3 of an hour. So, when it multiplies 22 by the actual formula, it multiplies it by the unrounded number. That results in the 58.67. I would argue that 58.67 is the correct answer, not 58.74.