Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I am getting wrong answers to simple math problems in excel 2010. Possibly related to rounding. How can I fix this?

Example: Calculator figures .77*32 as 24.64, Excel figures it as 24.60

share|improve this question
    
From the looks of things it's just rounding them to 1 decimal place. –  ohope5 Apr 30 '13 at 18:46
2  
Do you get 24.60 or 24.6? Maybe it's just formatting results and showing 1 decimal place, but actual precision is better. –  gronostaj Apr 30 '13 at 18:56
    
what are your cell format settings? –  Frank Thomas Apr 30 '13 at 18:58
2  
The only way I can get that result in Excel is to use a custom format along the lines of #0.0 or ##.# so that the last decimal place is rounded or ignored. Reformat the cell as a number with 2 decimal places and post back with the result –  Tog Apr 30 '13 at 19:09
1  
I just tested this and it works fine. –  KronoS Apr 30 '13 at 19:10

1 Answer 1

excel work with 8 byte numbers bydefault and have 15 digit presision. i was unable to duplicate your example in office 2010 for mac and windows version.

Most likely that you are looking at formatted numbers. 24.64/32=0.76865. Is your 0.77 not perhaps formatted already?

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.