Wednesday 3 February 2010

Error 16 digit number in excel 2003

If you type 16 digit or more in excel 2003, example 455558977564345999 cannot be represented in Excel's numeric storage format.. If you don't need to do math with it, then prefix with a single quote to store it exactly as text.


Almost all software (including Excel) follows the IEEE standard for 455558977564345999 double precision storage of numbers. The binary representation defined there can distinguish every 15 decimal digit number


Excel does do things a bit oddly when you enter more than 15 digits; it truncates to 15 digits before conversion to binary, whereas most otherpackages would use the trailing digits to fine tune the binary approximation so that they would display 455558977564345000

Related Posts by Categories



No comments:

Post a Comment

Random Posts