Almost all software (including Excel) follows the IEEE standard for 455558977564345999 double precision storage of numbers. The binary representation defined there can distinguish every 15 decimal digit number
Excel does do things a bit oddly when you enter more than 15 digits; it truncates to 15 digits before conversion to binary, whereas most otherpackages would use the trailing digits to fine tune the binary approximation so that they would display 455558977564345000
No comments:
Post a Comment