开发者

Excel Floating Point Arihmetic - What Type Does It Actually Use

From a previous questions someone indicated that Excel uses a 64 bit (8 byte) double-precision floating.

Is that correct - Is there any material on this at all?

I am try开发者_开发技巧ing to tie off numbers and this is killing me!


According to this article yes, it uses 64 bit double precision floating point numbers. The article also describes the rounding errors etc associated with this format.


Have a look at

Floating-point arithmetic

Under the section Precision

A floating-point number is stored in binary in three parts within a 65-bit range: the sign, the exponent, and the mantissa.

Here is another article

Understanding Floating Point Precision, aka “Why does Excel Give Me Seemingly Wrong Answers?”

Have a look at the section Structure of a Floating Point Number

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜