primary school question!

well, a silly question
why 0.07*400 is not equal to 28?
see screenshot;

Réponses (1)

Image Analyst
Image Analyst le 28 Nov 2020

0 votes

Truncation error due to double's only using 64 bits instead of an infinite number of bits. It will be off a very small amount, eps(28). See the FAQ for a thorough discussion:

Catégories

Produits

Version

R2020a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by