Precision issues when checking for a whole number

16 vues (au cours des 30 derniers jours)
Hugo  Braz
Hugo Braz le 5 Mar 2016
Commenté : Hugo Braz le 5 Mar 2016
Good evening to all,
Part of my homework is checking if the number entered by the user is a whole number. I've managed to do that already, but my question is related to precision.
What I thought on using:
if (round(num) ~= num) OR
if (mod(num, 1) == num)
end
Both options worked well when I entered a number with 15 or less decimal places. Is there any way for them to work when entering a number with more than 15 decimal places?
Thank you in advance!
  2 commentaires
Stephen23
Stephen23 le 5 Mar 2016
MATLAB uses IEEE standard floating-point numbers, which have a specified and known precision. How do you expect to get more precision out of them than they can actually store?
Hugo  Braz
Hugo Braz le 5 Mar 2016
Thank you all! I've started a MatLab course this semester and I didn't really pay much attention in these details.

Connectez-vous pour commenter.

Réponse acceptée

Walter Roberson
Walter Roberson le 5 Mar 2016
No. By the time you reach +1 or -1 as you go further away from 0, the distance between representable numbers has reached 2.22044604925031e-16 . The only whole number that can have 16 digits of precision is 0 itself.

Plus de réponses (1)

Roger Stafford
Roger Stafford le 5 Mar 2016
Modifié(e) : Roger Stafford le 5 Mar 2016
Actually x>=0 and either round(x)==x, floor(x)==x, or ceil(x)==x are always valid tests for whether x is a whole number as stored in matlab's memory, regardless of how many decimals may have been used to enter x into the memory. However inputing a number into the memory may require a conversion from decimal to binary and can very well change a number from a non-integer to an integer. It is also quite possible to have a matlab whole number which requires more than 16 decimal digits to express exactly, such as 1152921504606846976. Hence, the question of precision only applies to the entry process, not to the above tests.

Catégories

En savoir plus sur Logical dans Help Center et File Exchange

Produits

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by