How is the division of two numbers carried out in Matlab?
130 vues (au cours des 30 derniers jours)
Afficher commentaires plus anciens
The behavior is as expected when both the denominator and the numerator are in 'double' precision. If either of the two are integer, as in the example below, the rounding error yields unexpected division results.
double(475904) / double(512) = 929.5
int32(475904) / int32(512) = 930
int32(475904) / double(512) = 930
double(475904) / int32(512) = 930
Réponses (1)
John D'Errico
le 23 Mar 2018
Modifié(e) : John D'Errico
le 23 Mar 2018
Think about what the class of the result is. If you don't know how to use the class function to check that, then learn to read the output of the whos command. (In fact, in newer MATLAB releases, just displaying a variable at the command line tells you the class, if it is not a double.)
Then consider if the result is stored in an integer variable, then why would you expect a non-integer result? That is, an int32 cannot represent non-integers. So MATLAB stores only the integer part, essentially rounding to the nearest integer.
double(4) / int32(3)
ans =
int32
1
double(5) / int32(3)
ans =
int32
2
Voir également
Catégories
En savoir plus sur Logical dans Help Center et File Exchange
Produits
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!