How to improve double precision?
Afficher commentaires plus anciens
I have made below code
a=11;
b=256;
c=a/b
and the output said c=0, which was not I had expected
So I have used cast operator
a=11;
b=256;
c=double(a/b)
and the result returns the same value; 0
I have searched Matlab document and found that the default precision of double data type is 32
so It should return 0.04296875 instead of 0. But still get 0 for this kind of codes
How to fix it properly?
Réponse acceptée
Plus de réponses (0)
Catégories
En savoir plus sur Logical dans Centre d'aide et File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!