Results of math with integer
3 vues (au cours des 30 derniers jours)
Afficher commentaires plus anciens
Dear community,
I recently had to work with uint8 and did some simple calculations over it. I tought using integer math tells that if we woukd result in a non integer result, the non integer part gets truncated:
a=uint8(4);
b=uint8(7);
median([a b])
shouldn't this be 5, since the median of 4 and 7 would be the mean = 5.5 and then truncated to 5. Or is this just a matlab convention that results are rounded like doubles?
similarly
mean([a b])
the result is a double, but shouldn't it be a uint8 (and rounded according to whatever convention)? The data type is explicitly supported in the documentation of mean.
I was just wondering.
best regards
Jonas
0 commentaires
Réponse acceptée
Stephen23
le 22 Juin 2022
Modifié(e) : Stephen23
le 22 Juin 2022
"I tought using integer math tells that if we woukd result in a non integer result, the non integer part gets truncated:"
What you were taught is true for some other languages, but note that "MATLAB rounds the result, when necessary, according to the default rounding algorithm."
The MEDIAN() documentation states "median computes natively in the numeric class of A, such that class(M) = class(A).", which together with the rounding information above explains the output that you show (assuming that for an odd number of elements the middle two are averaged).
The MEAN() output class is given in this table:
mean(uint8([4,7]),'native')
Plus de réponses (0)
Voir également
Catégories
En savoir plus sur Matrix Indexing dans Help Center et File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!