Précision

Limitations de la précision, effets de l’arrondi et du remplissage

Les mots informatiques se composent d'un nombre fini de bits. Autrement dit, le codage binaire des variables ne constitue qu'une approximation d'une valeur réelle à la précision arbitraire. Par conséquent, les limites de la représentation binaire limitent automatiquement la précision de la valeur.

Rubriques

Range and Precision
Range and precision of fixed-point data types.
Maximize Precision
To maximize precision, make the slope as small as possible while keeping the range adequately large.
Rounding

Rounding involves going from high precision to lower precision and produces quantization errors and computational noise.
- Rounding Mode: Ceiling
- Rounding Mode: Convergent
- Rounding Mode: Floor
- Rounding Mode: Nearest
- Rounding Mode: Round
- Rounding Mode: Simplest
- Rounding Mode: Zero
Rounding Modes for Fixed-Point Simulink Blocks
Fixed-point Simulink^® blocks support seven different rounding modes.
Net Slope and Net Bias Precision
Net slope and bias precision, detecting precision loss, underflow, and overflow.
Detect Fixed-Point Constant Precision Loss
This example shows how to detect fixed-point constant precision loss.
Use Scaled Doubles to Avoid Precision Loss
How to avoid precision loss by overriding the data types in your model with scaled doubles.

Exemples présentés

Compute Quantization Error

Compute and compare the statistics of the signal quantization error when using various rounding methods.

Ouvrir le live script