Rounding
К оглавлению1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 1617 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33
34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
51 52 53 54
If a calculation produces a result with 11-digits or more, the calculator
uses the internal guard digits to determine how to display the result. If
the eleventh digit of the result is 5 or greater, the calculator rounds the
result to the next larger value for display.
For example, consider this problem.
1 P 3 Q 3 = ?
Internally, the calculator solves the problem in two steps, as shown
below.
1. 1 P 3 = 0.3333333333333
2. 0.3333333333333 Q 3 = 0.9999999999999
The calculator rounds the result and displays it as 1. This rounding
enables the calculator to display the most accurate result.
Although most calculations are accurate to within ±1 in the last displayed
digit, higher-order mathematical functions use iterative calculations, in
which inaccuracies can accumulate in the guard digits. In most cases, the
cumulative error from these calculations is maintained beyond the 10-
digit display so that no inaccuracy is shown.
AOS™ (Algebraic Operating System) Calculations
When you select the AOS calculation method, the calculator uses the
standard rules of algebraic hierarchy to determine the order in which it
performs operations.
Algebraic Hierarchy
The table shows the order in which the calculator performs operations
using the AOS calculation method.
Priority Operations
1 (highest) x2, x!, 1/x, %, ‡x, LN, e2, HYP, INV, SIN, COS, TAN
2 nCr, nPr
3 Yx
If a calculation produces a result with 11-digits or more, the calculator
uses the internal guard digits to determine how to display the result. If
the eleventh digit of the result is 5 or greater, the calculator rounds the
result to the next larger value for display.
For example, consider this problem.
1 P 3 Q 3 = ?
Internally, the calculator solves the problem in two steps, as shown
below.
1. 1 P 3 = 0.3333333333333
2. 0.3333333333333 Q 3 = 0.9999999999999
The calculator rounds the result and displays it as 1. This rounding
enables the calculator to display the most accurate result.
Although most calculations are accurate to within ±1 in the last displayed
digit, higher-order mathematical functions use iterative calculations, in
which inaccuracies can accumulate in the guard digits. In most cases, the
cumulative error from these calculations is maintained beyond the 10-
digit display so that no inaccuracy is shown.
AOS™ (Algebraic Operating System) Calculations
When you select the AOS calculation method, the calculator uses the
standard rules of algebraic hierarchy to determine the order in which it
performs operations.
Algebraic Hierarchy
The table shows the order in which the calculator performs operations
using the AOS calculation method.
Priority Operations
1 (highest) x2, x!, 1/x, %, ‡x, LN, e2, HYP, INV, SIN, COS, TAN
2 nCr, nPr
3 Yx