TY - JOUR

T1 - On various kinds of rounding rules for multiplication and division

AU - Chen, Wei Da

AU - Lee, Wei

AU - Mulliss, Christopher L.

PY - 2004/8/1

Y1 - 2004/8/1

N2 - A detailed investigation of three different rounding rules for multiplication and division is presented, including statistical analyses via Monte-Carlo simulations as well as a mathematical derivation. This work expands upon a previous study by Mulliss and Lee (1998), by making the more realistic assumption that the contributing uncertainties are statistically independent. With this assumption, it is shown that the so-called standard rounding rule fails over 60% of the time, leading to a loss in precision. Two alternative rules are studied, and both are found to be significantly more accurate than the standard rule. One alternative rule requires one extra significant digit beyond that predicted by the standard rule. The other requires one to count numbers whose leading digit is 5 or greater as having an extra significant digit, and then to apply the standard rule. Although the second alternative rule is slightly more accurate, the first is shown to be completely safe for data - never leading to a truncation of digits that contain significant information. Accordingly, we recommend the first alternative rule as the new standard.

AB - A detailed investigation of three different rounding rules for multiplication and division is presented, including statistical analyses via Monte-Carlo simulations as well as a mathematical derivation. This work expands upon a previous study by Mulliss and Lee (1998), by making the more realistic assumption that the contributing uncertainties are statistically independent. With this assumption, it is shown that the so-called standard rounding rule fails over 60% of the time, leading to a loss in precision. Two alternative rules are studied, and both are found to be significantly more accurate than the standard rule. One alternative rule requires one extra significant digit beyond that predicted by the standard rule. The other requires one to count numbers whose leading digit is 5 or greater as having an extra significant digit, and then to apply the standard rule. Although the second alternative rule is slightly more accurate, the first is shown to be completely safe for data - never leading to a truncation of digits that contain significant information. Accordingly, we recommend the first alternative rule as the new standard.

UR - http://www.scopus.com/inward/record.url?scp=8744313592&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:8744313592

VL - 42

SP - 335

EP - 346

JO - Chinese Journal of Physics

JF - Chinese Journal of Physics

SN - 0577-9073

IS - 4 I

ER -