Navigating the Uncertainty: Understanding the Significance of Measurement Uncertainty in Scientific Analysis

In the pursuit of accurate and reliable scientific data, the concept of measurement uncertainty plays a critical role. Whether it's in the realms of physics, chemistry, biology, or any other scientific discipline, the understanding and quantification of uncertainty have a profound impact on the validity and reliability of experimental results.

Measurement uncertainty refers to the doubt that exists about the result of any measurement, arising from limitations in the measurement process itself. This article aims to delve into the complexities of measurement uncertainty, its significance, methodologies for its estimation, and its role in scientific research.

In plain terms, uncertainty is defined as a ‘non-negative parameter characterizing the dispersion of the quantity values being attributed to a measurand, based on the information used.’ (source: VIM ). Quite a bland statement, even though perfectly correct. So what exactly is uncertainty?

Let’s take a look.

Measurement uncertainty

In the broadest metrological terms, uncertainty is the doubt that exists about the result of any measurement.

It is important to distinguish between uncertainty and error. While an error is the difference between the measured value and the ‘true’ value, uncertainty is a quantifiable doubt (expressed in statistical terms) about the measurement.

To enhance the amount of information gleaned from your measurements, the wisest approach is taking multiple readings and employing fundamental statistical computations. The primary calculations to focus on are determining the average or arithmetic mean and calculating the standard deviation for a given set of numbers.

An average or arithmetic mean is usually shown by a symbol with a bar above it, e.g. x? (‘x-bar’) is the mean value of x. In general, it is advisable to perform as many readings as possible for a given measurement, however, adding readings has (thankfully) diminished results. For accurate measurements, at least 10 readings are advised but, depending on the length and complexity of the measurement, this is not always possible. An absolute minimum of at least three readings should, however, be employed in all cases.

Standard deviation is the most general way of defining the “spread” of the measurement across the range of measurement readings. The standard deviation of a group of numbers provides insight into the typical variation of individual readings from the set's average. The true standard deviation value can only be derived from an extensive (infinite) collection of readings. When dealing with a moderate number of values, only the estimated the standard deviation is attainable, typically denoted by the symbol "s."

Sources of uncertainties and errors

• Measuring instruments, which can be affected by errors including bias, changes due to ageing, wear, drift, poor readability, and noise.
• The item being measured, which might not be stable, as seen when measuring the size of an ice cube in a warm room.
• The measurement process itself can be challenging, especially when dealing with small but lively animals or difficult-to-measure objects.
• 'Imported' uncertainties can also play a significant role in certain measurements, affecting setup, fine detail reading, and reaction times.
• Operator skill and judgment can arise if the measurements are not representative of the process being assessed.
• Sampling issues
• The environment's conditions, such as temperature, air pressure, and humidity, can impact both the measuring instrument and the item being measured.

Types of uncertainties

Like measurement errors, uncertainties can also be categorized as random and systematic. The definition of each type is as follows:

• Random uncertainty yields randomly different results upon repeating measurements, and averaging multiple measurements generally leads to a better estimate.
• Systematic uncertainty is characterized by a consistent influence affecting each repeated measurement, and is often undetectable without additional methods for estimation.

In terms of probability distribution, measurement uncertainty can take many different shapes. These fall somewhere between the following three theoretical distributions:

1. Gaussian or normal distribution
2. Rectangular distribution
3. U-shaped distribution

Propagation of uncertainty

An additional concept we need to consider in uncertainty analysis is the so-called propagation of uncertainty (or propagation of error). Put simply, propagation of uncertainty defines how uncertainties in the input quantities of a mathematically calculated resultant quantity influence the uncertainty in the final output. It helps us grasp how small errors in the initial data can impact the accuracy of our end result, commonly applied in scientific and engineering disciplines to ensure precise calculations and predictions.

How to evaluate uncertainty?

The Guide to the Expression of Uncertainty in Measurement (or GUM) defines two methods of uncertainty evaluation:

1. Type A evaluation - uncertainty estimates based on repeated measurements and suitable statistical probability distribution, as just described.
2. Type B evaluation - uncertainty assessed based on other available information which encompass past experience, validated models, calibration certificates and other relevant knowledge about the measured quantity. This information can help us define boundaries or specific ranges inside which a specific parameter of the measurement can influence the overall result. (Inside these ranges, various distributions functions can again be assumed to ‘model’ the influence of the parameter in question.)

While Type A can be thought of as the general by-the-book method of assessing uncertainty, the Type B method can often help improve the measurement quality rather substantially.

To evaluate uncertainty, there are several key steps we need to follow:

1. Define a test protocol with information you want to obtain from the measurements, the range of measurements required, and calculations needed for the final results
2. Execute the measurements
3. Estimate individual uncertainties
4. Decide if the uncertainties are independent of one another
5. Calculate the final result
6. Evaluate the combined uncertainty based on the input quantity uncertainties
7. Define the combined uncertainty using coverage factor, size of the uncertainty interval and a level of confidence
8. Report the measurement result with the evaluated uncertainty along with the used measurement and evaluation methodology

These steps will be discussed more in detail in the example presented below.

Main terms and parameters to consider when calculating uncertainty

Standard uncertainty

Each individual uncertainty contributing to the combined uncertainty of the measurement has to be expressed at the same level of confidence as standard uncertainties.

To this end, the standard uncertainty is typically used, which is expressed as a ± margin value that is the size of one standard deviation

The symbol u is generally used for expressing standard uncertainty.

Type A standard uncertainty

The Type A standard uncertainty can be expressed as:

where s is the standard deviation and N is the number of recordings per measurement.

Type B standard uncertainty

In instances of limited information, particularly in Type B estimates, one may need to estimate both upper and lower uncertainty bounds, assuming an equal likelihood of the value falling anywhere in between, resulting in a rectangular or uniform distribution. In this case:

where a is the half width of the (expected) measurement deviation limits. The selection of the type of distribution is down to the specifics of the test setup and the available knowledge about the specific type of uncertainty being analysed. One can, e.g., generally presume that uncertainties derived from the calibration certificate of a measuring instrument follow a normal distribution.

Combined standard uncertainty

In the simplest case, a measured quantity hold several independent measurement uncertainties (e.g. Type A uncertainty and several Type B uncertainties deriving from the used measurement setup). In this case, the combined uncertainty is:

For more complex cases with quantities derived from equations with multiple different units, refer e.g. to UKAS, The Expression of Uncertainty and Confidence in Measurement M 3003 .

Individual uncertainties correlation

Often, uncertainties are independent of one another. If, however, this is not the case, then the uncertainty analysis becomes somewhat more involved. Refer again to the UKAS handbook to find out more.

Coverage factor k

If one wishes to express the combined standard uncertainty at a different confidence level, such as, e.g., 95 %, re-scaling is achieved by multiplying the combined standard uncertainty (u_c) by a coverage factor (k). The result is known as the expanded uncertainty (U), and a specific coverage factor corresponds to a particular confidence level. The most commonly used coverage factor is k=2, providing an approximate 95-% confidence level, assuming the combined standard uncertainty is normally distributed. Different coverage factors, such as k=1, k=2.58, and k=3, correspond to confidence levels of approximately 68 %, 99 %, and 99.7 %, respectively, in a normal distribution, while other distributions have unique coverage factors.

Example: CMM measurement of an aluminum block’s length

To see how uncertainty analysis can be applied to a simple case of a measurement of the length of an aluminum block using CMM hit the link below and scroll to the final section of the article.

https://rdmotion.com/blog-3-uncertainty