Lesson 5 of 6 · Noise and missing data
Treat noise and missing values differently
8 minute lesson · 3 checks along the way
Your goal for this lessonUse quality information before calculating a result.
In this lesson 3 sections · 3 checks
Using archive links & definitions
Follow a linked name to explore its archive card. “Back to your lesson” brings you to the same part of the reading.
Words with a dotted underline open a short definition right here in the lesson.
Read & understand
A varying measurement is not always a changing target
Repeated readings can differ because of instrument noise, changing observation conditions or real physical variation. Calibration and uncertainty analysis help separate these possibilities. Averaging can reduce some random variation under suitable assumptions, but it does not automatically remove a shared bias or a processing mistake.
An unusually bright might be meaningful, saturated or affected by an artifact. A useful investigation consults quality information and neighboring or repeated measurements. Deleting every inconvenient value is not a valid substitute for a documented quality rule.
Check 1 of 3
10 pointsUse the reading above. You can try again without losing points.
Read & understand
A missing value is not zero
Science products often use a or mask to mark locations without usable data. USGS quality-assessment bands encode conditions relevant to Landsat interpretation, including fill and saturation flags. Those flags must be decoded according to the product documentation rather than treated as ordinary measured quantities.
For a fictional series of 10, 12 and one missing value, the mean of the two valid readings is 11. Replacing the missing value with zero gives about 7.33, answering a different and unjustified calculation. Report both the valid mean and the fact that only two of three intended readings are available.
This April 1994 Measurement of Air Pollution from Satellites (MAPS) product displays lower-atmospheric carbon monoxide with a low-to-high color key. Black cells are explicitly labeled data not yet processed. The displayed processing state is part of interpreting this historical product.
Look closely
Should the black cells enter an average as zero carbon monoxide?
See what to notice
No. Their label describes unavailable processing results, not measured zero concentration. A valid analysis must preserve that distinction and document its treatment of incomplete coverage.
Check 2 of 3
10 pointsUse the reading above. You can try again without losing points.
Read & understand
Ask why observations are missing
Missingness can itself be patterned. If clouds obscure a surface preferentially during particular conditions, clear-sky measurements may not represent the full period in the same way as a complete record. More arithmetic cannot replace observations of conditions the sample systematically omits.
Keep a record of exclusions, their reasons and their effect on coverage. A comparison between two dates should not silently compare different subsets of a region. You may need a common valid area or an explicitly modeled treatment of missing observations, with the remaining limits stated alongside the result.
Check 3 of 3
10 pointsUse the reading above. You can try again without losing points.
Put it together
Your lesson progress
Each check connects to a part of the story. Complete all 3 to earn your 25-point lesson bonus.
Explore further · Optional
Go to the source
Explore the evidence behind this lesson. These optional readings and videos open in a new tab.