Lesson 6 of 6 · Make the work reproducible
Leave a reproducible trail from data to conclusion
8 minute lesson · 3 checks along the way
Your goal for this lessonPreserve enough information for someone else to rerun and critique the work.
In this lesson 3 sections · 3 checks
Using archive links & definitions
Words with a dotted underline open a short definition right here in the lesson.
Read & understand
Save the chain, not only the final figure
A reproducible package identifies the input products and versions, selection rules, transformations, calculation and output. Include a short explanation of how to run the work and what result to expect. NASA’s open-science guidance treats data, software and documentation as connected parts of research.
For the fictional ratio exercise, the trail begins with the original target and reference values, continues through validity and pairing rules, and ends with the ratio comparison. A reader should be able to locate the exact point where an alternative reasonable choice would change the result.
Check 1 of 3
10 pointsUse the reading above. You can try again without losing points.
Read & understand
Make hidden dependencies visible
Record software versions and parameters that affect the calculation. If a method uses random sampling, preserve the when appropriate and describe the sampling method. A seed helps reproduce a particular computation; it does not make the statistical model correct or independent of its assumptions.
A can help verify that a file’s bytes match a recorded copy. It does not establish that the data are scientifically valid or that their source claim is true. Pair technical identity checks with , documentation and appropriate scientific review.
Preserve a chain another reader can inspect
Original teaching diagram. Inputs and method. Product IDs and versions. Selection, code and parameters. Outputs and interpretation. Expected values and figures. Uncertainty and data citation. Reproducing the computation helps evaluate a claim; it is not itself proof that the claim is true.
Open full-size diagram in a new tab: Preserve a chain another reader can inspectCheck 2 of 3
10 pointsUse the reading above. You can try again without losing points.
Read & understand
Reproduction and new evidence answer different questions
Another person rerunning the same inputs and method checks whether the reported result can be reproduced. A new observation or independently implemented analysis can test different dependencies. Identical results from the same mistaken method can reproduce perfectly, so reproducibility is valuable without being a guarantee of truth.
Finish the fictional project by listing what is shared, what remains uncertain and which next test could discriminate among explanations. Credit the original data producers and use an appropriate data citation. The result then becomes something others can inspect and extend, rather than an isolated screenshot with an unsupported conclusion.
Check 3 of 3
10 pointsUse the reading above. You can try again without losing points.
Put it together
Your lesson progress
Each check connects to a part of the story. Complete all 3 to earn your 25-point lesson bonus.
Explore further · Optional
Go to the source
Explore the evidence behind this lesson. These optional readings and videos open in a new tab.
- Read: NASA: open science principlesCompare the explanation and its assumptions with the worked example in this lesson.
- Read: NASA PDS: identifying and citing data productsCompare the explanation and its assumptions with the worked example in this lesson.
- Read: NASA: scientific data and software reproducibility guidanceCompare the explanation and its assumptions with the worked example in this lesson.