Worked example · Science · Year 9

Evaluating online claims about sports recovery drinks

DCF: Producing → Evaluating and improving digital content · LNF: Interpreting data

What this is

A secure Year 9 response, annotated against the success criteria, and a full answer key for the supply teacher. Step 1: sample size 6 vs 60 (20 per group); no control group vs two control groups (plain water and diluted squash); paid #Ad partnership with 10% commission vs independent university grant; subjective 1 to 10 feeling score vs electronic light-gate sprint times and blood glucose. Step 2: sprint time improvements are 1.0% (Water), 1.8% (Squash, 0.9 s saved) and 2.0% (HydraMax Pro, 1.0 s saved). Sugar per 500 ml bottle: HydraMax Pro has 36.0 g (120% of the 30 g NHS daily limit) vs 22.0 g in homemade squash. Cost ratio: £2.80 ÷ £0.14 = 20 times more expensive. Step 3: Graph A starts its truncated y-axis at 49.6 s instead of 0.0 s, making the HydraMax bar look 5 times taller (50 mm vs 10 mm), and omits Group B (squash) completely.

Step 1: audit the method and credibility

Feature Influencer post (Section 1) University lab trial (Section 2) Why this affects validity or reliability
Sample size 6 gym members 60 club runners (3 groups of 20) A sample of 6 is too small because one unusual runner heavily skews the mean. Testing 60 people reduces the effect of random individual variation.
Control group None (everyone drank HydraMax Pro) Two controls: plain water (negative) and diluted squash with salt (positive) Without a control group, you cannot tell whether recovery happened because of the 20-minute rest and fluid alone or because of the product.
Funding and independence Paid partnership (#Ad) with HydraMax; creator gets 10% commission on code RHYS15 Funded by an independent public university research grant Financial gain creates funding bias: the influencer profits if followers believe the claim and buy the drink.
How recovery was measured Self-reported 1 to 10 energy feeling score Electronic light-gate 400 m sprint times (s) and blood glucose (mmol/L) Feelings are subjective and easily influenced by expectation, whereas electronic light gates provide objective, repeatable measurements.

(b) In a double-blind trial, neither the runners nor the scientists timing the sprints know who drank HydraMax Pro, squash or plain water because all three drinks looked and tasted identical. If runners knew they were drinking an expensive sports drink, the placebo effect could make them feel more confident and try harder, producing a false improvement even if the drink had no chemical benefit.

Every row contrasts the specific evidence from Section 1 and Section 2 and explains the scientific reason why the flaw weakens validity or reliability. Evidences criterion 1.

Step 2: check the percentage change and nutrition data

Drink group (20 runners each) Baseline mean (s) Recovery mean (s) Time saved (s) Percentage improvement (%)
Group A: Plain water 50.0 49.5 0.5 (0.5 ÷ 50.0) × 100 = 1.0%
Group B: Diluted orange squash + salt 50.0 49.1 50.0 − 49.1 = 0.9 (0.9 ÷ 50.0) × 100 = 1.8%
Group C: HydraMax Pro Berry Blast 50.0 49.0 50.0 − 49.0 = 1.0 (1.0 ÷ 50.0) × 100 = 2.0%

(b) Sugar per 500 ml bottle (5 × 100 ml):
HydraMax Pro: 7.2 g × 5 = 36.0 g of free sugars per bottle.
Homemade diluted squash: 4.4 g × 5 = 22.0 g of free sugars per 500 ml.
Percentage of NHS 30 g daily limit in one bottle of HydraMax Pro: (36.0 ÷ 30.0) × 100 = 120% (6.0 g over the entire daily maximum in a single drink).

(c) Cost comparison: £2.80 ÷ £0.14 = 20 times more expensive. The laboratory data does not justify this cost: HydraMax Pro improved 400 m sprint time by 2.0% compared with 1.8% for homemade squash, and the 0.1 s difference was not statistically significant.

All percentage changes and nutrition scalings show full working with units, proving that the 40% feeling claim hides a 2.0% objective sprint improvement and an excessive 36.0 g sugar load. Evidences criteria 2 and 3.

Step 3: expose the misleading bar chart

Feature Graph A (Promotional chart) Graph B (Honest scientific chart)
Y-axis starting value Starts at 49.6 s (truncated, inverted axis to 48.8 s) Starts at 0.0 s (full scale)
Water bar height vs HydraMax bar height (mm) Water = 10 mm, HydraMax Pro = 50 mm Water = 49.5 mm, HydraMax Pro = 49.0 mm
How many times taller does the HydraMax bar look? 50 mm ÷ 10 mm = 5 times taller Almost identical (a 1.0% difference of 0.5 mm)

(b) The creators of Graph A also cherry-picked the groups by completely leaving out Group B (diluted orange squash + salt, 49.1 s). If Group B had been plotted on Graph A, its bar would have been 41.7 mm tall, showing buyers that a 14p homemade drink performs almost identically to HydraMax Pro.

Identifies both the mathematical exaggeration caused by the truncated y-axis (5 times taller for a 1.0% difference over water) and the cherry-picking of comparison groups. Evidences criterion 4.

Step 4: write your science fact-check post

Science Fact-Check: Does HydraMax Pro really give 40% faster recovery?

Verdict: Misleading. @FitWithRhys_CW’s claim of “40% faster recovery” comes from an unblinded mini-test of just 6 gym members with no control group, where the influencer earns a 10% sales commission (#Ad). Because participants knew what they were drinking, subjective energy scores (5.0 to 7.0) are vulnerable to the placebo effect.

In an independent double-blind laboratory trial of 60 runners, HydraMax Pro improved 400 m recovery sprint times by just 2.0% (50.0 s to 49.0 s), compared with 1.8% (49.1 s) for homemade diluted orange squash with a pinch of salt. The promotional bar chart makes HydraMax look 5 times better than water by truncating the vertical axis to start at 49.6 s and omitting the squash group entirely.

Recommendation: Do not stock HydraMax Pro. At £2.80 a bottle, it costs 20 times more than diluted squash (£0.14) and contains 36.0 g of sugar (120% of the 30 g NHS daily limit). (140 words)

Follows the 4-part structure, stays polite and objective, and weaves together method flaws, percentage calculations, axis truncation, sugar content and cost. Evidences criteria 1 to 5.

If you finish early: answers

Why this response is secure