M4.7.8 Chapter 8
Telling the truth with data
A chart shows one tall bar and one short bar, but the two numbers are almost the same. Is the chart telling the truth?
Your guess
Pick one before you read on. It is fine to be wrong.
By the end you can
- Spot a misleading graph or a misleading average
- Write a short report that compares two groups
Numbers do not lie, but the way we show them can mislead. A reader who knows the common tricks is hard to fool. This chapter shows three: a cut axis, an average that is not typical, and a comparison that tells only half the story.
Amina measures the mean height of the bean plants in two beds. Bed A has a mean of 52 cm and Bed B has a mean of 56 cm. Here is one chart of these numbers.
The bar for Bed A is only 2 units tall above the floor. The bar for Bed B is 6 units tall. So Bed B looks three times as tall. But 56 is only a little more than 52. The difference is 4 cm, which is about 8% of 52.
In a bar chart the length of a bar shows the size. A cut axis breaks that link. A fair bar chart starts at 0. If an axis has to be cut, a zigzag break mark on the axis warns the reader.
Other tricks are common. Two charts side by side may use different scales. A chart may show a short stretch of time, to hide a longer story. A bar chart with classes of different widths, drawn with height as the frequency, makes wide classes look big. Always ask: what is the scale, and what is left out?
Now a trick with an average. A bus company times 7 journeys in minutes: 12, 13, 13, 14, 15, 16 and 85. The 85 minute journey was held up by a flood. A leaflet says: "the average journey is 24 minutes".
Worked example
Find the mean, the median and the mode of the journey times 12, 13, 13, 14, 15, 16 and 85.
- Mean: 12 + 13 + 13 + 14 + 15 + 16 + 85 = 168. Then 168 ÷ 7 = 24.
- Median: the values are in order. The 4th of the 7 values is 14.
- Mode: 13 is the only value that appears twice.
Answer: The mean is 24 minutes, the median is 14 minutes and the mode is 13 minutes
A value far from the rest of the data is an outlier. The 85 is an outlier. It pulls the mean up. The median does not care how far away the largest value is.
Worked example
Which average best describes a typical journey: the mean or the median?
- Count the journeys shorter than the mean of 24 minutes. There are 6.
- So the mean is higher than six of the seven journeys. It is not typical.
- The 85 minute journey is an outlier. The median, the 4th value, is 14 minutes.
- Here, with an outlier in the data, the median describes a typical journey better.
Answer: The median, 14 minutes
Now the second half of the story. To compare two groups, one average is not enough. We need a number for the middle, the median, and a number for the spread, the IQR or the range. The two bus routes from the box plots chapter show this.
A short report has three parts. First, compare the middles with the medians. Second, compare the spreads with the IQRs or the ranges. Third, say what it means in plain words, with the numbers and the units.
Worked example
Write a short report comparing the journey times on Route A and Route B.
- The medians: both routes have a median of 25 minutes.
- The IQRs: Route A has 32 − 18 = 14 minutes. Route B has 28 − 22 = 6 minutes.
- The ranges: Route A has 45 − 10 = 35 minutes. Route B has 40 − 15 = 25 minutes.
- Report: both routes have a median of 25 minutes. Route B is more consistent, with an IQR of 6 minutes against 14.
Answer: Both routes have a median of 25 minutes, but Route B is more consistent: its IQR is 6 minutes against 14
Try it
Make one chart tell two stories
You need: squared paper, a ruler, a pencil.
- Take the counts of visitors in 5 weeks: 50, 51, 53, 52 and 55. Draw a bar chart with the axis from 0 to 60.
- Draw the same bar chart again with the axis from 48 to 56. Make both charts the same height on the page.
- Compare the two charts. Which one would you use to say "visitors are soaring"? Which is the fair one?
What you will see: The cut chart makes week 5 look more than three times week 1. The fair chart shows a gentle rise of 5 visitors in 4 weeks.
A wrong idea many people have
The mean is always the best average.
Why it feels right: The mean uses every value, so it seems the fairest.
The test that breaks it: In the journey times, the mean is 24 minutes, though six of the seven journeys took 16 minutes or less.
What is true: With an outlier, the median usually describes a typical value better. Say which average you used, and why.
A wrong idea many people have
Any chart whose axis does not start at 0 is dishonest.
Why it feels right: A cut axis is a favourite trick, so it is tempting to blame it every time.
The test that breaks it: A line graph of the temperature of a room, from 18 °C to 24 °C, needs no 0. Readers look at the changes along the line, not at the size of a bar.
What is true: A cut axis misleads most in a bar chart, where length means size. A cut axis should be marked with a break, and the numbers on it read.
Key words
- outlier
- a value that is far from the rest of the data.
- misleading
- giving a wrong idea, even if the numbers are true.
Back to your guess
The answer is A: Not always. A chart can cut off its axis, which makes a small difference look big.
A chart can be drawn from correct numbers and still mislead. If the axis starts above zero, a small difference can look large. Always read the scale. Charts can be trusted when they are drawn fairly, and we can learn to check.
Check yourself
Try each one before you look. A wrong answer tells you where to go next.
The chart shows the mean jump heights of two classes. What is wrong with it?
See the answer
The axis is cut, so a small difference looks big.
The bars start at 40 and not at 0. Class B is only a little higher than Class A, but its bar looks three times as tall.
Waiting times in minutes are 4, 5, 5, 6, 7, 9 and 48. Which average best describes a typical wait?
See the answer
The median, 6 minutes
The median is the 4th of the 7 values, 6. It is not pulled up by the outlier, 48.
A leaflet says: "Route A has the lower mean time, so it is more reliable." Why is this not enough?
See the answer
Reliable means little spread, so the IQRs or ranges must be compared too.
A mean says nothing about spread. Two routes with the same mean can have very different spreads.
The box plots show the heights of plants in two beds. Which statement is true?
See the answer
Bed Y has the higher median and the larger spread.
Bed Y has the median further right, and its box is longer. Its IQR is 52 − 33 = 19 against 42 − 28 = 14.
Which of these can make a bar chart misleading?
See the answer
Starting the vertical axis above zero.
A cut axis makes small differences look large, because bar length no longer shows the size.
What is an outlier?
See the answer
A value that is far from the rest of the data.
An outlier stands apart from the other values. It can pull a mean away from the typical value.
From an earlier chapter
The four quarterly readings of a year are 14, 26, 18, 10. What is the mean for the year?
See the answer
17
14 + 26 + 18 + 10 = 68. Then 68 ÷ 4 = 17.
Find the median of these 7 journey times, in minutes: 9, 10, 11, 12, 14, 15, 60.
See the answer
12
The values are in order. The 4th of the 7 values is 12. The outlier, 60, does not change the median.
Keep it
Copy this into your exercise book.
Check the scale: a cut axis misleads. An outlier pulls the mean, so use the median. To compare groups, give the median and the IQR, with the units.
Draw: Two bar charts of the same two numbers, one from 0 and one cut, with the words "same numbers" between.