Observer Twitter poll data on air monitors is meaningless

25 October 2021
What was claimed

Only 8% of schools have received air monitors that were promised by the government.

Our verdict

This data comes from a Twitter poll which means it is meaningless, as we can’t be sure who answered it or whether they were representative of schools.

“Only 8% of schools have received air monitors that were promised by government”

On 24 October the Observer reported that just 8% of schools had received carbon dioxide monitors promised by the government.

The monitors allow teachers to identify where ventilation might need to be improved, in order to aid the fight against the spread of Covid-19.

But the Observer’s article was based on a Twitter poll carried out by the headteacher of a primary school, which received 1,617 responses.

As we have written before, Twitter polls are meaningless for understanding anything other than the views of the specific people who answered the poll. 

The main reason for doing a poll in the first place is to find out about the views or behaviours of a group of people. As you usually can’t talk to all of them, you choose instead to talk to a sample of them.

That means a poll is only useful if you have some confidence that the people you are surveying are broadly representative of the people you’re interested in.

But with a Twitter poll you can never know this. In this case, you can’t know whether the respondents were people qualified to answer on the subject (teachers, school staff, parents etc). And even if they were, you can’t know if those people can give a representative view of the situation across the country more generally.

After publication, the Observer edited its headline to: “Only 8% of schools in England have received air monitors, headteacher’s Twitter poll suggests.”

This was still inaccurate. The Twitter poll doesn’t suggest that only 8% of schools in England have received air monitors. It tells us only about the responses of whichever Twitter users happened to engage with the poll when it was run, and nothing about the real world.

Also, the poll itself was ambiguously worded, asking: “Anybody seen a CO2 monitor yet? Asking for a school?”

It is possible that some respondents may have answered “no” if their school had received a monitor but they hadn’t personally seen one or had one in their class. 

This is another reason why the data can’t be used to show what proportion of schools have not received a monitor. And of course, it may also be the case that some schools already have monitors which were not provided directly by the Department for Education. 

After publication of this article, the Observer removed the article online. It wrote: "Twitter polls are informal and, if choosing to report them on a significant issue, we should be clear that respondents are self-selecting users of the platform who may or may not be statistically representative. In this case we failed to make that clear.

"The poll question, which was not given in the article, was, “Anybody seen a CO2 monitor yet? Asking for a school?”, and it cannot be said whether all those answering were in a position to confirm school arrangements.

"The online version of the article, which was amended shortly after publication to include reference in its headline to the Twitter poll, has been withdrawn from our website."

Honesty in public debate matters

You can help us take action – and get our regular free email

So how many schools have received air monitors?

Unfortunately, a Twitter poll on this subject can tell us nothing at all about the scale of the roll-out. But there are no official statistics available showing the latest progress of the roll-out either.

When we asked the Department for Education how many schools actually have received a monitor, a spokesperson told us: “We cannot pre-empt the publication of official Government statistics, but it would be inaccurate to report that the number of monitors being rolled out is equivalent to the number of settings that have confirmed receiving one.

“Our rollout of at least 300,000 carbon dioxide monitors to schools is on track.”

This refers to the target that education secretary Nadhim Zahawi suggested would be met in November, with over 90,000 being delivered by the end of October. For context, there are around 22,000 state or non-independent schools in England.

Update 1 November 2021

This article has been updated following the Observer's decision to remove its article online.

We took a stand for good information.

After we published this fact check, we contacted the The Observer to ask them to update the article to include an accurate description of what this Twitter poll can tell us. 

The Observer removed the online article and published a note about this in the For the record column in the Observer.

Don’t put up with bad information.

Add your name and join the fight for higher standards.

Full Fact fights bad information

Bad information ruins lives. It promotes hate, damages people’s health, and hurts democracy. You deserve better.