The Telegraph recently commissioned pollster ComRes to survey a representative sample of adults in Great Britain on Brexit.
The Telegraph presented the results in their front-page splash, claiming that more than half the public support Boris Johnson delivering Brexit by any means possible, including suspending Parliament. This was repeated by various media organisations including Metro and Reuters.
“Do you agree or disagree with the following statements?
“Boris needs to deliver Brexit by any means, including suspending parliament if necessary, in order to prevent MPs from stopping it.”
44% agreed, 37% disagreed and 19% said they didn’t know.
44% does not, as the Telegraph claims, represent more than half of the public.
The Telegraph excluded all the people who said they didn’t know from its reported findings in order to claim that a majority of the public (54%) agreed. This isn’t appropriate.
The Telegraph could have said that more people agreed with the statement than didn’t. Or that the majority of people with a view on the matter agreed. But not that the majority of the public agreed.
Since we originally wrote this, we got in touch with the Telegraph, who have now corrected their article.
As well as the problems with the Telegraph’s interpretation of the results, there are also problems with the question itself. The question has been phrased in such a way that it could lead people to agree with it.
For example, implicit in the statement is the idea that parliament will definitely stop Brexit. Not delay, but stop Brexit. This essentially inflates the perceived risk to Brexit of not proroguing parliament. Which might lead more people to agree with the statement.
There’s also arguably a broader problem with this sort of agree/disagree question as explained here by YouGov’s Director of Political Research, Anthony Wells.
He argues that the statements people have to agree or disagree with can only advocate for one side of the debate and so can lead respondents to agree by default.
In this example, the “benefit” of the Prime Minister taking any means possible, including suspending parliament, to deliver Brexit is clear. Brexit would be delivered.
But the other side of this debate is not spelled out or suggested, for example what might happen if Mr Johnson did not suspend parliament. So the wording used might have made it more likely for people to say they agree with the statement.
And finally, as we say often, this poll is only representative of people in Great Britain (it excludes Northern Ireland, which voted to Remain) as the Telegraph does mention in its article.
Update 29 August 2019
After we approached the Telegraph, it amended the top two lines of the article to make it clear that the figures represent only those who had a view on the matter. The newspaper also added a clarification to the article saying this figure excluded ‘don't know’ and refusal responses.
You’ve probably seen a surge in misleading and unsubstantiated medical advice since the Covid-19 outbreak. If followed, it can put lives at serious risk. We need your help to protect us all from false and harmful information.
We’ve seen people claiming to be health professionals, family members, and even the government – offering dangerous tips like drinking warm water or gargling to prevent infection. Neither of these will work.
The longer claims like these go unchecked, the more they are repeated and believed. It can put people’s health at serious risk, when our services are already under pressure.
Today, you have the opportunity to help save lives. Good information about Covid-19 could be the difference between someone taking the right precautions to protect themselves and their families, or not. Could you help protect us all from false and harmful information today?