Mar 26, 2018

Why reporting on polls is a mug’s game

When it comes to reporting polls, journalists think statistical noise is real, and correlation always equals causation.

Bernard Keane — Politics editor

Bernard Keane

Politics editor

Here's a good example of how journalists can get trapped in their own narratives. 

Today The Australian is a little embarrassed by its own Newspoll, which shows virtually no change from last fortnight's. This, according to Simon "drops king" Benson, is "despite Bill Shorten’s plan to axe tax-credit ­refunds for more than one million retirees". Benson's initial copy -- changed overnight -- said the result was "in apparent defiance" of Labor's dividend imputation refundability policy. It would have been more accurate to refer to it being in defiance of his newspaper's editorial line. The Oz has been campaigning heavily against the policy and continues today, reporting an attack on it by the IPA (there's a shock).

Free Trial

Proudly annoying those in power since 2000.

Sign up for a FREE 21-day trial to keep reading and get the best of Crikey straight to your inbox

By starting a free trial, you agree to accept Crikey’s terms and conditions


Leave a comment

8 thoughts on “Why reporting on polls is a mug’s game

  1. Hugh (Charlie) McColl

    Bernard, it might be a cheap shot but you could lead by example. The polls are crap, we know they are crap, you’ve discovered, at last, that they are crap so why not leave them alone altogether?

    1. Nudiefish

      I take your point, Charlie – but somebody has to explain newspol in order to defeat the prevailing narrative that it MUST be relevant.

      Don’t call these things out for what they are and next thing they are received wisdom.

  2. Judy Hardy-Holden

    Hey Bernard. I’m a self-funded retiree (without super). I live on the Sunshine Coast and I can’t stand the Australian. I even, as a born and bred Queenslander, (gasp) read the SMH!!! Wash your mouth out!!

  3. kyle Hargraves

    The following two observations illustrate the perils of polling.

    (1) The polls are crap, we know they are crap
    (2) I live on the Sunshine Coast and I can’t stand the Australian.

    To (1) why are they crap? Bernard has provided a partial answer; implied causation
    from correlation and no sense of time displacement with regard to “community” opinion.

    In this day and age it is very difficult to determine, statistically, what is independent
    (viz independent events) and what are, in fact correlated events; particularly concerning politics.

    Quite apart from respondents discharging noise (erroneous statements) into the data Polls are generally considered (or approached) as independent.

    It is a good deal easier to model independent events because, otherwise, the extent of correlation has to be determined and, in the real world, such activity always attracts error; the (real) error exceeding the standard error in cases. It has been conveyed, infrequently, that Trump won because the corresponding polls assumed independence when in fact the motivations of the voters was correlated across evens x, y & z (which the polls failed to capture).

    As to (2), assuming that the Australian is read, in the main, by retirees living on the Sunshine Coast (frankly I haven’t a clue either way) there is a subset to which the norm does not apply in any large sample. Clearly, the less reliable the assumption concerning a particular population the greater the percentage against the norm.

    1. covenanter

      “Journalists think”, now there’s an exciting concept for the future, with the obvious exceptions to this rule, Bernard et al.

    2. covenanter

      The polls are crap, because all but the most pernickety pedant recognises that polls are not actually “news”???

    3. covenanter

      The polls are crap, because all but the most pernickety pedant recognises that polls are not actually “news”???

  4. AR

    Apart from the irrelevance of polls (get an intern to spend a week with a polling company – they’ll soon learn that most, underpaid & exploited pollsters, skew their results, not (specifically) due to personal political bias but because they resent their shitty pay & (non)conditions of employment) the real question is “why IS the Oz?”.
    No-one with half a brain believes a word of the RWNJ reportage/verbiage though they may entirely want to believe the world view expostulated as they have heaps of filthy lucre to protect (and, shudder, rub on their painfully erect nipples under a full moon – nods to FDotM).
    Its malignant, evil siblings, the Hun, Tizer, CurryMaul & Terrograph, however are an entirely different cup of hemlock.

Share this article with a friend

Just fill out the fields below and we'll send your friend a link to this article along with a message from you.

Your details

Your friend's details