The Survivor Bias

It’s an old story well worth repeating here and considering in how we measure what we do:

going-down The Survivor Bias

During World War II the English sent daily bombing raids into Germany. Many planes never returned; those that did were often riddled with bullet holes from anti-air machine guns and German fighters.

Wanting to improve the odds of getting a crew home alive, English engineers studied the locations of the bullet holes. Where the planes were hit most, they reasoned, is where they should attach heavy armor plating. Sure enough, a pattern emerged: Bullets clustered on the wings, tail, and rear gunner’s station. Few bullets were found in the main cockpit or fuel tanks.

The logical conclusion is that they should add armor plating to the spots that get hit most often by bullets. But that’s wrong.

Planes with bullets in the cockpit or fuel tanks didn’t make it home; the bullet holes in returning planes were “found” in places that were by definition relatively benign. The real data is in the planes that were shot down, not the ones that survived.

Are you watching the survivors? 

By Ross Hill - August 19th, 2009 at 10:47am with 825 views

  • Yeah cool I figured it was automated to a degree have you thought about saving the images to your site that way google images will index you better or?

    I would like to know your best traffic keyword as im targeting particular keywords for my site an would like to know if its worth while I see your on page one for 'cd covers' Im targeting this keyword too.

    I have another site that is up there for 'Theme Songs' http://www.themesongshut.com it should get decent traffic for the keyword Theme songs but it don't LOL

    Any hinters you could give would be great Ross
  • That's not bad pal can you not automate the process of adding covers?
    Just out of interest whats the biggest keyword that brings traffic to you :)
  • It is already an automated process - and I'm not sure how naming a single keyword is useful, it's a variety of factors that lead to doing well with search traffic.
  • stevesammartino
    Mate, brilliant reminder that we most often need contrarian thinking for the real insights.

    Steve.
  • samotage
    There is often a lot more beyond prima faci, and the real reason often takes some insight.

    From memory armour was applied in the soft areas for newer planes like the P47 Thunderbolt which was perhaps one of the most robust planes in the war, the thinking going: planes are easy to replace, pilots not so.

    Sam,
    @samotage
  • Wow Ross,
    I actually hadn't heard this story before (I really should brush up on wartime history).

    Apart from feeling sad that there weren't planes coming home - this piece actually connects with a lot of concepts I've been thinking about lately in terms of what we are aiming for, what we're measuring, what is 'getting hit by the bullets' and are we 'looking after the pilot'?
  • Yeah it's a deep concept :)
blog comments powered by Disqus

You are visiting rosshill.com.au. This post was made possible by people like Steve Hopkins.

Have these updates provided you value? Become a micropatron today.