Experiments – the Key to Innovation | The Discipline of Innovation

Experiments – the Key to Innovation

There is a big problem that organisations often face: they want to be innovative, but they also want to minimise risk. This creates a certain amount of tension. If I had to pick the number one thing that I would recommend to organisations that are trying to become more innovative, it would be this: experiment. Experiment all the time. Try everything that you can possibly think of to try. An experimental mindset is absolutely essential to successful innovation.

We were talking about this idea in class this week, and it clearly makes people nervous. I was suggesting that in an uncertain environment, normal strategy tools such as SWOT analysis, five forces and so on are actually pretty dangerous to use. One of the students asked “so everything is chaos, and we throw out the tools and models, then what? What are we supposed to do?”

That’s a good question. I replied that in part this was a rhetorical trick – in terms of the narrative of the class, we were at a point equivalent to just before the end of the Two Towers in The Lord of the Rings trilogy: we’re trapped in a castle surrounded by tens of thousands of orcs, Gandalf is missing, the hobbits are spread all over middle earth, and we have absolutely no idea what is going on. How do we navigate from this point to the five different happy endings that conclude the story?

Again, my answer is to experiment. The tools that I have talked about previously that are designed for linking innovation to strategy are all built around experimenting. The way to combat high levels of uncertainty is to spread your bets. Try as many cheap experiments as you can.

There must be something to this idea, because I’ve run across three different people saying basically the same thing in the past three days. The first was Dan Ariely:

They asked me what I thought the best approach was. I told them that I was willing to share my intuition but that intuition is a remarkably bad thing to rely on. Only an experiment gives you the evidence you need. …

Companies pay amazing amounts of money to get answers from consultants with overdeveloped confidence in their own intuition. Managers rely on focus groups—a dozen people riffing on something they know little about—to set strategies. And yet, companies won’t experiment to find evidence of the right way forward.

Unsurprisingly, he goes on to make a case for the value of experimenting. Part of this reluctance is that experimenting leads to short-term losses – if you try several things to find out what works best, you have wasted resources by trying the ideas that end up not working. Or do you? Rita McGrath doesn’t think so:

If your organization can approach uncertain decisions as experiments and adopt the idea of intelligently failing, so much more can be learned (so much more quickly) than if failures or disappointments are covered up.

So ask yourself: are we genuinely reaping the benefit of the investments we’ve made in learning under uncertain conditions? Do we have mechanisms in place to benefit from our intelligent failures? And, if not, who might be taking advantage of the knowledge we are depriving ourselves of?

She includes a list of conditions that can lead to what she’s calling ‘intelligent failures’, the approach that she outlines is both good and practical. Then I ran across this by Bob Sutton:

The final point that Jeff Pfeffer and I make in Hard Facts is about failure. We emphasize that is impossible to run an organization without making a lot of mistakes. Innovation always entails failure. Most new products and companies don’t survive. And if you want creativity without failure, you are living in a fool’s paradise. It is also impossible to learn something new without making mistakes. …

Failure will never be eliminated, and so the best we can hope for from human beings and organizations is that they learn from their mistakes, that rather than making the same mistakes over and over again, they make new and different mistakes.

To be innovative, we have to try out new ideas. Some of these will fail. If we’re smart, we’ll set up our experiments so that we can learn as much as possible from the ideas that don’t work.

We face an environment that is filled with uncertainty. This makes planning dangerous. The best possible way to meet this uncertainty is not with intuition and guesswork, but with experimentation. If you can combine experimenting with empathy, then you’ll be building a formidable innovation capability.

(Photo from flickr/jurvetson under a Creative Commons license)

About Tim Kastelle

Student and teacher of innovation - University of Queensland Business School - links to academic papers, twitter, and so on can be found here.

21 Responses to Experiments – the Key to Innovation

  1. Roger Wilson 30 March 2010 at 2:56 am #

    Tim – my favorite experiement is to try to sell something; try to sell the same thing in two ways or offer something which differs in one key viable, etc. etc. The orderbook is a neglected research tool. Existing sales records contain many natural experiments if one focuses on the unexplained variances.

  2. Saul Kaplan 30 March 2010 at 3:50 am #

    Tim, I couldn’t agree more. My new mantra is R&D for new business models and systems. We need to try more stuff. We know how to do R&D for new products and technology. It is time to move experimentation in to the business model innovation arena.

    My hypothesis is that the half-life of a business model is decreasing. If that is true tomorrow’s leaders will have to change their business models 2-3 times over their careers. Leaders are not prepared and do not have the experience or tools to design and run these experiments. This new imperative calls for active experimentation. We need to get ideas for new business models off of the white board and on to a real world test bed.

    All organizations should manage a portfolio of business model experiments on an ongoing basis. The best experiments are collaborative across industry silos since the biggest value creating opportunities are networked business models that span organizations and sectors.

    Your post is right on. Let’s try more stuff.

    Saul Kaplan
    Chief Catalyst
    Business Innovation Factory

  3. Tim 30 March 2010 at 6:12 am #

    Thanks for stopping by Roger & thanks for the comment! I think that you make an excellent point. In every job that I had before coming into academia, I actually did exactly what you suggest – study previous sales patterns to see what I could learn. In every single case I was able to uncover something that no one within the company had known before. It’s amazing how much useful data firms hold that they never use.

  4. Tim 30 March 2010 at 6:15 am #

    Thanks Saul! We’re thinking along exactly the same lines – I am in the process of setting up a business model incubator for firms in our region. That makes the idea sound more tangible than it currently is, but the point is that I fully agree that this is an area that we need to be working on. There is both great potential and great need for innovation in this area!

  5. Ivan Silva 31 March 2010 at 5:44 pm #

    Hi Tim…I agree that experimentaton is like “practice makes perfect”. An issue is though, coming off the GFC, many innovative firms, such as the one I work at are sometimes cautious when experimenting and the costs that surround this process. Personally, I disagree with this caution because I believe it does not promote a truly innovative environment or provide the confidence to its innovative staff…..Lastly, when will you be in Melbourne……!!! Saludos to you Professore…!!

  6. Tim 31 March 2010 at 5:59 pm #

    Thanks for the comment Ivan. I agree with you that this has been happening, and that it is not good.

    I’ll be in Melbourne on 20 April (and possibly the afternoon of 19 April) – I am giving a talk at the AIG breakfast forum.

  7. Ivan Silva 31 March 2010 at 8:17 pm #

    Cool Tim, I will try to score an invite from my friend in AIG, so that we can meet…..I doubt it though….Cheers, Ivan

  8. Michael Gordon 1 April 2010 at 1:13 am #

    It is so simple. They only way to gain wisdom is by doing. Without doing, nothing can be gained. Let’s keep it that simple and gain this understanding and then we will not have to come up with so many concepts and models of how we learn. Experimentation is simply doing and limiting the potential for damage if error or unexpected results. Wisdom is gained by doing and sometimes innovation is achieved. It is so simple, I wonder who thought of it first?

  9. Lanny Arvan 2 April 2010 at 3:23 am #

    This piece by Atul Gawande should be of interest because it ties the extent of experimentation to the measured performance of the organization.

    However, I think you can sharpen your hypothesis. It’s not just to experiment but which experiments and when. How do the results of one feed into which experiment is tried next?

  10. Tim 2 April 2010 at 10:38 am #

    Thanks for the comment & link Lanny. I think that your last point is correct – I’ve been thinking of a follow-up post that touches on that exact issue.

    The Gawande link is great – I’ve not read that particular article yet so thanks. I’m a big fan of his – I’ve used his ideas in a couple of different posts here…


  1. uberVU - social comments - 28 March 2010

    Social comments and analytics for this post…

    This post was mentioned on Twitter by timkastelle: New blog post: Experiments- the Key to #Innovation they really are……

  2. Tweets that mention Experiments – the Key to Innovation « Innovation Strategy « Innovation Leadership Network -- - 28 March 2010

    [...] This post was mentioned on Twitter by Stefan Lindegaard, mieke van rheenen, mieke van rheenen, Ana Herradon, Tim Kastelle and others. Tim Kastelle said: New blog post: Experiments- the Key to #Innovation they really are… [...]

  3. Are you the best at something nobody needs anymore? | Game-Changer - 30 March 2010

    [...] Because change is continuous it’s is very difficult to know what is next after you’ve made it past the first curve but merely accepting that tomorrow is not going to be like to today is a great place to start. This means you have to do activities that are different from the day to day stuff your organization does, it means you have to make time to think, ponder and reflect to get a point of view of where things are going and then make some experiments to test your POV. [...]

  4. How to Experiment to Support Innovation « Book Riffs « Innovation Leadership Network - 2 April 2010

    [...] talked frequently about the importance of experimenting in innovation, and John has been discussing the use of real options in costing innovation initiatives. The key [...]

  5. #Innovation posts of the week: Management innovation at W.L. Gore | Game-Changer - 4 April 2010

    [...] Experiments – the Key to Innovation – Innovation Leadership Network [...]

  6. Don’t Fear the Social Media Bubble « Evolving Economic Entities « Innovation Leadership Network - 4 April 2010

    [...] inefficient, which is bad from a neo-classical economic view. But in many cases bubbles create an incubator for experimentation, which is often the only way we can discover the value in novel technologies. Here’s the way [...]

  7. The role of experimentation in innovation management | InnovationManagement - 13 April 2010

    [...] Meanwhile Tim Kastelle offers a practical guide of How to Experiment to Support Innovation in two posts. The perils of corporate organizational [...]

  8. Innovation Through Prototyping and Experiments « Innovation Leadership Network - 23 May 2010

    [...] talked before about the importance of experiments in the innovation process. Experiments are essential for two reasons. First, they allow us to be more confident that our [...]

  9. Where Do Bad Ideas Come From? « Innovation Leadership Network - 9 February 2011

    [...] The problem is that except for a handful of extremely stable markets, most firms actually operate in Tier 3, with plenty of genuine uncertainty. And Easterly’s prescription for economic development holds for businesses as well – when you face uncertainty the best thing to do is to experiment. [...]

  10. The “1-10-100″ Rule for Innovation Experiments « Innovation Leadership Network - 7 June 2011

    [...] Seek variation – explore the possibilities. [...]

  11. 10 Ways to Select Ideas - Innovation for Growth - 2 August 2013

    [...] Experiments: this is my favourite.  One good way to choose ideas is to prototype or try as many as possible on a small scale.  Then do more of the ones that work, and make sure that you learn from the ones that don’t.  The advantage here is that this is a very data-driven approach, it works well when you face uncertainty, and even little bets can lead to radical innovations.  The advantage is that you have data on what works and what doesn’t, which is the best way to choose ideas that merit further development.  The disadvantage is that you burn resources (time, money) on the prototypes that don’t work. [...]

Leave a Reply