Clicky

How to Test a Business Model Like a Scientist | The Discipline of Innovation

How to Test a Business Model Like a Scientist

How do we decide what actions to take in business? Or in life?

In many cases, we base our actions on our models of the world. We think that things work in a particular way, and this determines the choices we make.

We can make a strong case for trying to make these choices more like a scientist does. Here’s an example.

The Nieman Journalism Lab pulled together a set of opinions on the new pay system that the New York Times has put in place, with thoughts from Steven Brill, Anil Dash and Megan McCarthy among others. Here is one of the points that Steve Buttry makes in his piece:

My friend and former boss Jim Brady says that you can’t build a business model based on what people should do (and newspaper people believe in their bones that people should pay for their content). You build a business model based on what people will do. This tortured maze of exceptions and trigger points is a laughable effort to collect because people should pay but to find a way not to lose the people who won’t pay.

This is a great point.

The really good thing about it is that we can actually set these up as hypotheses that can be tested. “People will pay for content” is an idea about which we can collect a fair amount of data.

There are a number of people that are starting to say that we should treat business models as a set of testable hypotheses. Steve Blank outlines how to do this very well in this set of slides:

His thoughts on the broader trends in start-up experience are well worth reading in full, but for our purposes, jump to the case study that starts on slide 72. He uses the Business Model Canvas to discuss the experience of a start-up called OurCrave, an online social shopping platform.

The case shows what the original business model was, and more importantly, how the assumptions underlying it were tested. Then he shows how the business model changed five times in response to data and testing.

This approach doesn’t necessarily guarantee success, but it certainly helps the odds. It demonstrates the reality that Peter Sims describes in a recent post:

The truth is, most entrepreneurs launch their companies without an brilliant idea and proceed to discover one, or if they do start with what they think is a superb idea, they quickly discover that it’s flawed and then rapidly adapt.

Thinking about your business model like a scientist can be a good scheme, provided you keep two warnings in mind.

The first is to beware of false precision. You want to test your assumptions with data, but you can’t always get the data you need. And the fact of the matter is that your plan will change yet again once you launch it and people really start interacting with your ideas. Usually, when testing numbers like these, you want to be within an order of magnitude with your numbers, and you want to remember that they are estimates.

The second caution is to avoid making models that say things like “social media always works” or “social media never works.” These absolute cases are never true. What we really want to figure out are the circumstances in which an approach works or doesn’t. Your business model may or may need need social media support, or six sigma in your production, or any other number of things.

Scientists are interested in finding the boundary conditions for rules – when do rules stop working? When testing business model hypotheses, you’re trying to figure out what is right in your particular case. So beware of absolute statements about what will or won’t work.

Experimenting is a critical innovation skill. If you can figure out how to experiment with your business model, you will increase your chances of success. Just remember to test it like a scientist.

About Tim Kastelle

Student and teacher of innovation - University of Queensland Business School - links to academic papers, twitter, and so on can be found here.

Subscribe

Subscribe to receive all of our posts via RSS or email, or connect up on another service

10 Responses to How to Test a Business Model Like a Scientist

  1. Kevin McFarthing 24 March 2011 at 4:53 am #

    Hi Tim – agree that a reasonable degree of accuracy is more important than precision. But the bigger point is the classic market research one of how to relate a response in a test to behaviour in future reality. This also needs a scientific approach, so that you can validate (the key scientific word….) your methodology.

  2. Tim 24 March 2011 at 9:19 am #

    Very good point Kevin – thanks.

Trackbacks/Pingbacks

  1. 5 Fav Business and Strategy Post #27 | Donald McMichael - 27 March 2011

    [...] going into depth about the finds, I do encourage you check them out if they sound interesting. How to Test a Business Model Like a Scientist Whether you like it or not we base our decisions on the way we believe particular things work. This [...]

  2. When Should You Give Up on an Idea? « Innovation Leadership Network - 22 June 2011

    [...] However, in a start-up, it’s not so straightforward. Here you basically have one idea, so you need it to work. Still, you have an opportunity to test the various parts of your business model as you go along. [...]

  3. Anything You Want by Derek Sivers – “Experiment. Go!” « Innovation Leadership Network - 19 July 2011

    [...] Remember – every part of a business model is actually a hypothesis. You should figure out how to test each part. [...]

  4. Four Key Issues in Innovation Management - Innovation for Growth - 15 January 2013

    [...] hypotheses - so that it enables structured learning.  Experiments and hypothesis testing are an essential part of business model innovation.  If we are trying to embed lean start-up principles into larger organisations, this is a [...]

  5. Key Issues in Innovation Management | Integrative Innovation - 20 February 2013

    [...] hypotheses – so that it enables structured learning. Experiments and hypothesis testing are an essential part of business model innovation. If we are trying to embed lean startup principles into larger organisations, this is a capability [...]

  6. How to Use Experiments to Build an Innovation Culture - The Discipline of Innovation - 19 November 2013

    […] When Caterina Fake and Stewart Butterfield launched Flickr, did they work out the perfect business model in advance, then launch the site?  No.  They started out building massively multiplayer online game – Game Neverending, which became relatively successful, just not successful enough to keep the company afloat. So the team built a site around a photo-sharing protocol that they developed for the game, and that became Flickr.  It was business model development through trial and error. […]

  7. How to Use Experiments to Build an Innovation Culture | PARC blog - 29 January 2014

    […] When Caterina Fake and Stewart Butterfield launched Flickr, did they work out the perfect business model in advance, then launch the site? No. They started out building massively multiplayer online game – Game Neverending, which became relatively successful, just not successful enough to keep the company afloat. So the team built a site around a photo-sharing protocol that they developed for the game, and that became Flickr. It was business model development through trial and error. […]

  8. Lessons From My Latest Big Mistake | The Discipline of Innovation - 13 February 2014

    […] our ideas and build a business model around them based on experiments and data.  This is really the core of the lean startup approach, and we’re starting to see evidence that this really is a more effective way to build new […]

Leave a Reply