Clicky

How to Improve Your Innovation Metrics | The Discipline of Innovation

How to Improve Your Innovation Metrics

We’ve written a few posts criticising some of the more common innovation metrics in use, so I thought it would be smart to outline some ways that we can actually develop more effective metrics. Here’s a story that might help:

A while ago I was in charge of managing student recruitment for a tertiary education institution. One of the first things I looked into when I started the job was metrics – how did we measure how well my section was doing? The answer was one number: total number of enrolled students each year. The job that I was given was to increase that number by as much as possible (which begs all kinds of questions about quality, teaching and so on, but let’s set those aside for now…).

The problem was that managing that number as a standalone was hard. Well, impossible, actually. So I looked into what other numbers we had, and I found a that we had measures for total applications received, and total enrolments. I worked with my teams to figure out the path that people took to become students, and we then also figured out a way to measure enquiries. Once we had these numbers, here’s what we did:

We made three metrics: total number of enquiries, the ratio of applications/enquiries, and the ratio of enrolments/applications. Then I made the marketing team responsible for enquiries, the information team responsible for applications/enquiries, and the enrolments team responsible for enrolments/applications.

When my boss told me to increase enrolments as much as possible, he was hoping for a 5% increase. By breaking down the process, developing new metrics, and making people accountable for the measures, we were able to increase enrolments by 12%.

There are several lessons from improving innovation metrics in this:

  • Innovation is a process not an event: many things that we often think of as an event are actually processes. Enrolments is a good example – previously my institution only considered the end point, enrolled students. By breaking down the process that we went through to actually get an enrolled student, we were able to improve our ability to get enrolled students.

    I think of innovation as a process too – this is the diagram that I use to describe it:

    To improve our innovation metrics, we need to first think of it as a process.

  • Use multiple metrics: in the enrolments story, we used three metrics that led to the one that we were most interested in (total enrolments). We can do the same for innovation. Once we think of it as a process, then we need to develop metrics for each of the steps that lead to the outcomes that we are looking for from innovation. Innovation is a complex process, and to manage it we need to use multiple metrics.
  • Link Your Innovation Metrics to Your Strategy: my tertiary education institution saw increasing enrolments as a central part of its strategy. At the time, the educational sector in New Zealand was fairly turbulent, and there was a strong message from government that it wanted to see the sector consolidated. Increasing enrolments was seen as a way to signal that we were a thriving institution, making it less likely that we’d get absorbed by a larger polytechnic.

    We need to do the same thing with innovation – link it to our overall strategy so that it can help drive success. There are a number of broader strategic goals that can be supported by innovation – we just need to be clear about which ones we’re targeting.

  • Improve the part of the process that is weakest: when we started tracking the enrolments process, we discovered that we were pretty good at generating enquiries, and very good at converting applications into enrolments. The weak link was converting enquiries into applications.

    The information team had been given some sales training before I arrived, which they strongly resisted. They saw their role as helping people, not selling them. We implemented a lot of ideas, but the one that had the greatest impact was getting them to ask at the end of each enquiry that they handled “if you’re interested in the course, would you like to put in an application?”

    When they started doing that, the applications/enquiries ratio shot up from about 12% to 18% in a couple of weeks. And we weren’t forcing people to apply – the enrolments/application ratio held steady. If the quality of applications had decreased, this metric would have gone down. It turned out that a lot of people really did want to start studying, but they just needed a small nudge to get started.

    In looking at our innovation processes, we need to do the same thing: find the weak link, and figure out how to best improve it. As we’ve said many times before, usually the problem in organisations is not that they don’t have enough ideas, but rather that they need to get better at selecting ideas, or at getting them to spread. In any case, once we have identified the part of the process that is most in need of improvement, then we can figure out to best go about making it better.

Getting innovation metrics right is a challenging task. There is no single number that will tell us everything we need to know to manage innovation. I hope these ideas help you figure out how to measure it better in your organisation.

Note: There is also a good series on innovation metrics by Boris Plukowski on Blogging Innovation: Part 1, Part 2 & Part 3.

About Tim Kastelle

Student and teacher of innovation - University of Queensland Business School - links to academic papers, twitter, and so on can be found here.

5 Responses to How to Improve Your Innovation Metrics

  1. Wim Rampen 1 October 2010 at 2:35 pm #

    What? No single metric for loyalty!? How come? Can it be? ;)

    Hi Tim,

    Great post for it not only shows that it is about understanding the process (or Customer’s journey) but too that if you want to achieve a certain goal you need to develop metrics that are actionable throughout that journey as well as an understanding of who can influence that a specific part of the journey best..

    This approach is applicable far beyond the innovation process.

    And of course I’m interested in the set of metrics you use to measure how well you are doing after enrollment.. in the eyes of the students and your boss.

    Thx Wim

  2. Tim 1 October 2010 at 6:10 pm #

    Thanks Wim!

    The polytechnic instituted some extremely innovative methods for the post-enrolment stuff, but all of that was getting implemented when I moved away from NZ over here to Australia, so I’m not sure how it worked out. It involved assigning every new student to a personal learning advisor who would work with them throughout their entire program. There was nothing else like it in NZ at the time, and I haven’t run across any other program that is as comprehensive as that one.

    It was a really fun organisation to work for – we did a lot of cool stuff in the time I was there!

Trackbacks/Pingbacks

  1. Tweets that mention How to Improve Your Innovation Metrics « Innovation Leadership Network -- Topsy.com - 30 September 2010

    [...] This post was mentioned on Twitter by Andrew Dick and Tim Kastelle, Santi Chacon. Santi Chacon said: How to Improve Your Innovation Metrics: We’ve written a few posts criticising some of the more common inno… http://bit.ly/9uHqMD [...]

  2. How to Improve Your Innovation Metrics | gabriel catalano | in-perfección - 30 September 2010

    [...] http://timkastelle.org/blog/2010/09/how-to-improve-your-innovation-metrics/ [...]

  3. Entrepreneurship blogs agree: Fail fast! | InnovationManagement - 12 October 2010

    [...] effectiveness of your system, look at this post on the problem with using innovation metrics and how to improve said metrics at Innovation leadership [...]

Leave a Reply