Being Wrong is the Only Way to Learn

“Who knew doors only cost $30?”

Jason Potts said that to me last week when we were talking about the work he’s doing on his house. The house was severely damaged in the flood in January. For the past few weeks, Jason has been working on rebuilding it. He was telling me about how he’s learned to do a lot of the work – simply through experimenting.

Being wrong is actually an essential part of learning – as Jason’s experience with doors shows. Three months ago he didn’t know anything about installing handles on doors, and now he’s good at it. And the cost was much lower than he expected.

This is common error – we nearly always overestimate the cost of experimenting.

Part of this is because we don’t realise how cheap it is test most ideas. But the bigger problem is psychological – one big problem with experimenting is that we might be wrong. In her excellent book Being Wrong, Kathryn Shulz explains why this is such a problem for many people:

In our collective imagination, error is associated not just with shame and stupidity, but also with ignorance, indolence, psychopathology, and moral degeneracy. This set of associations was nicely summed up by the Italian cognitive scientist Massimo Piattelli-Palmarini, who noted that we err because of (among other things) “inattention, distraction, lack of interest, poor preparation, genuine stupidity, timidity, braggadocio, emotional imbalance,… ideological, racial, social or chauvinistic prejudices, as well as aggressive or prevaricatory instincts.” In this rather despairing view – and it is a common one – our errors are evidence of our gravest social, intellectual, and moral failings.
Of all the things we are wrong about, this idea of error might well top the list. It is our meta-mistake: we are wrong about what it means to be wrong. Far from being a sing of intellectual inferiority, the capacity to err is crucial to human cognition. … Thanks to error, we can revise our understanding of ourselves and amend our ideas about the world.

In other words, being wrong is the only way to learn.

That’s one of the things I’ve been spectacularly wrong about recently. We’ve had a persistent leak in our basement, which became a torrent during the rains that led to the flood. Ever since I first noticed the leak, I thought that it was from a broken drain pipe. My presumption was that the pipe was underneath the bricks, and that we would have to get plumbers in and dig up the whole front of the house to fix the leak.

During the rain, I took a close look at the leak, and realised that my idea about its source had to be completely wrong. So I developed a new idea: that the water was leaking through the gap between the sidewalk and the bricks.

To test this idea, I tried the experiment you can see in the picture. I bought $20 of sealant, and did the world’s messiest caulking job along the two gaps that I thought might be the source of the leak.

Since then, not one drop of water has gone into the basement. My experiment worked. Now that I know what the problem is, I can work on coming up with a solution more elegant that my two messy lines of sealant.

There are some general lessons in all of this home improvement work:

  • If things aren’t working right, examine your basic assumptions: I thought my leak would require a lot of time, money and expertise to fix. Jason thought the same about putting in doors. We were both wrong – but we only knew this once we actually tested those ideas.
  • Experiments are a lot cheaper than you think: Who knew that doors only cost $30? People that had already tried to experiment with them, I suppose. My new idea about the leak could have been wrong, but the $20 of sealant was a lot cheaper than calling in a plumber to test out my first hypothesis. Find a way to test out your ideas as quickly and cheaply as possible.
  • Being wrong is the only way to learn: Schulz’ point is exactly correct – being wrong is not a moral failing, or a sign of intellectual inferiority. It is the only way we can figure out how to do new things.

Experimenting isn’t just for fixing stuff around the house either – experimenting is a critical step in innovating. Earlier this week Jose Baldaia pointed to an excellent post by Amir Khella called How I launched a profitable product in 3 hours. Khella recounts how he developed a new product called Keynotopia which is, beautifully, a rapid prototyping (experimenting!) tool.

Here is part of what happened:

It had been less than a month since I wrote about how I’ve been using Apple Keynote to prototype iPad applications. I debated whether or not I should publish the post, thinking there was nothing new or useful about it. Yet, I decided to do it for the fun of it. What I didn’t expect, though, was for the post to be picked up by some of the most respected bloggers, becoming popular among the design and iPhone communities. In less than three weeks, the post generated more than 10,000 visits and 500 downloads of the iPad keynote templates I posted along.

Khella had an idea, but wasn’t sure if it would work, or even if it was any good or not. Instead of sinking a lot of further thought into it, he ran an experiment. He put together a website just to see if the idea would fly.

And it did. It’s great when your experiments work out this way. But what if it didn’t?

If no one had gone to the page, or if Keynotopia wasn’t useful for people, or if it didn’t work right, or if something else had gone wrong, he would have learned something – and for a pretty small investment, just three hours. If no one tried it out, then he’d know that the idea didn’t create value for people. Then he could move on to his next idea/experiment. If they had complaints about how it worked, then he’d know that the idea creates value, but his execution needs to be better. Then he could fix the problems and make the idea better.

In both of those cases, he would have been wrong about something. And much better off for knowing it.

Being wrong is the only way to learn. If you have a great idea, find a way to test it out. Experimenting is usually a lot cheaper than you think. Just remember Jason and the doors.

Student and teacher of innovation - University of Queensland Business School - links to academic papers, twitter, and so on can be found here.

Please note: I reserve the right to delete comments that are offensive or off-topic.

Leave a Reply

7 thoughts on “Being Wrong is the Only Way to Learn

  1. Hi Tim,
    Great post. You are right about everything – the need to experiment, learning from mistakes, and willingness to try out your ideas.

    Just to pad with a couple of my thoughts …I think that as much as folks overestimate the cost of experimenting, they also tremendously underestimate its benefits. Years ago when I was trying to get this message across, I used to use the term ELV (Experimentation Life-time Value). Much like the customer life-time value, my point was that the learnings from the experimentation should not just be looked at from a short-term perspective but from a long-term outlook.

    Taking your own caulking job example (btw, you were harsh on yourself – much better than your words portray it to be :-) ), next time a similar or related problem arises you would be a whole lot more prepared in terms of ideas, alternatives, actions to take and execution because of the learning you got from this test.

    The other point I want to make (this along Khella’s experience) is that until the time we invent mind-reading machines experimentation and trying out things is the only way to get constructive feedback. Even if the original idea might not have panned out, putting it out there might sprout 5 new ideas based on the feedback received.

    Once again, enjoyed the read.

    Regards,
    Ned

  2. Thanks for the comment Ned. Taking the life-time value is a great way to look at the payoff from experiments. I agree that people also underestimate the benefits, so this is a valuable idea.

    The picture might not be enough of a close-up to show just how bad that caulking job was… :-)

  3. Being Wrong is the Only Way to Learn,it is a new way and a new idea for us.But it has proved by many people before,once we had made a mistake,never should we did it again if we want to success.My boss always tell me not to make the same mistake,it decide how far we can go in the future.Thanks for sharing your idea.