The first step to comparing products is understanding your customers. This may seem counter-intuitive, but your product’s capabilities are meaningless unless you are comparing them from your customer’s point of view. This article is part 2 in a series on comparing products. Check out part 1, then continue with this article on the first steps of comparing products.
Overall Product Comparison Process
This is may be a long series. Each article will start with a recap of the overall process.
Getting useful information from comparing products requires you to:
- Introduction & Overview (so that the step-numbers align with the article numbers)
- Identify your customers. (This article)
- Articulate the problems they care about solving.
- Determine how important solving each problem is, relative to the other problems, for your customers.
- Characterize how important it is for you to solve the problems of each group of customers.
- Discover which (competitive) products your customers consider to be your competition.
- Assess how effectively each competitive product solves each important problem.
- Assess how effectively each competitive product solves each important problem, for each important group of customers.
With this information, you can create a point of view about how your product compares to the others.
From that point of view, you can determine where to invest in your product. That’s the whole point of doing the comparison – not to be self-congratulatory, but to guide forward thinking. I’ve stopped being excited when I find existing “product comparisons” and game plans when starting to work with a product team. To date, they have always been “positioning papers” designed to emphasize the product’s strength – usually prepared for internal sales teams, but unfortunately, sometimes prepared for executives (‘Look! We’ve done a great job!”) Those documents are a useful source of information to get you started down the product comparison path, but if you let them guide you, they will take you down the primrose path.
Identify Your Customers
You want to have a model that represents how you are approaching your market. As a product manager focused on solving customer problems, you should have a customer-centric market model.
Your goal is to identify groups of customers that share sets of problems, and share a point of view about how important it is to solve those problems. Effectively, this is a definition of a persona (yes, I know there are better ways to define personas).
The important thing is that you identify groups of people that will reach the same conclusion about your product, by answering the following questions similarly –
- Which problems that are important to me can I solve with this product?
- How well does this product solve those problems?
- How does this product compare to other products?
Personas, Goals, and Contexts
The image above is adapted from Robert W. Bailey’s diagram from Human Performance Engineering, (although I first saw it in the Handbook of Usability Testing). One use of Bailey’s diagram is to understand that to assess the usability of a product, you have to take into account the human being who is using the product, the environment in which they are using the product, and the actions the person is trying to perform.
My extensions of the idea are that
- Groups of people with similar sensibilities (personas) will form similar conclusions about how much they like a product when,
- They are using the product in similar contexts,
- To achieve similar goals
One benefit of abstracting this way is that you don’t get caught up in the mechanics or procedures of how someone is solving a problem (the actions). Focus on the action is appropriate when evaluating the usability of a particular product, but not when comparing how different products solve the same problem. I also like something that reminds me that people use products in different environments and situations.
Example Personas
Usually, when I see personas they are focused purely on marketing and demographic data, or they are based solely on contextual inquiry intended to inform a design aesthetic. The former may tell you where to market a product to groups of people (magazines, tv ads, luxury travel websites, etc), and the latter informs how to implement solutions. What we need is something that helps us assess the relative importance of solutions to problems shared by groups of people.
This series of articles is looking at the Kindle Fire as a proxy product by which I will explain the techniques (without actually performing a data-driven analysis – I’ll invent data for the purpose of this article series).
I found a presentation on Slideshare:
BlackBerry Consumer Preferences and Segmentation
Where some MBA students documented the research and analysis of the market of prosumers – “professional” consumers.
What I particularly like is the way they presented a summary of part of their analysis on slide 27. That’s the part we’re going to pretend applies to the Kindle Fire (because it might just). Note that their presentation includes a “RIM Confidential” clause in the footer, so it might have been removed by the time you read this article. I’ll briefly describe what they did. They did an analysis of survey results, identified groups of people that placed similar importance on different activities and aspects of smartphone usage, and identified three “clusters” of people with statistically significant shared sensibilities.
- Hi-Tech Prosumers – people who placed high value on most features, anticipated high usage of most features, were price-sensitive, had lower incomes (less than $75K USD per year) and were the younger members of the target demographic.
- Typical Blackberry Prosumers – people who placed high value on network features, moderate value on other features, made heavy use of “standard” capabilities, but did not plan to use apps, or multimedia.
- Basic Prosumer – people who placed high value on phone features, were heavy users of text and voice features; had low use of other capabilities, but anticipated becoming heavy users of “smartphone capabilities” (email, calendar, browsing, apps, camera, etc) when they purchased their next phone.
What’s notable is that they did the right type of analysis – finding clusters of people that can serve to quantify market value of different personas – this will inform the determination of the relative importance of different groups of customers (step 3 in the process of comparing products). By interviewing individual survey respondents that are in each of the clusters, they can get the additional information they need to develop personas.
For this series of articles, I will pretend that three personas were developed, in order to demonstrate this approach to comparing products:
- Hi-Tech Prosumers – people who get excited about convergence, highly value additional multimedia capabilities, live a multi-device existence, and are acutely aware of competitive products.
- Typical Amazon Kindle Users – people who placed high value on the reading experience, the convenience of being able to easily get new content, and the absence of a subscription fee.
- Basic Consumers – people who read primarily on paper media, have recently started consuming multimedia on their computers, and anticipate becoming part of the “post pc era.”
I will also invent additional data as we explore the rest of the product comparison process.
Developing Personas
Please don’t finish this article believing that persona creation is trivial – it isn’t. I’ve heard the saying before that a bad persona is better than no persona at all, and I believe that. Without a target persona, you will almost certainly create the elastic user anti-pattern.
Persona creation is more of a precondition of this process than a part of this process – you should already have personas developed for your product. This article is not intended to go into the details of how to create a persona, but rather a review of the aspects of that persona development that are needed for the product comparison process to be effective:
- Identification of people in your market that share perspectives on problems – e.g. knowing that for one group of potential customers solving problem X is important and problem Y is not, even when problem Y’s solution is important to another group of customers.
- Being able to estimate the relative number of people that are represented by each persona – e.g. knowing how much revenue potential exists for sales to each group of people.
Summary
Recapping the overall flow of this series of articles on product comparison
Getting useful information from comparing products requires you to:
- Introduction and Overview (so that the step-numbers align with the article numbers)
- Identify your customers. (This article)
- Articulate the problems your customers care about solving.
- Determine how important solving each problem is, relative to the other problems, for your customers.
- Characterize how important it is for you to solve the problems of each group of customers.
- Discover which (competitive) products your customers consider to be your competition.
- Assess how effectively each competitive product solves each important problem.
- Assess how effectively each competitive product solves each important problem, for each important group of customers.
With this information, you can create a point of view about how your product compares to other products.
Attributions
* Thanks Alaska Dude for the Lovely Lass photo.
Showing a loop of Customers > Products > Market > Market Segments > Customers highlights the typical product development / go to market problem – where do you start?
When you have your loop going, you can iterate and fine-tune e.g. modify product / messages for different segments, and your customers can help you uncover new use cases.
But where to start? Lean Startup recommends you start with minimum viable product, throw it out to the market and see if customers find it and if there is a problem worth solving.
I think you should start with what you know best, ideally that’s the customers – but not everyone can start there
Thanks, Giles, and welcome to Tyner Blain!
I wrote an article, Product Managers and Innovation earlier this year, touching on exactly this point.
You can start inside-out (I have a hammer, I wonder if there are people sitting around with unused nails – or better – people who need to attach things), or outside-in (people need to attach things – I’ll invent a hammer and nails).
For start-ups in particular, my experience / intuition is that successful ones start with a founder who knows a market (outside-in) and has an idea for a solution (inside-out) already in mind when the company is formed. I bet that the ones that started inside-out have a tough time getting to the “next” product, where the ones that start outside-in are more likely to figure out ways to leverage their existing brand to solve additional problems.