NPS: The cons
So far, so good. But there are some real downfalls to relying solely on NPS. Here are a few:
1. NPS lacks context behind scores
What’s behind that single data point? Why do people choose not to be advocates? Did a particular campaign or change to a product drive an increase or decrease in your NPS?
With a single score, this information just isn’t there. It’s important to be able to dig deeper into what’s driving people’s scores, and there are lots of other data sources that can help you complete the picture.
2. Sample sizes are often small
Due to time or budget restraints, the number of people your survey gets in front of (let alone actually respond) can be limited.
Big scale NPS studies can take a long time and a lot of money.
3. The time between the survey and analyzing the results can be long
Like we said, large scale NPS studies can take time, and that means the results aren’t anywhere close to real-time.
Results can’t be actioned until they’re reported on, which means customers who give a low score a month ago could remain unhappy until all scores have been gathered. Even then, without context, it could be a while before things are fixed.
4. Some say NPS is liable to ‘gaming’
“The results are easy to manipulate, whether intentionally or unintentionally,” write Khadeeja Safdar and Inti Pacheco in the Wall Street Journal. Their report, which ran under the subheading “NPS—or net promoter score—is a measure of customer satisfaction that has developed a cult-like following among CEOs. It also may be misleading,” lays out a number of issues with NPS, including that employees of some brands might be encouraged to ‘game’ the results. These tactics might include only reminding the happiest customers to fill out the survey, for example.
The trouble with overstating the importance of a single metric, and balancing people’s compensation on it, is that it can be tempting to get creative with the methodology.
5. Feedback is solicited
There are pros and cons to asking people questions. The manner in which they are asked might alter their answer, and the timing can also affect things.
Ideally, for lots of research, you want as little influence from the researcher as possible on the results in order to get the response that is most true to the individual. When feedback is unsolicited, there’s no additional bias a company can add until it comes to analyzing those results.
6. NPS doesn’t account for the influence of each promoter/detractor
Let’s say you’ve got nine promoters and one detractor. Looks like you’re in for a healthy Net Promoter score!
But now imagine that one person is Oprah, and she’s ready to actively encourage her following not to trust your brand. Suddenly, things don’t look so good.
Measuring NPS alone means the ability of your respondents to influence others goes unchecked.