The Problem With Measuring Satisfaction

(Richard Millington) #1
Originally published at: <strong></strong><br><br>If you use a satisfaction feedback score, community managers will only reply to questions when they are sure the answer will be happy.

That’s not in the best interests of the member (or your business).

Read more

(Suzi Nelson) #2

This is so true - awesome post. Especially for those of us with platforms we dont own that don’t supply a lot of data, sometimes a big majority of what we have to work with is annecdotal. And sometimes there’s nothing wrong with that!

“Always supplant any data metrics with common sense and qualitative data. Use surveys, interviews, and your own observations. If you use data-driven metrics alone to set targets, assess performance, and give bonuses, you’re setting yourself up for problems.”

^^ This is gold.

(Sarah Hawk) #3

Agreed – and I think in some ways it’s circling back a bit to how we used to work.
When I started in community, there pretty much was no data. If you’re ever looked at a vB dashboard you’ll know what I mean. Most of what we did was anecdotal. We relied on a personal gauge of ‘community health’.

Then the tide turned and we were all about data and proxy metrics, which don’t work well for the reasons Rich talks about in this post.

I think there needs to be a balance of both. Some anecdotal, and some hard data (the key being that they are the right metrics – the ones that are tied to business goals).

(Richard Millington) #4

that should say supplement!

@hawk please can you fix? :slight_smile:

(Sarah Hawk) #5

Sure thing – sorted.

(Ernesto Izquierdo) #6

This interview with Christie Fidura from Salesforce also goes into what you mention Sarah. Having both, a bit of data and qualitative analysis.

We’re using the stats of conversations created by the community VS the conversations and replies created by the community manager as suggested in Buzzing communities.

And then using data to know if questions are being answered or not recently. As we are just three months since opening these internal platforms, it’s important to keep an eye on what’s going well and what can be improved.

But we’re also aiming at analysing on a case by case, how the community is helping each unit achieve their operational goals, be these upskilling, training, finding guidelines, or co-developing new ones.

(Suzi Nelson) #7

Hate it when that happens! :smiley:

(Alessio Fattorini) #8

That’s the key. Thanks :wink:

(Travis King) #9

Does anyone know how I can represent “gut checks” as hard data? :stuck_out_tongue:

(Sarah Hawk) #10

Yup. Prepend it with “True Fact”. That’s what my kids do.