Online Opinion Can Make or Break a Firm: Are you listening?

When companies like Dell and Kodak hire Chief Listening Officers, inquiring minds want to know what they are listening “to” and “for”: check FIR podcasts and Ad Age article.

The big task? Data mining — and figuring out who needs the information. [Kodak Chief Listener]:“What kind of information does our marketing team need vs. our product team? How do we classify the data? What is the process for handling ‘ABC’ information vs. ‘XYZ’ information?”

Now a Guest Poster for the social media blog CompuKol Connection, I wrote the following article for them:

Sentiment Analysis is the label describing online opinions

Social media empowers companies to listen to what is being said about them, so they can join the conversation and become part of the Recommendation Chain. With the proliferation of reviews, ratings, recommendations and other forms of online expressions, businesses need to “mine” these opinions to (a) market their products, (b) identify new opportunities, and (c) manage their reputations.

Online opinion can make or break a company – it is a Virtual Currency.

“We’ve gone from traditional market research to media monitoring to mining data that helps formulate business and communications strategy,” said public opinion pollster Bradley Honan at the Sentiment Analysis Symposium in NYC this past summer. Sentiment analysis is the label for a process to determine the emotional attitudes of writers with respect to some brand or topic.

Can sentiment be measured?

How well sentiment can be truly measured is still in question according to many marketers including online strategist Thomas Walker. “The value is that you can take a pulse on how effective a campaign has been. For example, you run a campaign that is designed to reach people’s funny bones, but the needle doesn’t move on your sentiment; you know that on a large scale it was ineffective.

“BUT if the needle moves and you look at what people are saying, you have the chance to incorporate certain elements into your brand’s voice, and if you use this information correctly, you’ll be able to make your brand become more of a reflection of how supporters want to see you.

“If, however, the feedback is negative, you can drill down using sentiment analysis tools to see what people don’t like, and if you’re a smart brand, you become what your customers want you to become. This is the new future of business.”

Sentiment analysis is a subjective process. What one person reads as positive could be neutral to another.  Specific business goals are required to provide the context for examining online opinion, and this can be analyzed automatically with computer software using Natural Language Processing [NLP] and machine learning.

Most accurate? Human or Computer monitoring?

However, social media bloggers, market monitoring specialists, and measurement software suppliers are taking sides as to whether human or automated sentiment analysis is more accurate — and better: “At the heart of this ongoing debate is the issue of accuracy, or the degree to which software can correctly extract positive, negative, or neutral tone” from words alone, according to Marshall Sponder in a recent blog article “Is There Any Point To Doing Sentiment Analysis.” [http://www.socialmediatoday.com/SMC/198067]

Sponder concluded that aiming for 100% accuracy misses the point because sentiment is not objective and can be swayed by “momentary considerations” like a person’s mood at the time of writing. Sponder suggested that businesses try to analyze core beliefs that are more stable than off-the-cuff remarks. He also pointed out that critics of automated tracking say that humans can read between the lines where, of course, a machine cannot.

Information technology professionals like James McGovern, who directs the Virtusa Corporation, urges people to accept the limitations of sentiment analysis:  “NLP isn’t quite mature enough yet to automate the measurement, nor is sentiment analysis a quantitative measure. It is more qualitative at this time. It is highly recommended to dedicate a human team to interact with the community, distinct from managing the message,” he said.

Sentiment accuracy is like a fine wine, according to Jennifer Campbell, a resource managing director.

“It improves with time, whether you are using a dedicated and educated group of reviewers or an intelligent natural language solution that is able to learn from a growing set of data,” she said.

Measuring online opinions and data can be used on a broader scope than just with brands and companies, pointed out Mark Parker, CEO of Smart Social Media. His company had initially found little “social noise” referencing a client, one of Australia’s largest housing construction companies. However, when he conducted  additional research, he found a lot of sentiment expressed around two core issues: interest rate movements and housing affordability, which were both closely linked to the demand for the client’s products.

“Nervous sentiment” on issues is worth checking out

“What we saw in the sentiment wasn’t so much positive or negative or even neutral for that matter – I termed it as nervous sentiment – the customers were nervous about these two issues. So the opportunity for this client was to tap into these two conversations and be seen to be contributing information, tools, and advice,” he said.

The initial results of online data mining may be less significant than some measurement tool vendors would have us believe, but as a starting point for further investigation and insight, they can be very important. Web marketing strategist (and number cruncher) Alan Stephenson put it this way:

“Sentiment analysis only becomes meaningful for me when we dig deeper. For example, alarm bells would be going off around the 10.4% of posts with the word ‘problem’ mentioned. This discovery would provide a reason to examine posts in more detail. As an early warning system, this kind of alert is extremely relevant. I would rather have a false alarm than a reputation fire,” he said.

Whether through human or machine analysis, businesses have a huge opportunity to discover valuable information about their products, services and company reputations. The challenge, then, is to take the feelings they uncover and implement appropriate actions to capitalize on the positive feedback — and design solutions for the problems.

Your turn: What value do you see in monitoring, measuring, and giving meaning to consumer online opinion?

Print Friendly, PDF & Email

5 thoughts on “Online Opinion Can Make or Break a Firm: Are you listening?”

  1. Nice post, Shari 🙂 Actually last Saturday we had a barcamp here in Paris around online reputation and one of the workshops was on the Whuffie Effect – i.e. measuring your own and your company’s online reputation and being able to track that over time.
    Even though there are certain measures and tools for measuring, including Synthesio (bam! auto-promo — I’m done now 😉 ), it would be REALLY interesting to see one measure emerge that would take all the rest into account.

    As far as sentiment analysis goes, though, we really haven’t found a tool that does as well as human analysts – especially when you’re talking about monitoring in multiple languages and pulling out analyses from unstructured data. Though the semantic web and NLP are advancing, they’re not their just yet, from our point of view, and all of the agencies we’ve talked with have agreed that either you put your own man hours into good analyses, or you pay for someone else to do it.

    Marshall is an excellent source for info on social media monitoring, as well, and great to be in touch with 🙂
    Nice to see how this came out 🙂

    Best,
    Michelle @Synthesio

  2. Great post, Shari. I’d love to share some insight on the subject of sentiment analysis as it’s quite often a topic of conversation over here at Radian6.

    While I agree with Jennifer Campbell on how sentiment accuracy will improve with time, I don’t think we need to choose between human and computer monitoring. The human element will always be needed as unique cases are constantly popping up on the social radar. For example, sarcasm could be overlooked by the computer, and would need a human element to make the connection and thus determine the proper sentiment.

    Before treading into the sentiment arena organizations should outline what defines a negative, positive, or neutral comment and when it is appropriate to automate these comments. Adding to the need for a human element this should all be incorporated into the social strategy before the organization decides to adopt a sentiment/monitoring platform.

    Zach Woodward
    Community Engagement Specialist, Radian6

  3. Shari,
    Great post. Such an important area for every business to get their head around. Despite the current technical limitations, sentiment monitoring in some shape or form can only grow in importance. As more of the relevant comments about our business take place on platforms outwith our control, it will only become harder to keep our virtual finger on the pulse. It will become part of what every successful business does.

    “THE FUTURE”, wrote the novelist William Gibson, “is already here: it’s just not evenly distributed”.

  4. Debate about the prospects for reaching 100% accuracy, or 50%, or any specific level of accuracy, with sentiment analysis is premature, or perhaps just ridiculous. That’s because the state of the art in text analytics still has a long way to go in satisfying user requirements for identification of subject matter of text, let alone how people feel about the subject.

    That is not to say that the current state of sentiment analysis is not yet valuable. On the contrary, the ability to extract, from a monstrously large volume of text, a concentrated collection of largely positive or negative comments is itself tremendously valuable. The right combination of subject and sentiment analysis reduces a body of text into manageable parts that humans can review to draw useful insight. If the process isn’t perfect, it is still far superior to asking the same humans to manually code or scan a great bulk of text and try to draw meaningful and consistent conclusions.

    A couple of years ago, I spoke with a banking executive who was searching for ways to evaluate effectiveness of public relations campaigns. I introduced her to text mining as a means of quantifying campaign results. That bank did venture into text mining and now uses it for other applications as well. Some of their applications are currently considered no more than 20% accurate, yet are still so valuable that their investment in text mining is growing. Analytics don’t have to be perfect to be valuable, just better than the alternatives.

  5. Shari,
    Great summary of the role of sentiment analysis.

    I think the key here is opportunity – how do we move beyond simply looking at the positive or negative and focus on the opportunity – the opportunity to learn, innovate, and improve (internally and externally).

    I had the opportunity to listen to Todd Coates (MD of Sydney’s BridgeClimb) speak this week and his point was they only learn as an organisation when people complain – so for them – the negative is the opportunity.

    Cheers Mark

Leave a Reply