Professional Documents
Culture Documents
Seth Grimes
Alta Plana Corporation
301-270-0795 -- http://altaplana.com
Seth Grimes
Principal Consultant with Alta Plana Corporation.
Contributing Editor, TechWebs IntelligentEnterprise.com. Channel Expert (text analytics), B-Eye-Network.com. Founding Chair, Sentiment Analysis Symposium, sentimentsymposium.com, and Text Analytics Summit, textanalyticsnews.com.
Two assertions:
Human communications are inherently subjective.
Opinion often masquerades as Fact.
4
www.google.com/publicdata
The unemployment rate is 9.7%. Unemployment is WAY TOO HIGH!! The unemployment rate is higher than it was two years ago (5.1%). Former U.S. Federal Reserve Chairman Alan Greenspan said on Tuesday that the global recession will "surely be the longest and deepest" since the 1930s, adding that the Obama administration's Troubled Asset Relief Program will be insufficient to plug the yawning financial gap. [Reuters, Feb 18, 2009] Bernanke is doing a better job than Greenspan.
Sentiment
Sentiment+
In this example, you can quickly see that the Drooling Dog Bar B Q has gotten lots of positive reviews, and if you want to see what other people have said about the restaurant, clicking this result is a good choice.
-- http://googleblog.blogspot.com/2009/05/more-search-options-and-otherupdates.html
In the recap of [Searchology] from Googles Matt Cutts, he tells us that: If you sort by reviews, Google will perform sentiment analysis and highlight interesting comments.
-- Bill Slawski, Google's New Review Search Option and Sentiment Analysis, http://www.seobythesea.com/?p=1488
11
User intent?
12
13
Counting term hits, in one source, at the doc level, doesnt take you far...
14
Counting -clicks, not even keywords -leaves you wondering Why? and So What?
15
Sentiment analysis is the task of identifying positive and negative opinions, emotions, and evaluations.
-- Wilson, Wiebe & Hoffman, 2005, Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis
Sentiment analysis or opinion mining is the computational study of opinions, sentiments and emotions expressed in text An opinion on a feature f is a positive or negative view, attitude, emotion or appraisal on f from an opinion holder.
-- Bing Liu, 2010, Sentiment Analysis and Subjectivity, in Handbook of Natural Language Processing
16
17
Must distinguish the sentiment holder from the object: Greenspan said the recession will
18
Consumption models:
Push Pull (a.k.a. search)
1. 2. 3. 4. General search engine Siloed/vertical search interface Application embedded Widgets/gadgets
Rated negative?
Manual focus
???
22
23
Claim: You fall far short with (only) -Doc-level analysis. Keyword-based analysis.
For text, you need strong natural language processing (NLP) for information extraction:
A direct opinion is a quintuple (oj, fjk, ooijkl, hi, tl), where oj is an object, fjk is a feature of the object oj, ooijkl is the orientation or polarity of the opinion on feature fjk of object oj, hi is the opinion holder and tl is the time when the opinion is expressed by hi. [Liu 2010]
index at will!
24
25
26
28
Beyond polarity: We present a system that adds an emotional dimension to an activity that Internet users engage in frequently, search..
-- Sood & Vasserman & Hoffman, 2009, ESSE: Exploring Mood on the Web
29
Happy Sad Angry Energetic Confused Aggravated Bouncy Crappy Angry Happy Crushed Bitchy Hyper Depressed Enraged Cheerful Distressed Infuriated Ecstatic Envious Irate Excited Gloomy Pissed off Jubilant Guilty Giddy Intimidated Giggly Jealous Lonely Rejected Sad Scared ----------------------The three prominent mood groups that emerged from K-Means Clustering on the set of LiveJournal mood labels.
30
Questions?
Comments?