We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Why Sentiment Analysis Engines Need Customization
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Sentiment Analytics > Why Sentiment Analysis Engines Need Customization
AnalyticsSentiment AnalyticsSocial Media AnalyticsText AnalyticsUnstructured Data

Why Sentiment Analysis Engines Need Customization

lexalytics
lexalytics
4 Min Read
Why Sentiment Analysis Engines Need Customization
Illustration generated with Qwen Image.
SHARE

There was a time, not too long ago, when the general population would have bet their life savings that flying cars and human-like robots would exist by the year 2014.

There are definitely no flying cars, and robots aren’t exactly how we pictured them. However, we do have artificial intelligence that can understand what people are saying.

Creepy? Sort of, but more cool than creepy in my opinion.

There was a time, not too long ago, when the general population would have bet their life savings that flying cars and human-like robots would exist by the year 2014.

More Read

Keep an Eye on the emerging Open-Source Analytics Stack
Keep an Eye on the emerging Open-Source Analytics Stack
The Transformational Power of Big Data For HR
First Look – RuleXpress
Building Your Analytical Team: Tips for Executives
4 Ways to Increase the Security of Wearable Devices

There are definitely no flying cars, and robots aren’t exactly how we pictured them. However, we do have artificial intelligence that can understand what people are saying.

Creepy? Sort of, but more cool than creepy in my opinion.

When artificial language is used to understand human (natural) language, it’s referred to as natural language processing (NLP). Most NLP engines that are used to analyze text come equipped with something called sentiment analysis, which is a technology that lets us know whether text is positive, negative or neutral.

Good NLP engines will be able to assign sentiment to a single word or phrase. “Awful”, for example, is a word with negative sentiment. “Delicious” is positive and “Blue chair” is neutral.

Sentiment analysis can also tell us the polarity of an entire document. For example, a tweet that reads, “The service was awful but the food was delicious!” would be neutral. That’s because the positive and the negative cancel out to make for a neutral score.

Really good NLP engines will give you a sentiment score for the individual words and phrases that bear sentiment, and another score for the entire document as a whole. So in the example above, we would know that the tweet is neutral, but it contains valuable positive and negative information.

The problem with sentiment analysis is sometimes it’s wrong. It’s just a limitation that we have to deal with. I mean, humans can’t agree on the polarity of a document half the time. Even grad students won’t agree 20% of the time.

“Oh man, that was nasty!” Is this sentence positive or negative?

Surely, it must be negative. “Nasty” is a negative word, and everything else in this sentence is neutral. Final answer, negative! Drum role…

Wrong! It’s positive.

The person who said this used the American slang definition of nasty, which has positive sentiment. There is absolutely no way to know by reading the sentence. So, if you (a human) were just tricked by reading this article, how is a machine supposed to figure it out? Answer: Tell the engine what’s positive and what’s negative.

High quality NLP engines will let you customize your sentiment analysis settings. “Nasty” is negative by default. If you’re processing slang where “nasty” is considered a positive term, you would access your engine’s sentiment customization function, and assign a positive score to the word.

The better NLP engines out there will make this entire process a piece of cake. Without this kind of customization, the machine could very well be useless in your work. When you choose a sentiment analysis engine, make sure it allows for customization.

Otherwise, you’ll be stuck with a machine that interprets everything literally, and you’ll never get accurate results.

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

b2b payment data tells supplier about its customers
What B2B Payment Data Tells a Supplier About Its Customers
Business Intelligence
Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Alfred Hitchcock and a Classic Forecasting Scam
Predictive Analytics

Alfred Hitchcock and a Classic Forecasting Scam

5 Min Read
Votamatic Predicted the Presidential Election Results with R
AnalyticsNews

Votamatic Predicted the Presidential Election Results with R

4 Min Read
Tom Davenport’s Culture of Analytics
AnalyticsBest PracticesCommentaryCulture/LeadershipExclusiveInside Companies

Tom Davenport’s Culture of Analytics

6 Min Read
Comparing and Contrasting Analytics Types
AnalyticsBig Data

Comparing and Contrasting Analytics Types

4 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

From Bolts to Bots: How AI Is Fortifying the Automotive Industry
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?