Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    sales and data analytics
    How Data Analytics Improves Lead Management and Sales Results
    9 Min Read
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: This Is Why You Shouldn’t Weight Your Survey Data
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Uncategorized > This Is Why You Shouldn’t Weight Your Survey Data
Uncategorized

This Is Why You Shouldn’t Weight Your Survey Data

AnniePettit
AnniePettit
4 Min Read
Image
SHARE

ImageFor a long time I’ve been a big proponent of weighting data as little and as rarely as possible. You see, I would rather fill cells to achieve the desired sample size rather than fake cells based on data I’ve already gathered – not on data that I failed to gather.

ImageFor a long time I’ve been a big proponent of weighting data as little and as rarely as possible. You see, I would rather fill cells to achieve the desired sample size rather than fake cells based on data I’ve already gathered – not on data that I failed to gather. Obviously, I failed to gather that data for a specific reason, perhaps one that is completely unknown and unguessable to me.

Let’s look at an example. I asked Excel to randomly generate a score from 1 to 10 for fifty men and fifty women. Then, I copied those scores four times. In the first copy, I deleted the last ten scores of women. In the second copy, I deleted the last twenty scores of women, and so on. What I was left with was five datasets based on the exact same population, but with various percentages of missing data. Why was the data missing? I don’t know. Maybe the introverts didn’t answer the door/pick up the phone/talk to me at the mall. Maybe the high income people were all away from home and at their cottages that weekend. Maybe my interviewer drove up in a beat-up, rusty Pinto and scared people off. Regardless, data analysis must begin!

In the Perfect Sample, we see the results from 50 men and 50 women wherein the weights for both men and women are 1, and both the unweighted and weighted total scores are 5.5. But notice what happens when data from more and more women become missing, and the weights for women must compensate and become higher and higher. Although we know that the “true” score is 5.5, the Unweighted Total Score eventually becomes 4.8 and is made even worse with the Weighted Total Score which eventually becomes 4.5 in Scenario 4. In other words, although weighting the data ensured that women’s opinions were counted just as much as men’s opinions, it didn’t improve the quality of the data. It simply exaggerated a flawed sampling technique.

 

 Random SampleScenario 2Scenario 3Scenario 3Scenario 4
Unweighted Total Score5.55.35.14.94.8
Number of men5050505050
Number of women5045403530
Weight for men1.01.01.01.01.0
Weight for women1.01.111.251.431.67
Weighted Total Score5.55.35.04.84.5

 

The moral of the story is this.

Never use weighting to adjust or correct for missing data.

Fill every cell, and then use weighting sparingly to adjust for extremely minor differences that resulted from oversampling (not undersampling).

This message has been brought to you by the letter α and the number 27644437.

 

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

sales and data analytics
How Data Analytics Improves Lead Management and Sales Results
Analytics Big Data Exclusive
ai in marketing
How AI and Smart Platforms Improve Email Marketing
Artificial Intelligence Exclusive Marketing
AI Document Verification for Legal Firms: Importance & Top Tools
AI Document Verification for Legal Firms: Importance & Top Tools
Artificial Intelligence Exclusive
AI supply chain
AI Tools Are Strengthening Global Supply Chains
Artificial Intelligence Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Dunbar Lives!

3 Min Read
Image
Uncategorized

How GE Is Using Big Data to Drive Business Performance

7 Min Read

5 Must-Do’s to Prepare Change

6 Min Read

Failing Faster

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots
ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?