Social Media’s Impact on Consumer Mindset: When to Use Which Sentiment Extraction Tool?
Raoul V. Kübler, Anatoli Colicev, and Koen Pauwels, 2017, 17-122-09
User-generated content provides managers rich data opportunities to gauge customers’ feelings, and sentiment analysis of social media data is increasingly used in a wide variety of fields, including finance, politics, and marketing. Popular tools include simple volume measures (such as number of likes and clicks), dictionary-based analysis of sentiment-rich words, and machine learning-based techniques.
These tools are typically used in isolation, which hinders ability to compare their power to explain customer-level performance such as brand awareness, image, purchase intent, customer satisfaction, and recommendation. Similarly, managers and other decision makers are uncertain as to whether their analysts are using the appropriate tool to extract actionable sentiment information for their specific brands and industries.
Raoul Kübler, Anatoli Colicev, and Koen Pauwels address this issue by analyzing a unique dataset with daily social media and consumer mindset metrics for 48 brands in diverse industries. They compare the dynamic explanatory power of these methods for daily customer mindset metrics.
Overall, vector autoregressive models show that machine learning-based approaches have the best average performance for detecting positive, negative and neutral comments. At the same time, there are systematic differences among industries, mindset metrics, and brands. Since costs increase when moving from volume metrics to dictionaries and machine learning, these findings can help managers decide when more detailed analytics are worth the investment.
Volume metrics are the cheapest to obtain and perform well for explaining awareness and purchase intent. This is an appropriate choice especially for smaller brands in negative sentiment industries (e.g., airlines and banking). Managers of other brands may consider investing in more sophisticated sentiment analysis techniques, especially when explaining or predicting brand impression, satisfaction, and recommendation.
Raoul V. Kübler is Assistant Professor of Marketing, Ozyegin University, Istanbul. Anatoli Colicev is Assistant Professor of Marketing, Nazarbayev University Graduate School of Business, Astana. Koen Pauwels is Professor of Marketing, Northeastern University, Boston.
Identifying Customer Needs from User-Generated Content
Artem Timoshenko and John R. Hauser (2018) [Report]
Integrating Social Media Metrics
Wendy W. Moe and David A. Schweidel (2015) [Report]
- Corporate: FREE
- Academic: FREE
- Subscribers: FREE
- Public: $0.00
3 WAYS to GET CONNECTED
Employees of MSI Member Companies enjoy the benefits of complete online access to content, member conferences and networking with the MSI community.
Qualified academics benefit from a relationship with MSI through access to msi.org, conferences and research opportunities.
The public is invited to enjoy partial access to msi.org content, a free e-newsletter, selected reports and more.