Access the full text.
Sign up today, get DeepDyve free for 14 days.
S. Pokharel (2014)
Wisdom of Crowds: The Value of Stock Opinions Transmitted through Social MediaCfa Digest, 44
Paul Tetlock (2005)
Giving Content to Investor Sentiment: The Role of Media in the Stock MarketThe Journal of Finance, 62(3)
E. Fama, K. French (1993)
Common risk factors in the returns on stocks and bondsJournal of Financial Economics, 33
P. Deans (2011)
The Impact of Social Media on C-level RolesMIS Q. Executive, 10
Stefano Baccianella, Andrea Esuli, F. Sebastiani (2010)
SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining
Lucia Vadicamo, F. Carrara, Andrea Cimino, S. Cresci, F. Dell’Orletta, F. Falchi, M. Tesconi (2017)
Cross-Media Learning for Image Sentiment Analysis in the Wild2017 IEEE International Conference on Computer Vision Workshops (ICCVW)
Shuyuan Deng, Zhijian Huang, Atish Sinha, Huimin Zhao (2018)
The Interaction Between Microblog Sentiment and Stock Returns: An Empirical ExaminationMIS Q., 42
Quanzeng You, Jiebo Luo, Hailin Jin, Jianchao Yang (2015)
Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep NetworksArXiv, abs/1509.06041
T. Ensor, A. Surprenant, I. Neath (2018)
Increasing word distinctiveness eliminates the picture superiority effect in recognition: Evidence for the physical-distinctiveness accountMemory & Cognition, 47
Samar Alqhtani, S. Luo, B. Regan (2015)
Fusing Text and Image for Event Detection in TwitterArXiv, abs/1503.03920
H. Sul, A. Dennis, Lingyao Yuan (2014)
Trading on Twitter: The Financial Information Content of Emotion in Social Media2014 47th Hawaii International Conference on System Sciences
H. Sul, A. Dennis, Lingyao Yuan (2017)
Trading on Twitter: Using Social Media Sentiment to Predict Stock ReturnsDecis. Sci., 48
Harald Schoen, Daniel Gayo-Avello, P. Metaxas, Eni Mustafaraj, M. Strohmaier, P. Gloor (2013)
The power of prediction with social mediaInternet Res., 23
Atika Qazi, R. Raj, Glenn Hardaker, C. Standing (2017)
A systematic literature review on opinion types and sentiment analysis techniques: Tasks and challengesInternet Res., 27
Pei Xu, Liang Chen, R. Santhanam (2015)
Will video be the next generation of e-commerce product reviews? Presentation format and the role of product typeDecis. Support Syst., 73
Xueming Luo (2007)
Consumer Negative Voice and Firm-Idiosyncratic Stock ReturnsJournal of Marketing, 71
Jan Kietzmann, Kristopher Hermkens, Ian McCarthy, Bruno Silvestre (2011)
Social Media? Get Serious! Understanding the Functional Building Blocks of Social MediaBusiness Horizons, 54
Steve Schifferes, N. Newman, Neil Thurman, D. Corney, A. Göker, Carlos Martin (2014)
Identifying and Verifying News through Social MediaDigital Journalism, 2
X. Leung, S. Tanford, Lan Jiang (2017)
Is a picture really worth a thousand words?: An experiment on hotel Facebook message effectivenessJournal of Hospitality and Tourism Technology, 8
Terry Childers, M. Houston (1984)
Conditions for a Picture-Superiority Effect on Consumer MemoryJournal of Consumer Research, 11
Sung-Byung Yang, Sungyoung Hlee, Jimin Lee, C. Koo (2017)
An empirical examination of online restaurant reviews on Yelp.comInternational Journal of Contemporary Hospitality Management, 29
K. Im, M. Pesaran, Y. Shin (2003)
Testing for unit roots in heterogeneous panelsJournal of Econometrics, 115
Quanzeng You, Hailin Jin, Jiebo Luo (2017)
Visual Sentiment Analysis by Attending on Local Image Regions
Jufeng Yang, Dongyu She, Yu-Kun Lai, Paul Rosin, Ming-Hsuan Yang (2018)
Weakly Supervised Coupled Networks for Visual Sentiment Analysis2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
F. Ordenes, Dhruv Grewal, S. Ludwig, K. Ruyter, D. Mahr, Martin Wetzels (2019)
Cutting through Content Clutter: How Speech and Image Acts Drive Consumer Sharing of Social Media Brand MessagesJournal of Consumer Research, 45
Thien Nguyen, Kiyoaki Shirai, Julien Velcin (2015)
Sentiment analysis on social media for stock movement predictionExpert Syst. Appl., 42
Xiaodong Li, Haoran Xie, Li Chen, Jianping Wang, Xiaotie Deng (2014)
News impact on stock price return via sentiment analysisKnowl. Based Syst., 69
Maik Schmeling (2009)
Investor sentiment and stock returns: Some international evidenceJournal of Empirical Finance, 16
MIS Quarterly, 44
Xueming Luo, Christian Homburg, J. Wieseke (2010)
Customer Satisfaction, Analyst Stock Recommendations, and Firm ValueJournal of Marketing Research, 47
M. Makrehchi, Sameena Shah, Wenhui Liao (2013)
Stock Prediction Using Event-Based Sentiment Analysis2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), 1
L. Liu, Daria Dzyabura, Natalie Mizik (2018)
Visual Listening In: Extracting Brand Image Portrayed on Social MediaMark. Sci., 39
J. Bollen, Huina Mao, Xiao-Jun Zeng (2010)
Twitter mood predicts the stock marketArXiv, abs/1010.3003
Robert Gertner, Bengt Holmstrom
Herd Behavior and Investment
M. Soleymani, David García, Brendan Jou, Björn Schuller, Shih-Fu Chang, M. Pantic (2017)
A survey of multimodal sentiment analysisImage Vis. Comput., 65
D. Kliger, BG Malkiel (2007)
Efficient capital markets: A review of theory and empirical work
Marketing Science, 31
D. Scharfstein, J. Stein (1990)
Herd Behavior and InvestmentThe American Economic Review, 80
D. Shin, Shu He, G. Lee, Andrew Whinston, Suleyman Cetintas, Kuang-chih Lee (2020)
Enhancing Social Media Analysis with Visual Data Analytics: A Deep Learning ApproachMIS Q., 44
H. Reinert (1976)
One picture is worth a thousand words? Not necessarily.The Modern Language Journal, 60
Heshan Sun (2013)
A Longitudinal Study of Herd Behavior in the Adoption and Continued Use of TechnologyMIS Q., 37
S. Bikhchandani, Sunil Sharma (2000)
Herd Behavior in Financial MarketsIMF Staff Papers, 47
D. Willows (1978)
A Picture Is Not Always Worth a Thousand Words: Pictures as Distractors in Reading.Journal of Educational Psychology, 70
Chong Oh, O. Sheng (2011)
Investigating Predictive Power of Stock Micro Blog Sentiment in Forecasting Future Stock Price Directional Movement
William Hamilton, Kevin Clark, J. Leskovec, Dan Jurafsky (2016)
Inducing Domain-Specific Sentiment Lexicons from Unlabeled CorporaProceedings of the Conference on Empirical Methods in Natural Language Processing. Conference on Empirical Methods in Natural Language Processing, 2016
Marketing Science, 39
J. Xun, Biao Guo (2017)
Twitter as customer's eWOM: an empirical study on their impact on firm financial performanceInternet Res., 27
Yingcai Wu, Nan Cao, D. Gotz, Yap-Peng Tan, D. Keim (2016)
A Survey on Visual Analytics of Social Media DataIEEE Transactions on Multimedia, 18
Leqi Liu, Daniel Preotiuc-Pietro, Zahra Samani, M. Moghaddam, L. Ungar (2016)
Analyzing Personality through Social Media Profile Picture Choice
Stuti Jindal, Sanjay Singh (2015)
Image sentiment analysis using deep convolutional neural networks with domain specific fine tuning2015 International Conference on Information Processing (ICIP)
Tzu-Lun Huang (2018)
The puzzling media effect in the Chinese stock marketPacific-Basin Finance Journal
Seshadri Tirunillai, G. Tellis (2011)
Does Chatter Really Matter? Dynamics of User-Generated Content and Stock PerformanceERIM: Business Processes
Jeffrey Pennington, R. Socher, Christopher Manning (2014)
GloVe: Global Vectors for Word Representation
In Choi (2001)
Unit root tests for panel dataJournal of International Money and Finance, 20
Review of Financial Studies, 27
A. Whitehouse, M. Maybery, K. Durkin (2006)
The development of the picture‐superiority effectBritish Journal of Development Psychology, 24
Yubo Chen, Jinhong Xie (2004)
Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication MixQuantitative Marketing
Shaojing Fan, Zhiqi Shen, Ming Jiang, Bryan Koenig, Juan Xu, M. Kankanhalli, Qi Zhao (2018)
Emotional Attention: A Study of Image Sentiment and Visual Attention2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
C. Ho, P. Damien, B. Gu, Prabhudev Konana (2017)
The time-varying nature of social media sentiments in modeling stock returnsDecis. Support Syst., 101
Tarun Chordia, B. Swaminathan (2000)
Trading Volume and Cross‐Autocorrelations in Stock ReturnsJournal of Finance, 55
M. Weldon, H. Roediger, B. Challis (1989)
The properties of retrieval cues constrain the picture superiority effectMemory & Cognition, 17
Xueming Luo, J. Zhang, Wenjing Duan (2013)
Social Media and Firm Equity ValueFox: Marketing & Supply Chain Management (Topic)
Wei Dong, S. Liao, Zhongju Zhang (2018)
Leveraging Financial Social Media Data for Corporate Fraud DetectionJournal of Management Information Systems, 35
Despite the extensive academic interest in social media sentiment for financial fields, multimodal data in the stock market has been neglected. The purpose of this paper is to explore the influence of multimodal social media data on stock performance, and investigate the underlying mechanism of two forms of social media data, i.e. text and pictures.Design/methodology/approachThis research employs panel vector autoregressive models to quantify the effect of the sentiment derived from two modalities in social media, i.e. text information and picture information. Through the models, the authors examine the short-term and long-term associations between social media sentiment and stock performance, measured by three metrics. Specifically, the authors design an enhanced sentiment analysis method, integrating random walk and word embeddings through Global Vectors for Word Representation (GloVe), to construct a domain-specific lexicon and apply it to textual sentiment analysis. Secondly, the authors exploit a deep learning framework based on convolutional neural networks to analyze the sentiment in picture data.FindingsThe empirical results derived from vector autoregressive models reveal that both measures of the sentiment extracted from textual information and pictorial information in social media are significant leading indicators of stock performance. Moreover, pictorial information and textual information have similar relationships with stock performance.Originality/valueTo the best of the authors’ knowledge, this is the first study that incorporates multimodal social media data for sentiment analysis, which is valuable in understanding pictures of social media data. The study offers significant implications for researchers and practitioners. This research informs researchers on the attention of multimodal social media data. The study’s findings provide some managerial recommendations, e.g. watching not only words but also pictures in social media.
Internet Research – Emerald Publishing
Published: May 19, 2021
Keywords: Stock performance; Multimodal data; Sentiment analysis; Deep learning; Vector autoregression
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.