Inducing Domain-Specific Sentiment Lexicons from Unlabeled Corpora
By William L. Hamilton, Kevin Clark, Jure Leskovec, Dan Jurafsky. 2016
343 citations recorded by the source corpus.
A word's sentiment depends on the domain in which it is used. Computational social science research thus requires sentiment lexicons that are specific to the domains being studied. We combine domain-specific word embeddings with a label propagation framework to induce accurate domain-specific sentiment lexicons using small sets of seed words. We show that our approach achieves state-of-the-art performance on inducing sentiment lexicons from domain-specific corpora and that our purely corpus-based approach outperforms methods that rely on hand-curated resources (e.g., WordNet). Using our framework, we induce and release historical sentiment lexicons for 150 years of English and community-specific sentiment lexicons for 250 online communities from the social media forum Reddit. The historical lexicons we induce show that more than 5% of sentiment-bearing (non-neutral) English words completely switched polarity during the last 150 years, and the community-specific lexicons highlight how sentiment varies drastically between different communities.
Subfields: Artificial Intelligence, Natural Language Processing, Sentiment & Opinion Analysis
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Percy Liang
- Erik Cambria
- Soujanya Poria
- Mohit Bansal
- Noah A. Smith
- Luke S. Zettlemoyer
- Yejin Choi
- Jianfeng Gao
In Natural Language Processing
- Soujanya Poria
- Erik Cambria
- Noah A. Smith
- Percy Liang
- Luke S. Zettlemoyer
- Mohit Bansal
- Dan Jurafsky
- Mohit Iyyer
In Sentiment & Opinion Analysis
- Sven Buechel
- Udo Hahn
- Saif M. Mohammad
- Devamanyu Hazarika
- Soujanya Poria
- Susanna Rücker
- Navonil Majumder
- Erik Cambria
Citations in the corpus
- Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus (2021, methodology): “We compute a sentiment lexicon by averaging the various social lexicons of Hamilton et al. (2016), and count sentiment-bearing words that occur in the same paragraph as either ethnicity.”
- Natural language based financial forecasting: a survey (2017, background): “Recently, there have been other attempts to automatically build lexicons for the financial domain [111,45].”
- Learning and Evaluating Emotion Lexicons for 91 Languages (2020, methodology): “More recent approaches focus heavily on word embeddings, either using semi-supervised graph-based approaches (Wang et al., 2016; Hamilton et al., 2016; Sedoc et al., 2017) or fully supervised methods (Rosenthal et al., 2015; Li et al., 2017; Rothe et al., 2016; Du and Zhang, 2016).”
- Word Emotion Induction for Multiple Languages as a Deep Multi-Task Learning Problem (2018, methodology): “Training was performed according to the original paper with the exception that (following Hamilton et al. (2016)) we did not apply the proposed re-orthogonalization after each training step, since we did not find any evidence that this procedure actually results in improved performance.”
- Sentiment Analysis: Detecting Valence, Emotions, and Other Affectual States from Text (2016, methodology): “These approaches are of two kinds: (1) those that learn word embeddings with an additional objective function to keep antonymous and differing sentiment word pairs farther away from each other (Maas, Daly, Pham, Huang, Ng, & Potts, 2011; Tang, Wei, Qin, Zhou, & Liu, 2014b; Ren, Zhang, Zhang, & Ji, 2”
- Diachronic word embeddings and semantic shifts: a survey (2018, methodology): “At the same time, Hamilton et al. (2016c) and Hamilton et al. (2016b) showed that these two approaches can be used simultaneously: they employed both ‘second order embeddings’ and orthogonal Procrustes transformations to align diachronic models. Recently, it was shown in Bamler and Mandt (2017) (‘dy”
- Community Interaction and Conflict on the Web (2018, background): “Previous work has suggested that conflicting communities are likely to focus on topically similar areas [14, 25], so we evaluate this hypothesis here.”
- Knowledge Adaptation: Teaching to Adapt (2017, background): “world review categories, blog types, or communities (Hamilton et al., 2016).”
- Investigating Sports Commentator Bias within a Large Corpus of American Football Broadcasts (2019, methodology): “, a window of words around a player mention) by searching for words that match those in domain-specific sentiment lexicons from Hamilton et al. (2016).10 This method identifies 49,787 windows containing sentiment-laden words, only 12.”
- Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research (2020, background): “One line of work models domain-dependent word embeddings, Sarma et al. [188], Shi et al. [192], K Sarma et al. [88] or domain-specific sentiment lexicons, Hamilton et al.[56], while others attempt to learn representations based on either co-occurrences of domain-specific with domain-independent term”
- Time-Out: Temporal Referencing for Robust Modeling of Lexical Semantic Change (2019, methodology): “Previous evaluation procedures mainly tackle a few words: case studies of individual words (Wi-jaya and Yeniterzi, 2011; Jatowt and Duh, 2014; Hamilton et al., 2016a), or a comparison between a few changing and semantically stable words (Lau et al., 2012; Schlechtweg et al., 2017).”
- Exploring Human Gender Stereotypes with Word Association Test (2019, background): “The local strategy is to connect a word with its k nearest neighbors (same as Hamilton et al. (2016)).”
- KinGDOM: Knowledge-Guided DOMain Adaptation for Sentiment Analysis (2020, background): “, 2019) or domain-specific sentiment lexicons (Hamilton et al., 2016a), while others attempt to learn representations based on co-occurrences of domainspecific with domain-independent terms (Blitzer et al.”