1
ICSE
2018
Lin et al.
Sentiment Analysis for Software Engineering: How Far Can We Go?
Sentiment Analysis for Software Engineering: How Far Can We Go?
✔️
✔️
✔️
✔️
Tool Development + Evaluation
✔️
Stanford CoreNLP SO
2
MSR
2017
Islam and Zibran
Leveraging Automated Sentiment Analysis in Software Engineering
Leveraging Automated Sentiment Analysis in Software Engineering
✔️
✔️
❌
✔️
Tool Development + Evaluation
❌
SentiStrength-SE
3
MSR
2018
Novielli et al.
A Benchmark Study on Sentiment Analysis for Software Engineering Research
A Benchmark Study on Sentiment Analysis for Software Engineering Research
✔️
✔️
✔️
✔️
Tool Evaluation
❌
4
EMSE
2017
Jongeling et al.
On Negative Results When Using Sentiment Analysis Tools for Software Engineering Research
On Negative Results When Using Sentiment Analysis Tools for Software Engineering Research
✔️
✔️
✔️
✔️
Tool Evaluation
❌
5
ICSME
2015
Jongeling et al.
Choosing Your Weapons: On Sentiment Analysis Tools for Software Engineering Research
Choosing Your Weapons: On Sentiment Analysis Tools for Software Engineering Research
✔️
✔️
❌
✔️
Tool Evaluation
❌
6
JSS
2018
Islam and Zibran
SentiStrength-SE: Exploiting Domain Specificity for Improved Sentiment Analysis in Software Engineering Text
SentiStrength-SE: Exploiting Domain Specificity for Improved Sentiment Analysis in Software Engineering Text
✔️
✔️
✔️
✔️
Tool Development + Evaluation
❌
7
ICSME
2020
Zhang et al.
Sentiment Analysis for Software Engineering: How Far Can Pre-trained Transformer Models Go?
Sentiment Analysis for Software Engineering: How Far Can Pre-trained Transformer Models Go?
✔️
✔️
✔️
✔️
Tool Development + Evaluation
❌
Fine-tune pre-trained Transformer-based models (BERT, RoBERTa, XLNet) for SE
8
SEmotion
2018
Ding et al.
Entity-Level Sentiment Analysis of Issue Comments
Entity-Level Sentiment Analysis of Issue Comments
✔️
✔️
✔️
✔️
Tool Development + Evaluation
✔️
SentiSW
9
MSR
2017
Souza and Silva
Sentiment Analysis of Travis CI Builds
Sentiment Analysis of Travis CI Builds
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
10
ASE
2017
Ahmed et al.
SentiCR: A Customized Sentiment Analysis Tool for Code Review Interactions
SentiCR: A Customized Sentiment Analysis Tool for Code Review Interactions
✔️
✔️
✔️
✔️
Tool Development + Evaluation
✔️
SentiCR
11
JSS
2015
Jurado and Rodriguez
Sentiment Analysis in Monitoring Software Development Processes: An Exploratory Case Study on GitHub's Project Issues
Sentiment Analysis in Monitoring Software Development Processes: An Exploratory Case Study on GitHub's Project Issues
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
12
MSR
2016
Blaz and Becker
Sentiment Analysis in Tickets for IT Support
Sentiment Analysis in Tickets for IT Support
❌
❌
✔️
✔️
Tool Development + Evaluation
✔️
3 dictionary-based models
13
DASC/ PiCom/ CBDCom/ CyberSciTech
2019
Shen et al.
Evaluating the Performance of Machine Learning Sentiment Analysis Algorithms in Software Engineering
Evaluating the Performance of Machine Learning Sentiment Analysis Algorithms in Software Engineering
✔️
✔️
✔️
✔️
Tool Evaluation
❌
14
EMSE
2018
Calefato et al.
Sentiment Polarity Detection for Software Development
Sentiment Polarity Detection for Software Development
✔️
✔️
✔️
✔️
Tool Development + Evaluation
✔️
Senti4SD
15
MSR
2014
Guzman et al.
Sentiment Analysis of Commit Comments in GitHub: An Empirical Study
Sentiment Analysis of Commit Comments in GitHub: An Empirical Study
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
16
SEDE
2018
Islam and Zibran
Sentiment Analysis of Software Bug Related Commit Messages
Sentiment Analysis of Software Bug Related Commit Messages
✔️
✔️
❌
✔️
Tool Application + Usage
❌
17
SSE
2015
Novielli et al.
The Challenges of Sentiment Detection in the Social Programmer Ecosystem
The Challenges of Sentiment Detection in the Social Programmer Ecosystem
✔️
✔️
✔️
✔️
Tool Evaluation
❌
18
SAC
2018
Islam and Zibran
DEVA: Sensing Emotions in the Valence Arousal Space in Software Engineering Text
DEVA: Sensing Emotions in the Valence Arousal Space in Software Engineering Text
✔️
✔️
✔️
✔️
Tool Development + Evaluation
✔️
DEVA
19
MSR
2016
Sinha et al.
Analyzing Developer Sentiment in Commit Logs
Analyzing Developer Sentiment in Commit Logs
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
20
MSR
2017
Mäntylä et al.
Bootstrapping a Lexicon for Emotional Arousal in Software Engineering
Bootstrapping a Lexicon for Emotional Arousal in Software Engineering
❌
❌
✔️
✔️
Tool Development + Evaluation
✔️
21
SEmotion
2018
Imtiaz et al.
Sentiment and Politeness Analysis Tools on Developer Discussions Are Unreliable, but So Are People
Sentiment and Politeness Analysis Tools on Developer Discussions Are Unreliable, but So Are People
✔️
✔️
✔️
✔️
Tool Evaluation
✔️
22
ESEC/FSE
2013
Guzman and Bruegge
Towards Emotional Awareness in Software Development Teams
Towards Emotional Awareness in Software Development Teams
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
23
SANER
2020
Huq et al.
Is Developer Sentiment Related to Software Bugs: An Exploratory Study on GitHub Commits
Is Developer Sentiment Related to Software Bugs: An Exploratory Study on GitHub Commits
✔️
✔️
❌
✔️
Tool Application + Usage
❌
24
SSE
2014
Novielli et al.
Towards Discovering the Role of Emotions in StackOverflow
Towards Discovering the Role of Emotions in StackOverflow
❌
❌
❌
✔️
Tool Application + Usage
❌
25
MSR
2018
Novielli et al.
A Gold Standard for Emotion Annotation in Stack Overflow
A Gold Standard for Emotion Annotation in Stack Overflow
❌
❌
✔️
✔️
Tool Application + Usage
✔️
26
MSR
2018
Efstathiou et al.
Word Embeddings for the Software Engineering Domain
Word Embeddings for the Software Engineering Domain
❌
❌
❌
✔️
Tool Development + Evaluation
❌
word2vec
27
ICSE-NIER
2017
Gachechiladze et al.
Anger and Its Direction in Collaborative Software Development
Anger and Its Direction in Collaborative Software Development
❌
❌
✔️
✔️
Tool Development + Evaluation
✔️
28
MSR
2019
Biswas et al.
Exploring Word Embedding Techniques to Improve Sentiment Analysis of Software Engineering Texts
Exploring Word Embedding Techniques to Improve Sentiment Analysis of Software Engineering Texts
❌
✔️
✔️
✔️
Tool Development + Evaluation
❌
RNN4SentiSE
29
MSR
2015
Calefato et al.
Mining Successful Answers in Stack Overflow
Mining Successful Answers in Stack Overflow
✔️
✔️
❌
✔️
Tool Application + Usage
❌
30
MSR
2015
Ortu et al.
Are Bullies more Productive? Empirical Study of Affectiveness vs. Issue Fixing Time
Are Bullies more Productive? Empirical Study of Affectiveness vs. Issue Fixing Time
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
31
MSR
2016
Ortu et al.
The Emotional Side of Software Developers in JIRA
The Emotional Side of Software Developers in JIRA
❌
❌
✔️
✔️
Tool Application + Usage
✔️
32
ICPC
2021
Sun et al.
Exploiting the Unique Expression for Improved Sentiment Analysis in Software Engineering Text
Exploiting the Unique Expression for Improved Sentiment Analysis in Software Engineering Text
❌
✔️
❌
✔️
Tool Development + Evaluation
❌
SESSION
33
CASCON
2014
Tourani et al.
Monitoring Sentiment in Open Source Mailing Lists – Exploratory Study on the Apache Ecosystem
Monitoring Sentiment in Open Source Mailing Lists – Exploratory Study on the Apache Ecosystem
✔️
✔️
✔️
✔️
Tool Application + Usage
✔️
34
SEmotion
2019
Ferreira et al.
A Longitudinal Study on the Maintainers’ Sentiment of a Large Scale Open Source Ecosystem
A Longitudinal Study on the Maintainers’ Sentiment of a Large Scale Open Source Ecosystem
❌
❌
✔️
✔️
Tool Application + Usage
❌
35
MSR
2020
Novielli et al.
Can We Use SE-specific Sentiment Analysis Tools in a Cross-Platform Setting?
Can We Use SE-specific Sentiment Analysis Tools in a Cross-Platform Setting?
✔️
✔️
❌
✔️
Tool Evaluation
✔️
36
MSR
2022
Ferreira et al.
How Heated Is It? Understanding GitHub Locked Issues
How Heated Is It? Understanding GitHub Locked Issues
❌
❌
❌
✔️
Tool Application + Usage (human only)
✔️
37
MSR
2014
Murgia et al.
Do Developers Feel Emotions? An Exploratory Analysis of Emotions in Software Artifacts
Do Developers Feel Emotions? An Exploratory Analysis of Emotions in Software Artifacts
✔️
✔️
❌
✔️
Tool Application + Usage (human only)
✔️
38
SEmotion
2019
Cheruvelil and daSilva
Developers' Sentiment and Issue Reopening
Developers' Sentiment and Issue Reopening
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
39
ICSE-NIER
2019
Robbes and Janes
Leveraging Small Software Engineering Data Sets with Pre-trained Neural Networks
Leveraging Small Software Engineering Data Sets with Pre-trained Neural Networks
❌
❌
✔️
✔️
Tool Evaluation
❌
40
ESEC/FSE
2019
Chen et al.
SEntiMoji: An Emoji-Powered Learning Approach for Sentiment Analysis in Software Engineering
SEntiMoji: An Emoji-Powered Learning Approach for Sentiment Analysis in Software Engineering
✔️
✔️
✔️
✔️
Tool Development + Evaluation
❌
SEntiMoji
41
ESEC/FSE
2021
Venigalla and Chimalakonda
StackEmo: Towards Enhancing User Experience by Augmenting Stack Overflow with Emojis
StackEmo: Towards Enhancing User Experience by Augmenting Stack Overflow with Emojis
❌
✔️
❌
✔️
Tool Development + Evaluation
❌
StackEmo
42
MSR
2020
Claes and Mäntylä
20-MAD - 20 Years of Issues and Commits of Mozilla and Apache Development
20-MAD - 20 Years of Issues and Commits of Mozilla and Apache Development
❌
❌
❌
✔️
Tool Application + Usage
❌
43
ICSEW
2020
Kuutila et al.
Chat Activity Is a Better Predictor than Chat Sentiment on Software Developers Productivity
Chat Activity Is a Better Predictor than Chat Sentiment on Software Developers Productivity
❌
❌
❌
✔️
Tool Application + Usage
❌
44
SEmotion
2016
Marshall et al.
Outcomes of Emotional Content from Agile Team Forum Posts
Outcomes of Emotional Content from Agile Team Forum Posts
❌
❌
❌
✔️
Tool Application + Usage (human only)
✔️
45
ICSE
2022
Miller et al.
“Did You Miss My Comment or What?” Understanding Toxicity in Open Source Discussions
“Did You Miss My Comment or What?” Understanding Toxicity in Open Source Discussions
❌
❌
❌
✔️
Tool Application + Usage
✔️
46
APSEC
2020
Sarker et al.
A Benchmark Study of the Contemporary Toxicity Detectors on Software Engineering Interactions
A Benchmark Study of the Contemporary Toxicity Detectors on Software Engineering Interactions
❌
❌
❌
✔️
Tool Evaluation
✔️
47
ESEC/FSE
2021
Cohen
Contextualizing Toxicity in Open Source: A Qualitative Study
Contextualizing Toxicity in Open Source: A Qualitative Study
❌
❌
❌
✔️
Tool Application + Usage
✔️
48
EASE
2021
Cheriyan et al.
Towards Offensive Language Detection and Reduction in Four Software Engineering Communities
Towards Offensive Language Detection and Reduction in Four Software Engineering Communities
✔️
✔️
❌
✔️
Tool Evaluation
✔️
49
ENASE
2022
Sayago-Heredia et al.
Exploring the Impact of Toxic Comments in Code Quality
Exploring the Impact of Toxic Comments in Code Quality
❌
❌
❌
✔️
Tool Application + Usage
❌
50
TOSEM
2023
Sarker et al.
Automated Identification of Toxic Code Reviews Using ToxiCR
Automated Identification of Toxic Code Reviews Using ToxiCR
❌
❌
❌
✔️
Tool Development + Evaluation
❌
ToxiCR
51
EMSE
2022
Hata et al.
GitHub Discussions: An Exploratory Study of Early Adoption
GitHub Discussions: An Exploratory Study of Early Adoption
❌
✔️
❌
✔️
Tool Application + Usage
✔️
52
ICSE-NIER
2020
Raman et al.
Stress and Burnout in Open Source: Toward Finding, Understanding, and Mitigating Unhealthy Interactions
Stress and Burnout in Open Source: Toward Finding, Understanding, and Mitigating Unhealthy Interactions
❌
❌
❌
✔️
Tool Development + Evaluation
✔️
STRUDEL toxicity detector
53
ICSE-SEIS
2022
Qiu et al.
Detecting Interpersonal Conflict in Issues and Code Review: Cross Pollinating Open- and Closed-Source Approaches
Detecting Interpersonal Conflict in Issues and Code Review: Cross Pollinating Open- and Closed-Source Approaches
❌
❌
❌
✔️
Tool Evaluation
✔️
54
HCI
2021
Ferreira et al.
The “Shut the f**k up” Phenomenon: Characterizing Incivility in Open Source Code Review Discussions
The “Shut the f**k up” Phenomenon: Characterizing Incivility in Open Source Code Review Discussions
❌
✔️
❌
✔️
Tool Evaluation
✔️
55
ESEM
2017
Islam and Zibran
A Comparison of Dictionary Building Methods for Sentiment Analysis in Software Engineering Text
A Comparison of Dictionary Building Methods for Sentiment Analysis in Software Engineering Text
✔️
✔️
✔️
✔️
Tool Evaluation
❌
56
SANER
2018
Islam and Zibran
A Comparison of Software Engineering Domain Specific Sentiment Analysis Tools
A Comparison of Software Engineering Domain Specific Sentiment Analysis Tools
✔️
✔️
✔️
✔️
Tool Evaluation
❌
57
ACIIW
2017
Calefato et al.
EmoTxt: A Toolkit for Emotion Recognition from Text
EmoTxt: A Toolkit for Emotion Recognition from Text
✔️
✔️
✔️
✔️
Tool Development + Evaluation
✔️
EmoTxt
58
OSS
2020
Kritikos et al.
An Empirical Investigation of Sentiment Analysis of the Bug Tracking Process in Libre Office Open Source Software
An Empirical Investigation of Sentiment Analysis of the Bug Tracking Process in Libre Office Open Source Software
✔️
✔️
❌
✔️
Tool Application + Usage
❌
59
EMSE
2018
Murgia et al.
An Exploratory Qualitative and Quantitative Analysis of Emotions in Issue Report Comments of Open Source Systems
An Exploratory Qualitative and Quantitative Analysis of Emotions in Issue Report Comments of Open Source Systems
✔️
✔️
✔️
✔️
Tool Development + Evaluation
✔️
ESEM-E
60
RE Journal
2017
Guzman et al.
An Exploratory Study of Twitter Messages about Software Applications
An Exploratory Study of Twitter Messages about Software Applications
✔️
✔️
✔️
✔️
Tool Application + Usage
✔️
61
SEKE
2018
Freira et al.
Analyzing The Impact Of Feedback In GitHub On The Software Developer's Mood
Analyzing The Impact Of Feedback In GitHub On The Software Developer's Mood
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
62
EMSE
2021
Novielli et al.
Assessment of Off-the-Shelf SE-Specific Sentiment Analysis Tools: An Extended Replication Study
Assessment of Off-the-Shelf SE-Specific Sentiment Analysis Tools: An Extended Replication Study
✔️
✔️
❌
✔️
Tool Evaluation
✔️
63
EMSE
2020
Ahasanuzzaman et al.
CAPS: A Supervised Technique for Classifying Stack Overflow Posts Concerning API Issues
CAPS: A Supervised Technique for Classifying Stack Overflow Posts Concerning API Issues
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
64
TRel
2020
Umer et al.
CNN-Based Automatic Prioritization of Bug Reports
CNN-Based Automatic Prioritization of Bug Reports
✔️
✔️
❌
✔️
Tool Application + Usage
❌
65
HICSS
2016
Robinson et al.
Developer Behavior and Sentiment from Data Mining Open Source Repositories
Developer Behavior and Sentiment from Data Mining Open Source Repositories
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
66
ICSME
2019
Neupane et al.
EmoD: An End-to-End Approach for Investigating Emotion Dynamics in Software Development
EmoD: An End-to-End Approach for Investigating Emotion Dynamics in Software Development
✔️
✔️
✔️
✔️
Tool Development
❌
EmoD
67
ICECA
2018
Kaur et al.
Emotion Mining and Sentiment Analysis in Software Engineering Domain
Emotion Mining and Sentiment Analysis in Software Engineering Domain
✔️
✔️
✔️
✔️
Tool Evaluation
✔️
68
ICT Express
2020
Cagnoni et al.
Emotion-Based Analysis of Programming Languages on Stack Overflow
Emotion-Based Analysis of Programming Languages on Stack Overflow
✔️
✔️
❌
✔️
Tool Development + Evaluation
❌
69
ASE
2019
Wang
Emotions Extracted from Text vs. True Emotions–An Empirical Evaluation in SE Context
Emotions Extracted from Text vs. True Emotions–An Empirical Evaluation in SE Context
✔️
✔️
✔️
✔️
Tool Evaluation
✔️
70
SEmotion
2019
Calefato et al.
EMTk – The Emotion Mining Toolkit
EMTk – The Emotion Mining Toolkit
✔️
✔️
❌
✔️
Tool Development + Evaluation
❌
EMTk
71
ICPC
2013
Zhang and Hou
Extracting Problematic API Features from Forum Discussions
Extracting Problematic API Features from Forum Discussions
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
72
AffectRE
2018
Werner et al.
How Angry Are Your Customers? Sentiment Analysis of Support Tickets that Escalate
How Angry Are Your Customers? Sentiment Analysis of Support Tickets that Escalate
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
73
IJSEA
2018
Mostafa and Abd Elghany
Investigating Game Developers' Guilt Emotions Using Sentiment Analysis
Investigating Game Developers' Guilt Emotions Using Sentiment Analysis
✔️
✔️
❌
✔️
Tool Application + Usage
❌
74
SAC
2019
Islam et al.
MarValous: Machine Learning Based Detection of Emotions in the Valence-Arousal Space in Software Engineering Text
MarValous: Machine Learning Based Detection of Emotions in the Valence-Arousal Space in Software Engineering Text
✔️
✔️
✔️
✔️
Tool Development + Evaluation
❌
MarValous
75
SEmotion
2018
Werder and Brinkkemper
MEME: Toward a Method for Emotions Extraction from GitHub
MEME: Toward a Method for Emotions Extraction from GitHub
✔️
✔️
✔️
✔️
Tool Development + Evaluation
❌
MEME
76
PROMISE
2018
Ortu et al.
Mining Communication Patterns in Software Development: A GitHub Analysis
Mining Communication Patterns in Software Development: A GitHub Analysis
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
77
EISEJ
2017
Goyal and Sardana
NRFixer: Sentiment Based Model for Predicting the Fixability of Non-Reproducible Bugs
NRFixer: Sentiment Based Model for Predicting the Fixability of Non-Reproducible Bugs
✔️
✔️
❌
✔️
Tool Application + Usage
❌
78
ESEM
2018
Claes et al.
On the Use of Emoticons in Open Source Software Development
On the Use of Emoticons in Open Source Software Development
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
79
ICSE
2019
Lin et al.
Pattern-Based Mining of Opinions in Q&A Websites
Pattern-Based Mining of Opinions in Q&A Websites
✔️
✔️
✔️
✔️
Tool Development + Evaluation
✔️
POME
80
MSR
2014
Pletea et al.
Security and Emotion: Sentiment Analysis of Security Discussions on GitHub
Security and Emotion: Sentiment Analysis of Security Discussions on GitHub
✔️
✔️
✔️
✔️
Tool Application + Usage
✔️
81
RESI
2014
Rousinopoulos et al.
Sentiment Analysis of Free/Open Source Developers: Preliminary Findings from a Case Study
Sentiment Analysis of Free/Open Source Developers: Preliminary Findings from a Case Study
✔️
✔️
❌
✔️
Tool Application + Usage
❌
82
CIC
2017
Patwardhan
Sentiment Identification for Collaborative, Geographically Dispersed, Cross-Functional Software Development Teams
Sentiment Identification for Collaborative, Geographically Dispersed, Cross-Functional Software Development Teams
✔️
✔️
✔️
✔️
Tool Application + Usage
✔️
83
PeerJ Computer Science
2016
Destefanis et al.
Software Development: Do Good Manners Matter?
Software Development: Do Good Manners Matter?
✔️
✔️
❌
✔️
Tool Application + Usage
❌
84
SEmotion
2018
Werder
The Evolution of Emotional Displays in Open Source Software Development Teams: An Individual Growth Curve Analysis
The Evolution of Emotional Displays in Open Source Software Development Teams: An Individual Growth Curve Analysis
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
85
CGC
2013
Garcia et al.
The Role of Emotions in Contributors Activity: A Case Study on the GENTOO Community
The Role of Emotions in Contributors Activity: A Case Study on the GENTOO Community
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
86
SERA
2016
Islam and Zibran
Towards Understanding and Exploiting Developers' Emotional Variations in Software Engineering
Towards Understanding and Exploiting Developers' Emotional Variations in Software Engineering
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
87
VISSOFT
2013
Guzman
Visualizing Emotions in Software Development Projects
Visualizing Emotions in Software Development Projects
✔️
✔️
✔️
✔️
Tool Application + Usage
❌
88
SANER
2020
Brisson et al.
We Are Family: Analyzing Communication in GitHub Software Repositories and Their Forks
We Are Family: Analyzing Communication in GitHub Software Repositories and Their Forks
✔️
✔️
❌
✔️
Tool Application + Usage
❌
89
ICSME
2020
Biswas et al.
Achieving Reliable Sentiment Analysis in the Software Engineering Domain Using BERT
Achieving Reliable Sentiment Analysis in the Software Engineering Domain Using BERT
❌
✔️
❌
✔️
Tool Development + Evaluation
✔️
BERT4SentiSE
90
EDM
2021
Mahbub et al.
Analysis of Factors Influencing User Contribution and Predicting Involvement of Users on Stack Overflow
Analysis of Factors Influencing User Contribution and Predicting Involvement of Users on Stack Overflow
❌
✔️
❌
✔️
Tool Application + Usage
❌
91
SEmotion
2021
Park and Sharif
Assessing Perceived Sentiment in Pull Requests with Emoji: Evidence from Tools and Developer Eye Movements
Assessing Perceived Sentiment in Pull Requests with Emoji: Evidence from Tools and Developer Eye Movements
❌
✔️
❌
✔️
Tool Evaluation
✔️
92
TSE
2021
Uddin and Khomh
Automatic Mining of Opinions Expressed About APIs in Stack Overflow
Automatic Mining of Opinions Expressed About APIs in Stack Overflow
❌
✔️
✔️
✔️
Tool Development + Evaluation
✔️
OpinerDSO
93
ICSS
2021
Wu et al.
BERT for Sentiment Classification in Software Engineering
BERT for Sentiment Classification in Software Engineering
❌
✔️
❌
✔️
Tool Development + Evaluation
❌
BERT-FT
94
KBS
2020
Cabrera-Diego et al.
Classifying Emotions in Stack Overflow and JIRA Using a Multi-Label Approach
Classifying Emotions in Stack Overflow and JIRA Using a Multi-Label Approach
❌
✔️
❌
✔️
Tool Evaluation
❌
95
TOSEM
2021
Chen et al.
Emoji-Powered Sentiment and Emotion Detection from Software Developers’ Communication Data
Emoji-Powered Sentiment and Emotion Detection from Software Developers’ Communication Data
❌
✔️
❌
✔️
Tool Evaluation
❌
96
REW
2021
Herrmann and Klünder
From Textual to Verbal Communication: Towards Applying Sentiment Analysis to a Software Project Meeting
From Textual to Verbal Communication: Towards Applying Sentiment Analysis to a Software Project Meeting
❌
✔️
❌
✔️
Tool Application + Usage
✔️
97
SEmotion
2021
Mansoor et al.
How Developers and Tools Categorize Sentiment in Stack Overflow Questions – A Pilot Study
How Developers and Tools Categorize Sentiment in Stack Overflow Questions – A Pilot Study
❌
✔️
❌
✔️
Tool Evaluation
✔️
98
PLOS ONE
2021
Sokolovsky et al.
Is It Feasible to Detect FLOSS Version Release Events from Textual Messages? A Case Study on Stack Overflow
Is It Feasible to Detect FLOSS Version Release Events from Textual Messages? A Case Study on Stack Overflow
❌
✔️
❌
✔️
Tool Application + Usage
❌
99
MSR
2016
Mäntylä et al.
Mining Valence, Arousal, and Dominance – Possibilities for Detecting Burnout and Productivity?
Mining Valence, Arousal, and Dominance – Possibilities for Detecting Burnout and Productivity?
❌
✔️
✔️
✔️
Tool Application + Usage
❌
100
HotStorage
2021
Zhang et al.
SentiLog: Anomaly Detecting on Parallel File Systems via Log-Based Sentiment Analysis
SentiLog: Anomaly Detecting on Parallel File Systems via Log-Based Sentiment Analysis
❌
✔️
❌
✔️
Tool Development
❌
SentiLog
101
CONISOFT
2020
Valdez et al.
Sentiment Analysis in Jira Software Repositories
Sentiment Analysis in Jira Software Repositories
❌
✔️
❌
✔️
Tool Application + Usage
❌
102
Mathematics
2021
Dao and Yang
Severity Prediction for Bug Reports Using Multi-Aspect Features: A Deep Learning Approach
Severity Prediction for Bug Reports Using Multi-Aspect Features: A Deep Learning Approach
❌
✔️
❌
✔️
Tool Application + Usage
❌
103
CHASE
2021
Sanei et al.
The Impacts of Sentiments and Tones in Community-Generated Issue Discussions
The Impacts of Sentiments and Tones in Community-Generated Issue Discussions
❌
✔️
❌
✔️
Tool Application + Usage
✔️
104
ICSE-NIER
2020
Madampe et al.
Towards Understanding Emotional Response to Requirements Changes in Agile Teams
Towards Understanding Emotional Response to Requirements Changes in Agile Teams
❌
✔️
✔️
✔️
Tool Application + Usage
❌
105
ICSE-SEIS
2021
Venigalla and Chimalakonda
Understanding Emotions of Developer Community Towards Software Documentation
Understanding Emotions of Developer Community Towards Software Documentation
❌
✔️
❌
✔️
Tool Application + Usage
❌
106
PLOS ONE
2019
Sapkota et al.
A Network-Centric Approach for Estimating Trust Between Open Source Software Developers
A Network-Centric Approach for Estimating Trust Between Open Source Software Developers
❌
❌
✔️
✔️
Tool Application + Usage
✔️
107
ASEW
2015
Serva et al.
Automatically Mining Negative Code Examples from Software Developer Q & A Forums
Automatically Mining Negative Code Examples from Software Developer Q & A Forums
❌
❌
✔️
✔️
Tool Development + Evaluation
✔️
108
IEEE Software
2019
Werner et al.
Can a Machine Learn Through Customer Sentiment?: A Cost-Aware Approach to Predict Support Ticket Escalations
Can a Machine Learn Through Customer Sentiment?: A Cost-Aware Approach to Predict Support Ticket Escalations
❌
❌
✔️
✔️
Tool Application + Usage
❌
109
IEEE Software
2019
Lanovaz and Adams
Comparing the Communication Tone and Responses of Users and Developers in Two R Mailing Lists: Measuring Positive and Negative Emails
Comparing the Communication Tone and Responses of Users and Developers in Two R Mailing Lists: Measuring Positive and Negative Emails
❌
❌
✔️
✔️
Tool Application + Usage
❌
110
ICEIS
2016
da Cruz et al.
Estimating Trust in Virtual Teams: A Framework Based on Sentiment Analysis
Estimating Trust in Virtual Teams: A Framework Based on Sentiment Analysis
❌
❌
✔️
✔️
Tool Application + Usage
❌
111
IST
2018
Licorish and MacDonell
Exploring the Links Between Software Development Task Type, Team Attitudes and Task Completion Performance: Insights from the Jazz Repository
Exploring the Links Between Software Development Task Type, Team Attitudes and Task Completion Performance: Insights from the Jazz Repository
❌
❌
✔️
✔️
Tool Application + Usage
❌
112
ESSoS
2017
Munaiah et al.
Natural Language Insights from Code Reviews that Missed a Vulnerability
Natural Language Insights from Code Reviews that Missed a Vulnerability
❌
❌
✔️
✔️
Tool Application + Usage
❌
113
SCAM
2015
Rahman et al.
Recommending Insightful Comments for Source Code Using Crowdsourced Knowledge
Recommending Insightful Comments for Source Code Using Crowdsourced Knowledge
❌
❌
✔️
✔️
Tool Application + Usage
❌
114
ACIS
2014
Licorish and MacDonell
Relating IS Developers' Attitudes to Engagement
Relating IS Developers' Attitudes to Engagement
❌
❌
✔️
✔️
Tool Application + Usage
❌
115
OpenSym
2019
Ferreira et al.
Sentiment Analysis of Open Source Communities: An Exploratory Study
Sentiment Analysis of Open Source Communities: An Exploratory Study
❌
❌
✔️
✔️
Tool Application + Usage
❌
116
OpenSym
2019
Alesinloye et al.
Sentiment Analysis of Open Source Software Community Mailing List: A Preliminary Analysis
Sentiment Analysis of Open Source Software Community Mailing List: A Preliminary Analysis
❌
❌
✔️
✔️
Tool Application + Usage
❌
117
Information Systems
2019
Morales-Ramirez et al.
Speech-Acts Based Analysis for Requirements Discovery from Online Discussions
Speech-Acts Based Analysis for Requirements Discovery from Online Discussions
❌
❌
✔️
✔️
Tool Application + Usage
❌
118
SANER
2016
Tourani and Adams
The Impact of Human Discussions on Just-in-Time Quality Assurance: An Empirical Study on OpenStack and Eclipse
The Impact of Human Discussions on Just-in-Time Quality Assurance: An Empirical Study on OpenStack and Eclipse
❌
❌
✔️
✔️
Tool Application + Usage
❌
119
AffectRE
2018
Portugal and do Prado Leite
Usability Related Qualities Through Sentiment Analysis
Usability Related Qualities Through Sentiment Analysis
❌
❌
✔️
✔️
Tool Application + Usage
❌
120
I3E
2019
Ferreira et al.
Winning of Hearts and Minds: Integrating Sentiment Analytics into the Analysis of Contradictions
Winning of Hearts and Minds: Integrating Sentiment Analytics into the Analysis of Contradictions
❌
❌
✔️
✔️
Tool Application + Usage
❌
121
IEEE Access
2019
Ramay et al.
Deep Neural Network-Based Severity Prediction of Bug Reports
Deep Neural Network-Based Severity Prediction of Bug Reports
❌
❌
❌
✔️
Tool Application + Usage
❌
122
SAC
2017
Yang et al.
Analyzing Emotion Words to Predict Severity of Software Bugs: A Case Study of Open Source Projects
Analyzing Emotion Words to Predict Severity of Software Bugs: A Case Study of Open Source Projects
❌
❌
❌
✔️
Tool Application + Usage
❌
123
Trans. Info. Syst.
2018
Yang et al.
An Emotion Similarity Based Severity Prediction of Software Bugs: A Case Study of Open Source Projects
An Emotion Similarity Based Severity Prediction of Software Bugs: A Case Study of Open Source Projects
❌
❌
❌
✔️
Tool Application + Usage
❌
124
SANER
2018
Ahasanuzzaman et al.
Classifying Stack Overflow Posts on API Issues
Classifying Stack Overflow Posts on API Issues
❌
❌
❌
✔️
Tool Application + Usage
❌
125
HCSE
2020
Klünder et al.
Identifying the Mood of a Software Development Team by Analyzing Text-Based Communication in Chats with Machine Learning
Identifying the Mood of a Software Development Team by Analyzing Text-Based Communication in Chats with Machine Learning
❌
❌
❌
✔️
Tool Development + Evaluation
✔️
126
JSS
2022
Herrmann et al.
On the Subjectivity of Emotions in Software Projects: How Reliable Are Pre-labled Data Sets for Sentiment Analysis?
On the Subjectivity of Emotions in Software Projects: How Reliable Are Pre-labled Data Sets for Sentiment Analysis?
❌
❌
❌
✔️
Tool Development + Evaluation
✔️
127
ICSE-SEIS
2022
Graßl and Fraser
Scratch as Social Network: Topic Modeling and Sentiment Analysis in Scratch Projects
Scratch as Social Network: Topic Modeling and Sentiment Analysis in Scratch Projects
❌
❌
❌
✔️
Tool Application + Usage
✔️
128
TOSEM
2022
Uddin et al.
An Empirical Study of the Effectiveness of an Ensemble of Stand-Alone Sentiment Detection Tools for Software Engineering Datasets
An Empirical Study of the Effectiveness of an Ensemble of Stand-Alone Sentiment Detection Tools for Software Engineering Datasets
❌
❌
❌
✔️
Tool Development + Evaluation
❌
Sentisead
129
Journal of Software: Evolution and Process
2023
Almarimi et al.
Improving the Detection of Community Smells Through Socio-Technical and Sentiment Analysis
Improving the Detection of Community Smells Through Socio-Technical and Sentiment Analysis
❌
❌
❌
✔️
Tool Application + Usage
❌
130
ICPC
2021
Huang et al.
Predicting Community Smells' Occurrence on Individual Developers' Emotions and Progress
Predicting Community Smells' Occurrence on Individual Developers' Emotions and Progress
❌
❌
❌
✔️
Tool Application + Usage
❌
131
ICNGIoT
2022
Patnaik and Padhy
Sentiment Analysis of Software Project Code Commits
Sentiment Analysis of Software Project Code Commits
❌
❌
❌
✔️
Tool Application + Usage
❌
132
PROFES
2022
Obaidi et al.
On the Limitations of Combining Sentiment Analysis Tools in a Cross-Platform Setting
On the Limitations of Combining Sentiment Analysis Tools in a Cross-Platform Setting
❌
❌
❌
✔️
Tool Development + Evaluation
❌
133
JSS
2023
Swillus and Zaidman
Sentiment Overflow in the Testing Stack: Analysing Software Testing Posts on Stack Overflow
Sentiment Overflow in the Testing Stack: Analysing Software Testing Posts on Stack Overflow
❌
❌
❌
✔️
Tool Application + Usage
❌
134
ESEM
2023
Sarker et al.
ToxiSpanSE: An Explainable Toxicity Detection in Code Review Comments
ToxiSpanSE: An Explainable Toxicity Detection in Code Review Comments
❌
❌
❌
✔️
Tool Development + Evaluation
✔️
ToxiSpanSE
135
HICSS
2020
Sengupta and Haythornthwaite
Learning with Comments: An Analysis of Comments and Communityon Stack Overflow
Learning with Comments: An Analysis of Comments and Communityon Stack Overflow
❌
❌
❌
✔️
Tool Application + Usage (human only)
✔️
136
ICSESS
2022
Gao et al.
Understanding the Impact of Bots on Developers Sentiment and Project Progress
Understanding the Impact of Bots on Developers Sentiment and Project Progress
❌
❌
❌
✔️
Tool Application + Usage
❌
137
ASE
2022
Imran et al.
Data Augmentation for Improving Emotion Recognition in Software Engineering Communication
Data Augmentation for Improving Emotion Recognition in Software Engineering Communication
❌
❌
❌
✔️
Tool Evaluation
✔️
138
TSE
2022
Prenner and Robbes
Making the Most of Small Software Engineering Datasets With Modern Machine Learning
Making the Most of Small Software Engineering Datasets With Modern Machine Learning
❌
❌
❌
✔️
Tool Development + Evaluation
❌
StackOBERTflow
139
ICSE
2019
Sarker et al.
Socio-Technical Work-Rate Increase Associates With Changes in Work Patterns in Online Projects
Socio-Technical Work-Rate Increase Associates With Changes in Work Patterns in Online Projects
❌
❌
❌
✔️
Tool Application + Usage
❌
140
XP
2016
Ortu et al.
Arsonists or Firefighters? Affectiveness in Agile Software Development
Arsonists or Firefighters? Affectiveness in Agile Software Development
❌
❌
✔️
✔️
Tool Application + Usage
❌
141
MSR
2021
Fucci et al.
Waiting Around or Job Half-Done? Sentiment in Self-Admitted Technical Debt
Waiting Around or Job Half-Done? Sentiment in Self-Admitted Technical Debt
❌
❌
❌
✔️
Tool Evaluation
✔️
142
ICSE
2019
Imtiaz et al.
Investigating the Effects of Gender Bias on GitHub
Investigating the Effects of Gender Bias on GitHub
❌
❌
❌
✔️
Tool Application + Usage
❌
143
ICITA
2022
Kadhar and Kumar
Deep-Learning Approach for Sentiment Analysis in Software Engineering Domain
Deep-Learning Approach for Sentiment Analysis in Software Engineering Domain
❌
❌
❌
✔️
Tool Development + Evaluation
❌
144
Internetware
2022
Sun et al.
Incorporating Pre-trained Transformer Models into TextCNN for Sentiment Analysis on Software Engineering Texts
Incorporating Pre-trained Transformer Models into TextCNN for Sentiment Analysis on Software Engineering Texts
❌
❌
❌
✔️
Tool Development + Evaluation
❌
EASTER
145
ICCSAW
2022
Mula et al.
Software Sentiment Analysis Using Machine Learning with Different Word-Embeddings
Software Sentiment Analysis Using Machine Learning with Different Word-Embeddings
❌
❌
❌
✔️
Tool Development + Evaluation
❌
146
ICACI
2022
Kumar et al.
Sentiment Analysis of Developers' Comments on GitHub Repository: A Study
Sentiment Analysis of Developers' Comments on GitHub Repository: A Study
❌
❌
❌
✔️
Tool Application + Usage
❌
147
IST
2022
Rong et al.
An Empirical Study of Emoji Use in Software Development Communication
An Empirical Study of Emoji Use in Software Development Communication
❌
❌
❌
✔️
Tool Application + Usage
✔️
148
TSE
2023
von der Mosel et al.
On the Validity of Pre-trained Transformers for Natural Language Processing in the Software Engineering Domain
On the Validity of Pre-trained Transformers for Natural Language Processing in the Software Engineering Domain
❌
❌
❌
✔️
Tool Development + Evaluation
❌
seBERT
149
EMSE
2023
Assavakamhaenghan et al.
Does the first Response Matter for Future Contributions? A Study of First Contributions
Does the first Response Matter for Future Contributions? A Study of First Contributions
❌
❌
❌
✔️
Tool Application + Usage
❌
150
TOSEM
2021
Uddin et al.
Automatic API Usage Scenario Documentation from Technical Q&A Sites
Automatic API Usage Scenario Documentation from Technical Q&A Sites
❌
❌
❌
✔️
Tool Application + Usage
❌
151
IST
2020
Uddin et al.
Mining API Usage Scenarios from StackOverflow
Mining API Usage Scenarios from StackOverflow
❌
❌
✔️
✔️
Tool Application + Usage
❌
152
EMSE
2022
Uddin et al.
A Qualitative Study of Developers' Discussions of Their Problems and Joys During Early COVID-19 Months
A Qualitative Study of Developers' Discussions of Their Problems and Joys During Early COVID-19 Months
❌
❌
❌
✔️
Tool Application + Usage (human only)
✔️
153
IST
2019
El Asri et al.
An Empirical Study of Sentiments in Code Reviews
An Empirical Study of Sentiments in Code Reviews
❌
❌
✔️
✔️
Tool Application + Usage
✔️
154
IEEE Software
2019
Maipradit et al.
Sentiment Classification Using N-Gram Inverse Document Frequency and Automated Machine Learning
Sentiment Classification Using N-Gram Inverse Document Frequency and Automated Machine Learning
❌
❌
✔️
✔️
Tool Development + Evaluation
❌
155
HCSE
2022
Schroth et al.
On the Potentials of Realtime Sentiment Analysis on Text-Based Communication in Software Projects
On the Potentials of Realtime Sentiment Analysis on Text-Based Communication in Software Projects
❌
❌
❌
✔️
Tool Application + Usage
❌
156
EISEJ
2022
Kaur et al.
Analysis of Factors Influencing Developers' Sentiments in Commit Logs: Insights from Applying Sentiment Analysis
Analysis of Factors Influencing Developers' Sentiments in Commit Logs: Insights from Applying Sentiment Analysis
❌
❌
❌
✔️
Tool Application + Usage
❌
157
SANER
2019
Paul et al.
Expressions of Sentiments During Code Reviews: Male vs. Female
Expressions of Sentiments During Code Reviews: Male vs. Female
❌
❌
❌
✔️
Tool Application + Usage
❌
158
Big Data
2022
Bleyl and Buxton
Emotion Recognition on StackOverflow Posts Using BERT
Emotion Recognition on StackOverflow Posts Using BERT
❌
❌
❌
✔️
Tool Development + Evaluation
❌
159
APSEC
2017
Singh and Singh
How Do Code Refactoring Activities Impact Software Developers' Sentiments? – An Empirical Investigation into GitHub Commits
How Do Code Refactoring Activities Impact Software Developers' Sentiments? – An Empirical Investigation into GitHub Commits
❌
❌
✔️
✔️
Tool Application + Usage
❌
160
ICAT
2022
Sayago-Heredia et al.
A Datset for Analysis of Quality Code and Toxic Comments
A Datset for Analysis of Quality Code and Toxic Comments
❌
❌
❌
✔️
Tool Application + Usage
❌
161
XP
2015
Ortu et al.
Would You Mind Fixing This Issue? An Empirical Analysis of Politeness and Attractiveness in Software Developed Using Agile Boards
Would You Mind Fixing This Issue? An Empirical Analysis of Politeness and Attractiveness in Software Developed Using Agile Boards
❌
❌
❌
✔️
Tool Application + Usage
❌
162
APSEC
2019
Huq et al.
Understanding the Effect of Developer Sentiment on Fix-Inducing Changes: An Exploratory Study on GitHub Pull Requests
Understanding the Effect of Developer Sentiment on Fix-Inducing Changes: An Exploratory Study on GitHub Pull Requests
❌
❌
✔️
✔️
Tool Application + Usage
❌
163
SEmotion
2018
Destefanis et al.
On Measuring Affects of GitHub Issues' Commenters
On Measuring Affects of GitHub Issues' Commenters
❌
❌
✔️
✔️
Tool Application + Usage
❌
164
SEmotion
2019
Ortu et al.
Empirical Analysis of Affect of Merged Issues on GitHub
Empirical Analysis of Affect of Merged Issues on GitHub
❌
❌
✔️
✔️
Tool Application + Usage
❌
165
APSECW
2017
Yang et al.
Sentiments Analysis in GitHub Repositories: An Empirical Study
Sentiments Analysis in GitHub Repositories: An Empirical Study
❌
❌
✔️
✔️
Tool Application + Usage
❌
166
ICSE
2021
Chatterjee et al.
Automatic Extraction of Opinion-Based Q&A from Online Developer Chats
Automatic Extraction of Opinion-Based Q&A from Online Developer Chats
❌
❌
❌
✔️
Tool Application + Usage
❌
167
EMSE
2022
Cassee et al.
Self-Admitted Technical Debt and Comments' Polarity: An Empirical Study
Self-Admitted Technical Debt and Comments' Polarity: An Empirical Study
❌
❌
❌
✔️
Tool Evaluation
✔️
168
DTGS
2019
Skriptsova et al.
Analysis of Newcomers Activity in Communicative Posts on GitHub
Analysis of Newcomers Activity in Communicative Posts on GitHub
❌
❌
✔️
✔️
Tool Application + Usage
❌
169
SANER
2021
Chouchen et al.
Anti-Patterns in Modern Code Review: Symptoms and Prevalence
Anti-Patterns in Modern Code Review: Symptoms and Prevalence
❌
❌
❌
✔️
Tool Application + Usage (human only)
✔️
170
ESEC/FSE
2022
Robe et al.
Pair Programming Conversations with Agents vs. Developers: Challenges and Opportunities for SE Community
Pair Programming Conversations with Agents vs. Developers: Challenges and Opportunities for SE Community
❌
❌
❌
✔️
Tool Application + Usage (human only - but suggest tools)
✔️
171
TOSEM
2023
Batoun et al.
An Empirical Study on GitHub Pull Requests' Reactions
An Empirical Study on GitHub Pull Requests' Reactions
❌
❌
❌
✔️
Tool Application + Usage (human only)
✔️
172
SEKE
2020
Li et al.
Sentiment Analysis over Collaborative Relationships in Open Source Software Projects
Sentiment Analysis over Collaborative Relationships in Open Source Software Projects
❌
❌
❌
✔️
Tool Application + Usage
❌
173
DEXA
2021
Batra et al.
BERT-Based Sentiment Analysis: A Software Engineering Perspective
BERT-Based Sentiment Analysis: A Software Engineering Perspective
❌
❌
❌
✔️
Tool Evaluation
❌
174
APSEC
2021
Li et al.
Monitoring Negative Sentiment-Related Events in Open Source Software Projects
Monitoring Negative Sentiment-Related Events in Open Source Software Projects
❌
❌
❌
✔️
Tool Application + Usage
❌
175
ICSE
2023
Yin et al.
On the Self-Governance and Episodic Changes in Apache Incubator Projects: An Empirical Study
On the Self-Governance and Episodic Changes in Apache Incubator Projects: An Empirical Study
❌
❌
❌
✔️
Tool Application + Usage
❌
176
EMSE
2023
Wang et al.
More Than React: Investigating the Role of Emoji Reaction in GitHub Pull Requests
More Than React: Investigating the Role of Emoji Reaction in GitHub Pull Requests
❌
❌
❌
✔️
Tool Application + Usage
❌
177
JSS
2024
Ferreira et al.
Incivility Detection in Open Source Code Review and Issue Discussions
Incivility Detection in Open Source Code Review and Issue Discussions
❌
❌
❌
✔️
Tool Evaluation
❌