Pattern-based Mining of Opinions in Q&A WebsitesTechnical Track
Informal documentation contained in resources such as Q&A websites (e.g., Stack Overflow) is a precious resource for developers, who can find there examples on how to use certain libraries, as well as opinions about pros and cons of such libraries. Automatically identifying and classifying such opinions can alleviate developers’ burden in performing manual searches, and can be used to recommend libraries that are good from some points of view (e.g., performance), or highlight those less ideal from other perspectives (e.g., compatibility). We propose POME (Pattern-based Opinion MinEr), an approach that leverages natural language parsing and pattern-matching to classify Stack Overflow sentences referring to libraries according to seven aspects (e.g., performance, usability), and to determine their polarity (positive vs negative). The patterns have been inferred by manually analyzing 4,363 sentences from Stack Overflow linked to a total of 30 libraries. We evaluated POME by (i) comparing the pattern-matching approach with machine learners leveraging the patterns themselves as well as n-grams extracted from Stack Overflow posts; (ii) assessing the ability of POME to detect the polarity of sentences, as compared to sentiment-analysis tools; (iii) comparing POME with the state-of-the-art Stack Overflow opinion mining approach, Opiner, through a study involving 24 human evaluators. Our study shows that POME exhibits a higher precision than a state-of-the-art technique (Opiner), in terms of both opinion aspect identification and polarity assessment.
Thu 30 MayDisplayed time zone: Eastern Time (US & Canada) change
14:00 - 15:30 | Crowdsourced Knowledge and FeedbackJournal-First Papers / Technical Track / Software Engineering in Practice / Papers at St-Paul / Ste-Catherine Chair(s): Xin Xia Monash University | ||
14:00 20mTalk | Emerging App Issue Identification from User Feedback: Experience on WeChatSEIPIndustry Program Software Engineering in Practice Cuiyun Gao The Chinese University of Hong Kong, Wujie Zheng Tencent, Inc., Yuetang Deng Tencent, Inc., David Lo Singapore Management University, Jichuan Zeng , Michael Lyu , Irwin King | ||
14:20 10mTalk | An Empirical Study of Game Reviews on the Steam PlatformIndustry ProgramJournal-First Journal-First Papers Dayi Lin Queen's University, Cor-Paul Bezemer University of Alberta, Canada, Ying Zou Queen's University, Kingston, Ontario, Ahmed E. Hassan Queen's University | ||
14:30 20mTalk | How Reliable is the Crowdsourced Knowledge of Security Implementation?Technical Track Technical Track Mengsu Chen Virginia Tech, Felix Fischer Technical University of Munich, Na Meng Virginia Tech, Xiaoyin Wang University of Texas at San Antonio, USA, Jens Grossklags Technical University of Munich | ||
14:50 20mTalk | Pattern-based Mining of Opinions in Q&A WebsitesTechnical Track Technical Track Bin Lin Università della Svizzera italiana (USI), Fiorella Zampetti University of Sannio, Gabriele Bavota Università della Svizzera italiana (USI), Massimiliano Di Penta University of Sannio, Michele Lanza Universita della Svizzera italiana (USI) | ||
15:10 10mTalk | How Do Users Revise Answers on Technical Q&A Websites? A Case Study on Stack OverflowIndustry ProgramJournal-First Journal-First Papers Shaowei Wang Queen's University, Tse-Hsun (Peter) Chen Concordia University, Ahmed E. Hassan Queen's University | ||
15:20 10mTalk | Discussion Period Papers |