A Replicated Study on Duplicate Detection: Using Apache Lucene to Search Among Android Defects

Summary, in English

Context: Duplicate detection is a fundamental part of issue management. Systems able to predict whether a new defect report will be closed as a duplicate, may decrease costs by limiting rework and collecting related pieces of information. Goal: Our work explores using Apache Lucene for large-scale duplicate detection based on textual content. Also, we evaluate the previous claim that results are improved if the title is weighted as more important than the description. Method: We conduct a conceptual replication of a well-cited study conducted at Sony Ericsson, using Lucene for searching in the public Android defect repository. In line with the original study, we explore how varying the weighting of the title and the description affects the accuracy. Results: We show that Lucene obtains the best results when the defect report title is weighted three times higher than the description, a bigger difference than has been previously acknowledged. Conclusions: Our work shows the potential of using Lucene as a scalable solution for duplicate detection.

• Author: Markus Borg; Per Runeson; Jens Johansson; Mika Mäntylä
• Department/s: Department of Computer Science; Software Engineering Research Group; ELLIIT: the Linköping-Lund initiative on IT and mobile communication
• Publishing year: 2014
• Language: English
• Publication/Series: [Host publication title missing]
• Full text: - 248 kB; - 225 kB; Download statistics
• Links: http://dx.doi.org/10.1145/2652524.2652556
• Document type: Conference paper
• Topic: Computer Science
• Keywords: software evolution; issue management; information retrieval; replication
• Conference name: 8th International Symposium on Empirical Software Engineering and Measurement
• Conference date: 2014-09-18
• Conference place: Turin, Italy
• Status: Published
• Project: Embedded Applications Software Engineering; Embedded Applications Software Engineering