Unsupervised methods for Software Defect Prediction

Duy An Ha*, Ting Hsuan Chen, Shyan-Ming Yuan

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Software Defect Prediction (SDP) aims to assess software quality by using machine learning techniques. Recently, by proposing the connectivity-based unsupervised learning method, Zhang et al. have been proven that unsupervised classification has great potential to apply to this problem. Inspiring by this idea, in our work we try to replicate the results of Zhang et al.'s experiment and attempt to improve the performance by examining different techniques at each step of the approach using unsupervised learning methods to solve the SDP problem. Specifically, we try to follow the steps of the experiment described in their work strictly and examine three other clustering methods with four other ways for feature selection besides using all. To the best of our knowledge, these methods are first applied in SDP to evaluate their predictive power. For replicating the results, generally results in our experiments are not as good as the previous work. It may be due to we do not know which features are used in their experiment exactly. Fluid clustering and spectral clustering give better results than Newman clustering and CNM clustering in our experiments. Additionally, the experiments also show that using Kernel Principal Component Analysis (KPCA) or Non-Negative Matrix Factorization (NMF) for feature selection step gives better performance than using all features in the case of unlabeled data. Lastly, to make replicating our work easy, a lightweight framework is created and released on Github.

Original languageEnglish
Title of host publicationProceedings of the 10th International Symposium on Information and Communication Technology, SoICT 2019
PublisherAssociation for Computing Machinery
Pages49-55
Number of pages7
ISBN (Electronic)9781450372459
DOIs
StatePublished - 4 Dec 2019
Event10th International Symposium on Information and Communication Technology, SoICT 2019 - Ha Noi and Ha Long, Viet Nam
Duration: 4 Dec 20196 Dec 2019

Publication series

NameACM International Conference Proceeding Series

Conference

Conference10th International Symposium on Information and Communication Technology, SoICT 2019
CountryViet Nam
CityHa Noi and Ha Long
Period4/12/196/12/19

Keywords

  • Community structure detection
  • Machine learning
  • Software Defect Prediction
  • Software engineering
  • Unsupervised learning

Fingerprint Dive into the research topics of 'Unsupervised methods for Software Defect Prediction'. Together they form a unique fingerprint.

Cite this