Applying the FAHP to Improve the Performance Evaluation Reliability of Software Defect Classifiers

16Citations
Citations of this article
51Readers
Mendeley users who have this article in their library.

This article is free to access.

Abstract

Today's software complexity makes developing defect-free software almost impossible. Consequently, developing classifiers to classify software modules into defective and non-defective before software releases have attracted great interest in academia and software industry alike. Although many classifiers have been proposed, no one has been proven superior over others. The major reason is that while a research shows that classifier A is better than classifier B, we can find other research that shows the opposite. These conflicts are usually triggered when researchers report results using their preferable performance evaluation measures such as, recall and precision. Although this approach is valid, it does not examine all possible facets of classifiers performance characteristics. Thus, the performance evaluation might improve or deteriorate if researchers choose other performance measures. As a result, software developers usually struggle to select the most suitable classifier to use in their projects. The goal of this paper is to apply the fuzzy analytical hierarchy process (FAHP) as a popular multicriteria decision-making technique to reliably evaluate classifiers' performance. This evaluation framework incorporates a wider spectrum of performance measures to evaluate classifiers performance rather than relying on selected preferable measures. The results show that this approach will increase software developers' confidence in research outcomes and help them in avoiding false conclusions and infer reasonable boundaries for them. We exploited 22 popular performance measures and 11 software defect classifiers. The analysis was carried out using KNIME data mining platform and 12 software defect data sets provided by the NASA metrics data program (MDP) repository.

References Powered by Scopus

Fuzzy sets

71627Citations
N/AReaders
Get full text

Fuzzy hierarchical analysis

2777Citations
N/AReaders
Get full text

A fuzzy extension of Saaty's priority theory

2623Citations
N/AReaders
Get full text

Cited by Powered by Scopus

A Risk Analysis Based on a Two-Stage Model of Fuzzy AHP-DEA for Multimodal Freight Transportation Systems

34Citations
N/AReaders
Get full text

Structural transformation of fuzzy analytical hierarchy process: a relevant case for Covid-19

23Citations
N/AReaders
Get full text

Systematic Mapping: Artificial Intelligence Techniques in Software Engineering

19Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Ghunaim, H., & Dichter, J. (2019). Applying the FAHP to Improve the Performance Evaluation Reliability of Software Defect Classifiers. IEEE Access, 7, 62794–62804. https://doi.org/10.1109/ACCESS.2019.2915964

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 12

67%

Professor / Associate Prof. 3

17%

Researcher 2

11%

Lecturer / Post doc 1

6%

Readers' Discipline

Tooltip

Computer Science 11

48%

Engineering 10

43%

Materials Science 1

4%

Pharmacology, Toxicology and Pharmaceut... 1

4%

Save time finding and organizing research with Mendeley

Sign up for free