User-oriented Assessment of Classification Model Understandability

Document type: Conference Papers
Peer reviewed: Yes
Full text:
Author(s): Hiva Allahyari, Niklas Lavesson
Title: User-oriented Assessment of Classification Model Understandability
Conference name: 11th Scandinavian Conference on Artificial Intelligence
Year: 2011
Pagination: 11-19
ISBN: 978-1-60750-753-6
Publisher: IOS Press
City: Trondheim
Organization: Blekinge Institute of Technology
Department: School of Computing (Sektionen för datavetenskap och kommunikation)
School of Computing S-371 79 Karlskrona
+46 455 38 50 00
Authors e-mail:
Language: English
Abstract: This paper reviews methods for evaluating and analyzing the understandability of classification models in the context of data mining. The motivation for this study is the fact that the majority of previous work has focused on increasing the accuracy of models, ignoring user-oriented properties such as comprehensibility and understandability. Approaches for analyzing the understandability of data mining models have been discussed on two different levels: one is regarding the type of the models’ presentation and the other is considering the structure of the models. In this study, we present a summary of existing assumptions regarding both approaches followed by an empirical work to examine the understandability from the user’s point of view through a survey. The results indicate that decision tree models are more understandable than rule-based models. Using the survey results regarding understandability of a number of models in conjunction with quantitative measurements of the complexity of the models, we are able to establish correlation between complexity and understandability of the models.
Subject: Computer Science\Artificial Intelligence
Computer Science\General
Human Work Science\Human Computer Interaction
Keywords: Classification, Understandability, Evaluation