User-oriented Assessment of Classification Model Understandability
| Document type: | Conference Papers |
|---|---|
| Peer reviewed: | Yes |
| Full text: | |
| Author(s): | Hiva Allahyari, Niklas Lavesson |
| Title: | User-oriented Assessment of Classification Model Understandability |
| Conference name: | 11th Scandinavian Conference on Artificial Intelligence |
| Year: | 2011 |
| Pagination: | 11-19 |
| ISBN: | 978-1-60750-753-6 |
| Publisher: | IOS Press |
| City: | Trondheim |
| Organization: | Blekinge Institute of Technology |
| Department: | School of Computing (Sektionen för datavetenskap och kommunikation) School of Computing S-371 79 Karlskrona +46 455 38 50 00 http://www.bth.se/com |
| Authors e-mail: | Niklas.Lavesson@bth.se |
| Language: | English |
| Abstract: | This paper reviews methods for evaluating and analyzing the understandability of classification models in the context of data mining. The motivation for this study is the fact that the majority of previous work has focused on increasing the accuracy of models, ignoring user-oriented properties such as comprehensibility and understandability. Approaches for analyzing the understandability of data mining models have been discussed on two different levels: one is regarding the type of the models’ presentation and the other is considering the structure of the models. In this study, we present a summary of existing assumptions regarding both approaches followed by an empirical work to examine the understandability from the user’s point of view through a survey. The results indicate that decision tree models are more understandable than rule-based models. Using the survey results regarding understandability of a number of models in conjunction with quantitative measurements of the complexity of the models, we are able to establish correlation between complexity and understandability of the models. |
| Subject: | Computer Science\Artificial Intelligence Computer Science\General Human Work Science\Human Computer Interaction |
| Keywords: | Classification, Understandability, Evaluation |
