Towards Deep Machine Reasoning: a Prototype-based Deep Neural Network with Decision Tree Inference

By Plamen Parvanov Angelov, Eduardo Almeida Soares. 2020

16 citations recorded by the source corpus.

In this paper we introduce the DMR – a prototype-based method and network architecture for deep learning which is using a decision tree (DT)- based inference and synthetic data to balance the classes. It builds upon the recently introduced xDNN method addressing more complex multi-class problems, specifically when classes are highly imbalanced. DMR moves away from a direct decision based on all classes towards a layered DT of pair-wise class comparisons. In addition, it forces the prototypes to be balanced between classes regardless of possible class imbalances of the training data. It has two novel mechanisms, namely i) using a DT to determine the winning class label, and ii) balancing the classes by synthesizing data around the prototypes determined from the available training data. As a result, we improved significantly the performance of the resulting fully explainable DNN as evidenced on the well know benchmark problem Caltech-101. Furthermore, we also achieved high results in terms of accuracy for the well known Caltech-256 dataset, as well as surpassed the results of other approaches on Faces-1999 problem. In summary, we propose a new approach specifically advantageous for imbalanced multi-class problems on well known hard benchmark datasets. Moreover, DMR offers full explainability, does not require GPUs and can continue to learn from new data by adding new prototypes preserving the previous ones but not requiring full retraining.

Subfields: Artificial Intelligence

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Christin Seifert
  2. Meike Nauta
  3. Ron van Bree

Citations in the corpus