PASCAL Agnostic Learning
vs.
Prior Knowledge
IJCNN07

The challenge is now over. But it remains open for post-challenge submissions!


IMPORTANT: Entries made since February 1st 2007 might be using validation data, now available for training.

liknon feature selection + state of art (1)

Submitted by Erinija

An ensemble of linear discriminants is identified by splitting the training data n times into training and monitoring. The liknon is solved with increasing values of regularization parameter, the best model of the individual split is selected based on minimum monitoring error. The weights of the discriminants identify useful features. Other rules were trained on the selected feature subsets. Only for Gina Knn3 otperformed the ensemble.

gina6 hiva7 ada4 sylva10 nova2
predicted number of misclassifications: 1450, 9228, 6635, 2094, 947,

Dataset Balanced Error Area Under Curve  
Train Valid Test Train Valid Test
ada 0.1801 0.2012 0.1818 0.8692 0.8503 0.8702 agnostic
gina 0.0328 0.032 0.0583 0.9965 0.9796 0.9703 agnostic
hiva 0.1837 0.1593 0.2998 0.9029 0.9075 0.7625 agnostic
nova 0.033 0.038 0.0753 0.9926 0.9989 0.9681 agnostic
sylva 0.0183 0.0106 0.0197 0.9959 0.9973 0.9953 agnostic
Overall 0.0896 0.0882 0.127 0.9514 0.9467 0.9133 agnostic

This entry is a complete agnostic learning entry.