PASCAL Agnostic Learning
vs.
Prior Knowledge
IJCNN07

The challenge is now over. But it remains open for post-challenge submissions!


IMPORTANT: Entries made since February 1st 2007 might be using validation data, now available for training.

liknon feature selection + state of the art (2)

Submitted by Erinija

An ensemble of linear discriminants is identified by splitting the training data n times into training and monitoring. The liknon is solved with increasing values of regularization parameter, the best model of the individual split is selected based on minimum monitoring error. The weights of the discriminants identify useful features. Other rules were trained on the selected feature subsets. Only for Gina Knn3 otperformed the ensemble.

These are correct for current submission (2)
gina6 hiva7 ada4 sylva10 nova2
predicted number of misclassifications: 1450, 9228, 6635, 2094, 947,

Correction for previous submission (1):
gina1 hiva2 ada1 sylva5 nova7
predicted number of misclassifications: 1640, 10189, 7050, 1832, 1052,

Dataset Balanced Error Area Under Curve  
Train Valid Test Train Valid Test
ada 0.1853 0.1963 0.1819 0.8699 0.8517 0.8714 agnostic
gina 0.0296 0.0254 0.054 0.9969 0.9892 0.9741 agnostic
hiva 0.1661 0.195 0.3131 0.9102 0.9087 0.7517 agnostic
nova 0.0366 0.032 0.0743 0.9934 0.9986 0.9694 agnostic
sylva 0.0186 0.0164 0.019 0.9947 0.9962 0.9949 agnostic
Overall 0.0872 0.093 0.1285 0.953 0.9489 0.9123 agnostic

This entry is a complete agnostic learning entry.