The challenge is now over. But it remains open for post-challenge submissions!
Submitted by reference
A combination of reference models, selected via 100-fold validation (which provides a good unbiased estimator of performance).
ADA - xent quadratic lssvm : BER = 0.187897
GINA - xent cubic lssvm : BER = 0.052681
HIVA - press quadratic lssvm : BER = 0.244383
NOVA - xent linear lssvm : BER = 0.048260
SYLVA - serate quadratic lssvm : BER = 0.007641
N.B. sadly "the good" are unlikely to win this time because the models including ARD kernels were not included - they just take too long to perform the validation :-( It will be interesting to see how the HIVA, NOVA and SYLVA selections compare though. My vote goes with "the ugly"!
|Dataset||Balanced Error||Area Under Curve|