AUC optimization and the two-sample problem - Télécom Paris Accéder directement au contenu
Proceedings/Recueil Des Communications Année : 2009

AUC optimization and the two-sample problem

Résumé

The purpose of the paper is to explore the connection between multivariate ho-mogeneity tests and AUC optimization. The latter problem has recently received much attention in the statistical learning literature. From the elementary observation that, in the two-sample problem setup, the null assumption corresponds to the situation where the area under the optimal ROC curve is equal to 1/2, we propose a two-stage testing method based on data splitting. A nearly optimal scoring function in the AUC sense is first learnt from one of the two half-samples. Data from the remaining half-sample are then projected onto the real line and eventually ranked according to the scoring function computed at the first stage. The last step amounts to performing a standard Mann-Whitney Wilcoxon test in the one-dimensional framework. We show that the learning step of the procedure does not affect the consistency of the test as well as its properties in terms of power, provided the ranking produced is accurate enough in the AUC sense. The results of a numerical experiment are eventually displayed in order to show the efficiency of the method.
Fichier principal
Vignette du fichier
3838-auc-optimization-and-the-two-sample-problem.pdf (242.26 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02107262 , version 1 (23-04-2019)

Identifiants

  • HAL Id : hal-02107262 , version 1

Citer

Stéphan Clémençon, Marine Depecker, Nicolas Vayatis. AUC optimization and the two-sample problem. 2009, Advances in Neural Information Processing Systems 22. ⟨hal-02107262⟩
185 Consultations
238 Téléchargements

Partager

Gmail Facebook X LinkedIn More