Multiclass Feature Selection with Kernel Gram-matrix-based criteria

M. Ramona Gael Richard 1, 2 B. David 1, 2
1 S2A - Signal, Statistique et Apprentissage
LTCI - Laboratoire Traitement et Communication de l'Information
Abstract :

Feature selection has been an important issue in recent decades to determine the most relevant features according to a given classification problem. Numerous methods have emerged that take into account support vector machines (SVMs) in the selection process. Such approaches are powerful but often complex and costly. In this paper, we propose new feature selection methods based on two criteria designed for the optimization of SVM: kernel target alignment and kernel class separability. We demonstrate how these two measures, when fully expressed, can build efficient and simple methods, easily applicable to multiclass problems and iteratively computable with minimal memory requirements. An extensive experimental study is conducted both on artificial and real-world datasets to compare the proposed methods to state-of-the-art feature selection algorithms. The results demonstrate the relevance of the proposed methods both in terms of performance and computational cost.

Keywords : Feature selection SVM
Document type :
Journal articles
Complete list of metadatas

https://hal.telecom-paristech.fr/hal-02286310
Contributor : Telecomparis Hal <>
Submitted on : Friday, September 13, 2019 - 3:35:48 PM
Last modification on : Thursday, October 17, 2019 - 12:37:02 PM

Identifiers

  • HAL Id : hal-02286310, version 1

Collections

Citation

M. Ramona, Gael Richard, B. David. Multiclass Feature Selection with Kernel Gram-matrix-based criteria. IEEE Transactions on Neural Networks and Learning Systems, 2012, 23 (10), pp.1611-1623. ⟨hal-02286310⟩

Share

Metrics

Record views

4