A sparse Bayesian approach for joint feature selection and classifier learning

Àgata Lapedriza, Santi Seguí, David Masip, Jordi Vitrià

    Research output: Contribution to journalArticleResearchpeer-review

    7 Citations (Scopus)

    Abstract

    In this paper we present a new method for Joint Feature Selection and Classifier Learning using a sparse Bayesian approach. These tasks are performed by optimizing a global loss function that includes a term associated with the empirical loss and another one representing a feature selection and regularization constraint on the parameters. To minimize this function we use a recently proposed technique, the Boosted Lasso algorithm, that follows the regularization path of the empirical risk associated with our loss function. We develop the algorithm for a well known non-parametrical classification method, the relevance vector machine, and perform experiments using a synthetic data set and three databases from the UCI Machine Learning Repository. The results show that our method is able to select the relevant features, increasing in some cases the classification accuracy when feature selection is performed. © 2008 Springer-Verlag London Limited.
    Original languageEnglish
    Pages (from-to)299-308
    JournalPattern Analysis and Applications
    Volume11
    Issue number3-4
    DOIs
    Publication statusPublished - 1 Sep 2008

    Keywords

    • Bayesian learning
    • Classification
    • Feature selection

    Fingerprint

    Dive into the research topics of 'A sparse Bayesian approach for joint feature selection and classifier learning'. Together they form a unique fingerprint.

    Cite this