Concentration inequalities for regenerative and Harris recurrent Markov chains with applications to statistical learning.

Stéphan Clémençon 1, 2 Gabriela Ciolek 1, 2 P. Bertail 1, 2
1 S2A - Signal, Statistique et Apprentissage
LTCI - Laboratoire Traitement et Communication de l'Information
Abstract :

Concentration inequalities are very often a crucial step in deriving many results in statistical learning. The purpose of this talk is to present Bernstein and Hoeffding type maximal inequalities for regenerative Markov chains. Furthermore, we generalize these results and show exponential bounds for suprema of empirical processes over a class of functions F which size is controlled by its uniform entropy number. We show also that concentration inequalities are possible to obtain when the chain is sub-geometric. All constants involved in the bounds of the considered inequalities are given in an explicit form which can be advantageous in practical considerations. We show that the inequalities obtained for regenerative Markov chains can be easily generalized to a Harris recurrent case. Finally we provide one example of application of presented inequalities in statistical learning theory and obtain generalization bounds for mimimum volume set estimation problem when the data are Markovian.

Document type :
Conference papers
Complete list of metadatas

https://hal.telecom-paristech.fr/hal-02287763
Contributor : Telecomparis Hal <>
Submitted on : Friday, September 13, 2019 - 5:19:11 PM
Last modification on : Thursday, October 17, 2019 - 12:37:03 PM

Identifiers

  • HAL Id : hal-02287763, version 1

Citation

Stéphan Clémençon, Gabriela Ciolek, P. Bertail. Concentration inequalities for regenerative and Harris recurrent Markov chains with applications to statistical learning.. Séminaire généraliste de l'équipe de Probabilités et Statistiques, May 2017, Nancy, France. ⟨hal-02287763⟩

Share

Metrics

Record views

6