M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. K. Saul, An introduction to variational methods for graphical models, Machine Learning, vol.37, pp.183-233, 1999.

M. J. Beal, Variational algorithms for approximate bayesian inference, 2003.

M. Opper and O. Winther, Gaussian processes for classification: Mean-field algorithms, Neural Comput, vol.12, issue.11, pp.2655-2684, 2000.

T. P. Minka, Expectation propagation for approximate bayesian inference, Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence, UAI'01, pp.362-369, 2001.

S. Kullback and R. A. Leibler, On information and sufficiency, Ann. Math. Statist, vol.22, issue.1, p.1951

D. M. Blei, A. Kucukelbir, and J. D. Mcauliffe, Variational Inference: A Review for Statisticians. arXiv e-prints, 2016.

C. Zhang, J. Butepage, H. Kjellstrom, and S. Mandt, Advances in Variational Inference. arXiv e-prints, 2017.

J. Martin, M. I. Wainwright, and . Jordan, Graphical models, exponential families, and variational inference, Found. Trends Mach. Learn, vol.1, issue.1-2, pp.1-305, 2008.

J. Paisley, D. Blei, and M. Jordan, Variational Bayesian Inference with Stochastic Search. arXiv e-prints, 2012.

R. Ranganath, S. Gerrish, and D. M. Blei, , 2013.

M. D. Hoffman, D. M. Blei, C. Wang, and J. Paisley, Stochastic variational inference, Journal of Machine Learning Research, vol.14, pp.1303-1347, 2013.

T. P. Minka, A Family of Algorithms for Approximate Bayesian Inference, p.803033, 2001.

H. Zhu and R. Rohwer, Bayesian invariant measurements of generalization, Neural Processing Letters, vol.2, pp.28-31, 1995.

H. Zhu and R. Rohwer, Information geometric measurements of generalisation, vol.10, 1995.

A. Rényi, On measures of entropy and information, Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol.1, pp.547-561, 1961.

T. Van-erven and P. Harremoës, Rényi Divergence and Kullback-Leibler Divergence, 2012.

T. Minka, Divergence measures and message passing, vol.17, 2005.

T. Minka, Power ep. page 6, 2004.

J. Miguel-hernández-lobato, Y. Li, M. Rowland, D. Hernández-lobato, T. Bui et al., Black-box ?-divergence Minimization. arXiv e-prints, 2015.

Y. Li and R. E. Turner, Rényi Divergence Variational Inference, 2016.

A. Bousso-dieng, D. Tran, R. Ranganath, J. Paisley, and D. Blei, Variational inference via ? upper bound minimization, Advances in Neural Information Processing Systems, vol.30, pp.2732-2741, 2017.

Y. Li, J. M. Hernandez-lobato, and R. Turner, Stochastic expectation propagation, vol.06, 2015.

G. Dehaene and S. Barthelmé, Expectation Propagation in the large-data limit, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01235066

L. Bottou, Large-scale machine learning with stochastic gradient descent, Proceedings of COMPSTAT'2010, pp.177-186, 2010.

H. Robbins and S. Monro, A stochastic approximation method, Ann. Math. Statist, vol.22, issue.3, p.1951

D. M. Blei, A. Y. Ng, and M. Jordan, Latent dirichlet allocation, vol.3, pp.601-608, 2001.

T. Morimoto, Eine informationstheoretische ungleichung und ihre anwendung auf den beweis der ergodizitat von markoffschen ketten, Magyar Tud. Akad. Mat. Kutat Int, vol.08, pp.85-108, 1963.

T. Morimoto, Markov processes and the h-theorem, Journal of The Physical Society of Japan -J PHYS SOC JPN, vol.18, pp.328-331, 1963.

A. Cichocki and . Shun-ichi-amari, Families of alpha-beta-and gamma-divergences: Flexible and robust measures of similarities, Entropy, p.12, 2010.

M. Del, C. Pardo, and I. Vajda, On asymptotic properties of informationtheoretic divergences, IEEE Transactions on Information Theory, vol.49, issue.7, pp.1860-1867, 2003.

I. Sason, On f-divergences: Integral representations, local behavior, and inequalities, 2018.

E. Hellinger, Neue begründung der theorie quadratischer formen von unendlichvielen LTCI, Télécom Paris Institut Polytechnique de Paris 46, rue Barrault, 75013 Paris E-mail: kamelia.daudel@telecom-paris

C. Département, Télécom SudParis Institut Polytechnique de Paris 9 rue Charles Fourier, 91000 Evry E-mail: randal.douc@telecom-sudparis