Seq2VAR: multivariate time series representation with relational neural networks and linear autoregressive model

Edouard Pineau 1, 2, 3 Sebastien Razakarivony 1 Thomas Bonald 2, 3
1 Safran Tech
2 Telecom Paris, Institut Polytechnique de Paris
3 LINCS - Laboratory of Information, Network and Communication Sciences
Abstract : Finding understandable and meaningful feature representation of multivariate time series (MTS) is a difficult task, since information is entangled both in temporal and spatial dimensions. In particular, MTS can be seen as the observation of simultaneous causal interactions between dynamical variables. Standard way to model these interactions is the vector linear autoregression (VAR). The parameters of VAR models can be used as MTS feature representation. Yet, VAR cannot generalize on new samples, hence independent VAR models must be trained to represent different MTS. In this paper, we propose to use the inference capacity of neural networks to overpass this limit. We propose to associate a relational neural network to a VAR generative model to form an encoder-decoder of MTS. The model is denoted Seq2VAR for Sequence-to-VAR. We use recent advances in relational neural network to build our MTS encoder by explicitly modeling interactions between variables of MTS samples. We also propose to leverage reparametrization tricks for binomial sampling in neural networks in order to build a sparse version of Seq2VAR and find back the notion of Granger causality defined in sparse VAR models. We illustrate the interest of our approach through experiments on synthetic datasets.
Keywords : Multivariate time series Vector linear autoregression Relational neural networks Granger causality
Document type :
Conference papers
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download
https://hal.telecom-paristech.fr/hal-02293239
Contributor : Thomas Bonald <>
Submitted on : Friday, September 20, 2019 - 4:40:02 PM
Last modification on : Saturday, December 21, 2019 - 1:12:48 AM
Long-term archiving on: Sunday, February 9, 2020 - 3:30:56 AM

File

AALTD_19.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02293239, version 1

Collections

INRIA | SORBONNE-UNIVERSITE | PARISTECH | INSTITUT-TELECOM | SU-SCIENCES

Citation

Edouard Pineau, Sebastien Razakarivony, Thomas Bonald. Seq2VAR: multivariate time series representation with relational neural networks and linear autoregressive model. AALTD workshop, ECML/PKDD : 4th Workshop on Advanced Analytics and Learning on Temporal Data, 2019, Wurzburg, Germany. ⟨hal-02293239⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

140

Files downloads

131

Contact

Informations

CCSD