A Storage-Computation-Communication Tradeoff for Distributed Computing

Abstract : This paper investigates distributed computing systems where computations are split into “Map” and “Reduce” functions. A new coded scheme, called distributed computing and coded communication (D3C), is proposed, and its communication load is analyzed as a function of the available storage space and the number of intermediate values (IVA) to be computed. D3C achieves the smallest possible communication load for a given storage space, while a smaller number of IVAs need to be computed compared to Li et al.'s coded distributed computing (CDC) scheme. More generally, our scheme can flexibly trade between storage space and the number of IVAs to be computed. Communication load is then analyzed for any given tradeoff.
Complete list of metadatas

https://hal.telecom-paristech.fr/hal-02288593
Contributor : Qifa Yan <>
Submitted on : Sunday, September 15, 2019 - 5:28:09 AM
Last modification on : Thursday, October 17, 2019 - 12:36:55 PM

Identifiers

  • HAL Id : hal-02288593, version 1

Citation

Qifa Yan, Sheng Yang, Michèle Wigger. A Storage-Computation-Communication Tradeoff for Distributed Computing. 2018 15th International Symposium on Wireless Communication Systems (ISWCS), Aug 2018, Lisbon, Portugal. pp.1-5. ⟨hal-02288593⟩

Share

Metrics

Record views

30