Deriving job completion reliability and job energy consumption for a general mapreduce infrastructure from single-job perspective

Jia Chun Lin, Fang Yie Leu, Ming Chang Lee, Ying-Ping Chen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

MapReduce as a master-slave infrastructure consists of two master-side severs and a large number of slave-side working nodes. In this paper, we derive a job completion reliability (JCR for short) model and a job energy consumption (JEC for short) model from a single-job perspective for a general MapReduce infrastructure in which no redundancy scheme is adopted on the master side, and a cold-standby scheme is employed on the slave side. Without loss of generality, the JCR model is derived based on a Poisson distribution. Through the simulation and analytical results, MapReduce managers and service providers can comprehend how this infrastructure behaves and how to improve the infrastructure so as to achieve a more reliable and energy-efficient MapReduce environment.

Original languageEnglish
Title of host publicationProceedings - 27th International Conference on Advanced Information Networking and Applications Workshops, WAINA 2013
Pages1642-1647
Number of pages6
DOIs
StatePublished - 19 Aug 2013
Event27th International Conference on Advanced Information Networking and Applications Workshops, WAINA 2013 - Barcelona, Spain
Duration: 25 Mar 201328 Mar 2013

Publication series

NameProceedings - 27th International Conference on Advanced Information Networking and Applications Workshops, WAINA 2013

Conference

Conference27th International Conference on Advanced Information Networking and Applications Workshops, WAINA 2013
CountrySpain
CityBarcelona
Period25/03/1328/03/13

Keywords

  • Job completion reliability
  • Job energy consumption
  • MapReduce
  • Master-slave infrastructure
  • Poission distribution
  • Single-job perspective

Fingerprint Dive into the research topics of 'Deriving job completion reliability and job energy consumption for a general mapreduce infrastructure from single-job perspective'. Together they form a unique fingerprint.

Cite this