Application-aware SDN routing for big data networking

Li Wei Cheng, Shie-Yuan Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Scopus citations

Abstract

Big-Data applications need to shuffle their data over a network in a very large amount. The ability to efficiently allocate network resources to quickly finish the shuffle greatly affects the overall processing speed of Big-Data applications. The recent emergence of software-defined networking (SDN) technology makes it easier for the network to integrate with a Big-Data application. The network can allocate network resources based on an application's run-time requirements to accelerate the speed of Big-Data delivery. In this paper, we used Hadoop as a Big-Data application platform and designed an application-aware SDN routing scheme for Hadoop to accelerate its MapReduce data shuffling over a network. Our results show that our method can outperform the ECMP-RR scheme by up to 20% and outperform the Spanning Tree method and the Floodlight OpenFlow controller by up to 70%.

Original languageEnglish
Title of host publication2015 IEEE Global Communications Conference, GLOBECOM 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479959525
DOIs
StatePublished - 1 Jan 2015
Event58th IEEE Global Communications Conference, GLOBECOM 2015 - San Diego, United States
Duration: 6 Dec 201510 Dec 2015

Publication series

Name2015 IEEE Global Communications Conference, GLOBECOM 2015

Conference

Conference58th IEEE Global Communications Conference, GLOBECOM 2015
CountryUnited States
CitySan Diego
Period6/12/1510/12/15

Fingerprint Dive into the research topics of 'Application-aware SDN routing for big data networking'. Together they form a unique fingerprint.

Cite this