Cost-effective congestion-aware load balancing for datacenters

Bo Ting Chiang, Kuo-Chen Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Most existing datacenters still use Equal-Cost Multi-Path (ECMP) to achieve network load balancing. But such a stateless load balancing mechanism is not able to react adaptively when network congestion occurs. It will cause datacenters unable to make good use of network resources under the unbalanced network state. The main reason most datacenters still using ECMP is that the cost of realizing the state-of-art load balancing technologies is too high since all switches in datacenters need to be replaced with programmable switches, such as P4 switches. In this paper, we propose a cost-effective congestion-aware load balancing (CCLB) scheme that only needs to replace a portion of switches with programmable switches to achieve congestion-aware load balancing. CCLB makes good use of Explicit Congestion Notification (ECN) in the IP layer to be aware of network congestion and uses flowlet switching that slices large flows into small sub-flows to achieve load balancing. Experiment results show that the average flow completion time of the proposed CCLB is 27% shorter than that of ECMP in large flows. Compared to a classical congestion-aware mechanism, HULA, the average flow completion time of the proposed CCLB is slightly longer, but our switch replacement cost is much lower than HULA's.

Original languageEnglish
Title of host publicationICEIC 2019 - International Conference on Electronics, Information, and Communication
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9788995004449
DOIs
StatePublished - 3 May 2019
Event18th International Conference on Electronics, Information, and Communication, ICEIC 2019 - Auckland, New Zealand
Duration: 22 Jan 201925 Jan 2019

Publication series

NameICEIC 2019 - International Conference on Electronics, Information, and Communication

Conference

Conference18th International Conference on Electronics, Information, and Communication, ICEIC 2019
CountryNew Zealand
CityAuckland
Period22/01/1925/01/19

Keywords

  • Congestion-aware
  • Hybrid data plane
  • Load balancing
  • Programmable switch

Fingerprint Dive into the research topics of 'Cost-effective congestion-aware load balancing for datacenters'. Together they form a unique fingerprint.

  • Cite this

    Chiang, B. T., & Wang, K-C. (2019). Cost-effective congestion-aware load balancing for datacenters. In ICEIC 2019 - International Conference on Electronics, Information, and Communication [8706496] (ICEIC 2019 - International Conference on Electronics, Information, and Communication). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/ELINFOCOM.2019.8706496