Reinforcement Learning for HEVC/H.265 Frame-level Bit Allocation

Lian Ching Chen, Jun Hao Hu, Wen-Hsiao Peng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Frame-level bit allocation is crucial to video rate control. The problem is often cast as minimizing the distortions of a group of video frames subjective to a rate constraint. When these video frames are related through inter-frame prediction, the bit allocation for different frames exhibits dependency. To address such dependency, this paper introduces reinforcement learning. We first consider frame-level texture complexity and bit balance as a state signal, define the bit allocation for each frame as an action, and compute the negative frame-level distortion as an immediate reward signal. We then train a neural network to be our agent, which observes the state to allocate bits to each frame in order to maximize cumulative reward. As compared to the rate control scheme in HM-16.15, our method shows better PSNR performance while having smaller bit rate fluctuations.

Original languageEnglish
Title of host publication2018 IEEE 23rd International Conference on Digital Signal Processing, DSP 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538668115
DOIs
StatePublished - 31 Jan 2019
Event23rd IEEE International Conference on Digital Signal Processing, DSP 2018 - Shanghai, China
Duration: 19 Nov 201821 Nov 2018

Publication series

NameInternational Conference on Digital Signal Processing, DSP
Volume2018-November

Conference

Conference23rd IEEE International Conference on Digital Signal Processing, DSP 2018
CountryChina
CityShanghai
Period19/11/1821/11/18

Keywords

  • HEVC/H.265
  • deep reinforcement learning
  • frame-level bit allocation

Fingerprint Dive into the research topics of 'Reinforcement Learning for HEVC/H.265 Frame-level Bit Allocation'. Together they form a unique fingerprint.

Cite this