Temporal action detection based on hierarchical object detection networks

Yi Hui Wu, Wen Jiin Tsai, Hua Tsung Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper addresses the problem of temporal action detection from untrimmed videos. Considering that actions can be recognized by the occurrence of objects and the corresponding moving information in the video, a hierarchical model is proposed which consists of two object detection networks to do temporal action detection. The first network is used to detect objects in each frame, and the second one is for temporal action detection. We also proposed a method which converts the object detection results of the first network into a new type of frame so that it can be fed to the second network. The generated frame has six channels with spatiotemporal information beneficial to action detection. Quantitative results on THUMOS14 dataset demonstrate the superior of the proposed model with satisfactory performance gains over state-of-the-art action detection methods.

Original languageEnglish
Title of host publicationProceedings - 2019 12th International Conference on Ubi-Media Computing, Ubi-Media 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages119-123
Number of pages5
ISBN (Electronic)9781728128207
DOIs
StatePublished - Aug 2019
Event12th International Conference on Ubi-Media Computing, Ubi-Media 2019 - Bali, Indonesia
Duration: 6 Aug 20199 Aug 2019

Publication series

NameProceedings - 2019 12th International Conference on Ubi-Media Computing, Ubi-Media 2019

Conference

Conference12th International Conference on Ubi-Media Computing, Ubi-Media 2019
CountryIndonesia
CityBali
Period6/08/199/08/19

Keywords

  • Convolutional neural network (CNN)
  • Temporal action detection

Fingerprint Dive into the research topics of 'Temporal action detection based on hierarchical object detection networks'. Together they form a unique fingerprint.

  • Cite this

    Wu, Y. H., Tsai, W. J., & Chen, H. T. (2019). Temporal action detection based on hierarchical object detection networks. In Proceedings - 2019 12th International Conference on Ubi-Media Computing, Ubi-Media 2019 (pp. 119-123). [9049635] (Proceedings - 2019 12th International Conference on Ubi-Media Computing, Ubi-Media 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/Ubi-Media.2019.00031