Fast Temporal Activity Proposals for Efficitent Detection of Human Actions in Untrimmed Videos

Fabian Caba Heilbron Juan Carlos Niebles Bernard Ghanem
KAUST, Stanford University

CVPR 2016

Summary

In many large-scale video analysis scenarios, one is interested in localizing and recognizing human activities that occur in short temporal intervals within long untrimmed videos. Current approaches for activity detection still struggle to handle large-scale video collections and the task remains relatively unexplored. This is in part due to the computational complexity of current action recognition approaches and the lack of a method that proposes fewer intervals in the video, where activity processing can be focused. In this paper, we introduce a proposal method that aims to recover temporal segments containing actions in untrimmed videos. Building on techniques for learning sparse dictionaries, we introduce a learning framework to represent and retrieve activity proposals. We demonstrate the capabilities of our method in not only producing high quality proposals but also in its efficiency. Finally, we show the positive impact our method has on recognition performance when it is used for action detection, while running at 10FPS.


Resources:

  • Download our CVPR 2016 Paper.
  • Check out our Poster presentation!
  • Code is available in this Github repository!!
  • Acknowledgment

    Research in this publication was supported by the King Abdullah University of Science and Technology (KAUST) Office of Sponsored Research, the Stanford AI Lab Toyota Center for Artificial Intelligence Research, and a Google Faculty Research Award (2015).

    References

    If you use any of this work material in your research, please cite our CVPR 2016 paper:

    @article{caba2016_proposals,
      title={{Fast Temporal Activity Proposals for Efficitent Detection of Human Actions in Untrimmed Videos}},
      author={Caba Heilbron, Fabian and Niebles, Juan Carlos, and Ghanem, Bernard},
      journal={CVPR},
      year={2016}
    }