Motion Selective Prediction for Video Frame Synthesis -- Veronique Prinet

IEEE International Conference for Image Processing - 2019

Motion Selective Prediction for Video Frame Synthesis

Véronique Prinet

The Hebrew University of Jerusalem, Israel

Abstract

Existing conditional video prediction approaches train a network from large databases and generalise to previously unseen data. We take the opposite stance, and introduce a model that learns from the first frames of a given video and extends its content and motion, to, e.g., double its length. To this end, we propose a dual network that can use in a flexible way both dynamic and static convolutional motion kernels, to predict future frames. The construct of our model gives us the means to efficiently analyse its functioning and interpret its output. We demonstrate experimentally the robustness of our approach on challenging videos in-the-wild and show that it is competitive w.r.t. related baselines.

 
		@InProceedings{vp_arxiv2018,
		author  = {V{\'{e}}ronique Prinet} ,
		title   = {Motion Selective Prediction for Video Frame Synthesis},
  		journal = {CoRR},
  		volume  = {abs/1812.10157},
  		year    = {2018},
 		url     = {http://arxiv.org/abs/1812.10157},
  		archivePrefix = {arXiv}}
		
Note: A short version of this work is to appear under the title "Domain-agnostic video prediction from selective kernels", in ICIP 2019 (Taiwan, Sept) .
         
Paper (arxiv)
Data
Code
Presentation slides
PDF

Results
(The videos are better viewed with Chromium Web Browser.)