TV-L1 optical flow for vector valued images

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

The variational TV-L1 framework has become one of the most popular and successful approaches for calculating optical flow. One reason for the popularity is the very appealing properties of the two terms in the energy formulation of the problem, the robust L1-norm of the data fidelity term combined with the total variation (TV) regular- ization that smoothes the flow, but preserve strong discontinuities such as edges. Specifically the approach of Zach et al. [1] has provided a very clean and efficient algorithm for calculating TV-L1 optical flows between grayscale images. In this paper we propose a generalized algorithm that works on vector valued images, by means of a generalized projection step. We give examples of calculations of flows for a number of multi- dimensional constancy assumptions, e.g. gradient and RGB, and show how the developed methodology expands to any kind of vector valued images. The resulting algorithms have the same degree of parallelism as the case of one-dimensional images, and we have produced an efficient GPU implementation, that can take vector valued images with vectors of any dimension. Finally we demonstrate how these algorithms generally produce better flows than the original algorithm.
Original languageEnglish
Title of host publicationEnergy Minimization Methods in Computer Vision and Pattern Recognition : 8th International Conference, EMMCVPR 2011, St. Petersburg, Russia, July 25-27, 2011. Proceedings
EditorsYuri Boykov, Fredrik Kahl, Victor Lempitsky, Frank R. Schmidt
Number of pages15
Publication date2011
ISBN (Print)978-3-642-23093-6
ISBN (Electronic)978-3-642-23094-3
Publication statusPublished - 2011
Event8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition - Sankt Petersborg, Russian Federation
Duration: 25 Jul 201127 Jul 2011
Conference number: 8


Conference8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
LandRussian Federation
BySankt Petersborg
SeriesLecture notes in computer science

ID: 33478192