Eero P. Simoncelli, Edward H. Aelson

Abstract

We describe the relationship between gradient methods for computing optical ow and lter-based spatio-temporal energy models of biological motion processing, revealing that these techniques are equivalent under certain conditions. We discuss extensions of these techniques which compute probability distributions of optical ow. The use of distributions allows proper handling of the uncertainties inherent in the optical ow computation, facilitating the combination with information from other sources. The probabilistic framework also leads to several useful extensions of the standard quadratic gradient solution. We use these extensions to compute optical ow for both a synthetic and a real image sequence.