Learning reduced models for motion estimation on ocean satellite images

I. Herlin1,2, D. Béréziat3, K. Drifi1,2, S. Zhuk4

1 INRIA – B.P. 105, 78153 Le Chesnay Cedex, France

2 CEREA, joint laboratory ENPC – EDF R&D, Université Paris-Est – Cité Descartes, Champs-sur-Marne, 77455 Marne la Vallée, France

3 Université Pierre et Marie Curie – 4 place Jussieu, 75005 Paris, France

4 CWI – P.O. Box 94079, NL-1090 GB Amsterdam, Netherlands

Аннотация

The paper describes a learning method on sliding windows for estimating apparent motion on long temporal satellite sequences acquired over oceans. A «full model», which is defined on the pixel grid, is chosen to describe the dynamics of motion fields and images, based on heuristics of divergence-free motion and advection of image brightness by the velocity. The image sequence is split into small temporal windows that half overlap in time. Image assimilation in the full model is applied on the first window to retrieve its motion field. This makes it possible to define subspaces of motion fields and images and a «reduced model» is defined by applying the Galerkin projection of the full model on these subspaces. Data assimilation in the reduced model is applied on this second window. The process is iterated for the next window until the end of the whole image sequence. Each reduced model is then learned from the previous one. The main advantage of the approach is the small computational requirements of the assimilation in the reduced models that make it feasible to process in quasi-real time image acquisitions. Twin experiments have been designed to quantify the full model and the learning method on sliding windows and demonstrate the quality of the motion fields estimated by the approach.

Ключевые слова

Motion Estimation, Data Assimilation, Model Reduction, Galerkin projection

Для цитирования

Herlin I., Béréziat D., Drifi K., Zhuk S. Learning reduced models for motion estimation on ocean satellite images // Экологическая безопасность прибрежной и шельфовой зон и комплексное использование ресурсов шельфа. 2011. № 25, т. 2. С. 66–78.

Herlin, I., Béréziat, D., Drifi, K. and Zhuk, S., 2011. Learning Reduced Models for Motion Estimation on Ocean Satellite Images. Ecological Safety of Coastal and Shelf Zones and Comprehensive Use of Shelf Resources, 25(2), pp. 66–78.

Список литературы

  1. Horn B. and Schunk B. Determining optical flow // Art. Int. – 1981. – vol. 17. – P. 185–203.
  2. Isambert T., Berroir J. and Herlin I. A multiscale vector spline method for estimating the fluids motion on satellite images / In: Forsyth, D., Torr, P., Zisserman A. (eds.). – Springer, Heidelberg, 2008. – part IV. – vol. 5303. – P. 665–676.
  3. Papadakis N., Corpetti T. and Mémin E. Dynamically consistent optical flow estimation / In ICCV. 2007. – P. 1–7.
  4. Titaud O., Vidard A., Souopgui I. and Dimet F.-X. L. Assimilation of image sequences in numerical models // Tellus Series A: Dynamic Meteorology and Oceanography. – 2010. – vol. 62, № 1. – P. 30–47.
  5. Béréziat D. and Herlin I. Solving ill-posed image processing problems using data assimilation // Numerical Algorithms. – 2011. – vol. 56, № 2. – P. 219–252.
  6. Drifi K. and Herlin I. Assimilation d'images dans un modèle réduit pour l'estimation du mouvement / In GRETSI 2011 – Groupe d'Etudes du Traitement du Signal et des Images, Bordeaux, France. – 2011. – 4 p.
  7. Deriaz E. and Perrier V. Divergence-free and curl-free wavelets in two dimensions and three dimensions: application to turbulent flows // Journal of Turbulence. – 2006. – vol. 7, № 3. – P. 1–37.
  8. Le Dimet, F.-X. and Talagrand O. Variational algorithms for analysis and assimilation of meteorological observations: Theoretical aspects // Tellus. – 1986. – vol. 38A, № 2. – P. 97–110.
  9. Zhu C., Byrd R., Lu P. and Nocedal J. L-BFGS-B: a limited memory FORTRAN code for solving bound constrained optimization problems. Technical Report NAM-11. EECS Department, Northwestern University. – 1994.
  10. Isambert T., Herlin I., and Berroir J.-P. Fast and stable vector spline method for fluid flow estimation / In ICIP. – 2007. – P. 505–508.
  11. Corpetti T., Mémin E. and Pérez P. Dense estimation of fluid flows // Pat. Anal. and Mach. Int. – 2002. – vol. 24, № 3. – P. 365–380.
  12. Suter D. Motion estimation and vector splines / In CVPR. – 1994. – P. 939–942.

Файлы

 Полный текст (русский)

Мы используем Яндекс Метрику. Подробнее.