An Optical Flow Based Segmentation Method for Objects Extraction
Abstract:This paper describes a segmentation algorithm based
on the cooperation of an optical flow estimation method with edge
detection and region growing procedures.
The proposed method has been developed as a pre-processing
stage to be used in methodologies and tools for video/image indexing
and retrieval by content. The addressed problem consists in
extracting whole objects from background for producing images of
single complete objects from videos or photos. The extracted images
are used for calculating the object visual features necessary for both
indexing and retrieval processes.
The first task of the algorithm exploits the cues from motion
analysis for moving area detection. Objects and background are then
refined using respectively edge detection and region growing
procedures. These tasks are iteratively performed until objects and
background are completely resolved.
The developed method has been applied to a variety of indoor and
outdoor scenes where objects of different type and shape are
represented on variously textured background.
 R. Pohle and K. Toennies, "Segmentation of medical images using
adaptive region growing", Proc. SPIE Medical Imaging 2001, San
Diego, CA, 2001, 1337-1346.
 G. A. Ruza, and P. A. Estéveza, "Image segmentation using fuzzy minmax
neural networks for wood defect detection", Proc. IPROMS 2005,
online web-based conference, July 2005, to be published by Elsevier.
 A. K. Jain and M. P. Dubuisson, "Segmentation of x-ray and c-scan
images of fiber reinforced composite materials", Pattern Recognition,
25, pp. 257-269, 1992.
 P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph based image
segmentation", International Journal of Computer Vision 59(2), 167-
 J. Malik, S. Belongie, T. Leung and J. Shi, "Contour and texture analysis
for image segmentation", International Journal of Computer Vision
43(1), 7-27, 2001
 U. Montanari, "On the optimal detection of curves in noisy pictures",
Comm. of the ACM, vol.14:335-345, 1971.
 P. Parent and S. Zucker, "Trace inference, curvature, consistency, and
curve detection", IEEE Transactions on Pattern Analysis and Machine
Intelligence Volume 11 , Issue 8, Pages: 823 - 839, August 1989.
 A. Sha-ashua and S. Ullman, "Structural saliency: the detection of
globally salient structures using a locally connected network", in Proc.
2nd Int. Conf. Computer Vision, Tampa, FL, USA, 1988, pp 321-327.
 L. Williams and D. Jacobs, "Stochastic completion fields: a neural
model of illusory contour shape and salience", in Proc. 5th Int. Conf.
Computer Vision, Cambridge, MA, 1995, pp. 408-415.
 L. A. Vese and T. F. Chan, "A multiphase level set framework for image
segmentation using the Mumford and Shah model", International
Journal of Computer Vision 50(3), 271-293, 2002.
 N. Paragios, "A variational approach for the segmentation of the left
ventricle in cardiac image analysis", International Journal of Computer
Vision 50(3), 345-362, 2002.
 X. Wang, L. He and W. Wee, "Deformable contour method: a
constrained optimization approach", International Journal of Computer
Vision 59(1), 87-108, 2004.
 B. Appleton and H. Talbot, "Globally optimal geodesic active contours",
Journal of Mathematical Imaging and Vision 23:67-86, 2005
 T. Amiaz and N. Kiryati, "Dense discontinuous optical flow via contourbased
segmentation", in Proc. ICIP 2005, Genova, Italy, September
2005, Vol. III, pp. 1264-1267.
 C. L. Zitnick, N. Jojic and S. B. Kang, "Consistent segmentation for
optical flow estimation", in Proc. ICCV 2005, Beijing, China, October
 F. Ranchin and F. Dibos, "Moving objects segmentation using optical
flow estimation", in Proc. Workshop on Mathematics and Image
Analysis, Paris, September 2004.
 R. Vidal and S. Sastry, "Segmentation of dynamic scenes from image
intensities", in Proc. IEEE Workshop on Vision and Motion Computing,
Orlando FL, December 2002, pp. 44-49.
 D. Cremers, "A variational framework for image segmentation
combining motion estimation and shape regularization", in Proc. IEEE
Conference on Computer Vision and Pattern Recognition (CVPR),
Madison, Wisconsin, June 2003.
 A. G. Bors and I. Pitas, "Optical flow estimation and moving object
segmentation based on median radial basis function network", IEEE
Trans. Image Process., vol. 7, no. 5, pp. 693--702, May 1998.
 J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical
flow techniques", International Journal of Computer Vision 12(1), pp.
 E. Francomano, C. Lodato, S. Lopes and A. Tortorici, "An algorithm for
optical flow computation based on a quasi-interpolant operator",
Journal of Computational Methods in Science and Engineering
(JCMSE) to be published.
 B. K. Horn and B. G. Schunck, "Determining optical flow", Artificial
Intelligence. August 1981.
 M. Sezgin and B. Sankur, "Survey over image thresholding techniques
and quantitative performance evaluation", Journal of Electronic Imaging
13(1), 146-165, January 2004.
 A. Abutaleb, "Automatic thresholding of gray-level pictures using twodimensional
entropy", Computer Vision, Graphics, and Image
Processing, Volume 47, Issue 1, Pages 22-32, July 1989.
 M. Roggero. "Object segmentation with region growing and principal
component analysis", in Proc. ISPRS Commission III, Symposium 2002,
Graz, Austria, September 2002, pp. A-289-294.
 J. Fan, D. K. Y. Yau, A. K. Elmagarmid and W. G. Aref, "Automatic
image segmentation by integrating color-edge extraction and seeded
region growing", IEEE Trans. Image Process., vol.10, no.10, pp.1454-
1466, Oct. 2001.
 R. Adams and L. Bischof, "Seeded region growing", IEEE Trans.
Pattern Anal. Mach. Intell., vol.16, no.6, pp.641-647, June 1994.
 S. A. Hojjatoleslami and J. Kittler, "Region growing: A new approach",
IEEE Trans. Image Process., vol.7, no.7, pp.1079-1084, July 1998.
 Y. L. Chang and X. Li, "Adaptive image region-growing", IEEE Trans.
Image Process., vol.3, no.6, pp.868-872, Nov. 1994.