Deformable Segmentation

For the purpose of object boundary extraction, traditional shape-based deformable models rely on external image forces that come primarily from edge or image gradient information. Such reliance on local edge information makes the models prone to get stuck in local minima due to image noise and various other image artifacts. We propose a 2D deformable model—Metamorphs, which integrates region texture constraints so as to achieve more robust segmentation. Compared with traditional shape-based models, Metamorphs’s segmentation result is less dependent on model initialization and not sensitive to noise and spurious edges inside the object of interest. Then we present Active Volume Models (AVM), a similar and improved approach for 3D segmentation. The shape of this 3D model is considered as an elastic solid, with a simplex-mesh surface made of thousands of vertices. Deformations of the model are derived from a linear system that encodes external forces from the boundary of a Region of Interest (ROI), which is a binary mask representing the object region predicted by the current model. Efficient optimization and fast convergence of the model are achieved using the Finite Element Method (FEM). To further improve segmentation performance, a multiple-surface constraint is also employed to incorporate spatial constraints among multiple objects. It uses two surfacedistance based functions to adaptively adjust the weights of contribution from the image-based region information and from spatial constraints among multiple interacting surfaces. Several applications such as the rodent brain segmentation are shown to demonstrate the benefits of these segmentation algorithms based on deformable models that integrate multiple sources of constraints.

Publications

  • Xiaolei Huang, Dimitris Metaxas, “Metamorphs: Deformable Shape and Appearance Models,” In IEEE Trans. Pattern Analysis and Machine Intelligence (TPAMI), Vol. 30, No. 8, pp. 1444-1459, Aug. 2008.
  • Shaoting Zhang, Junzhou Huang, Mustafa Uzunbas, Tian Shen, Foteini Delis, Xiaolei Huang, Nora Volkow, Panayotis Thanos, Dimitris Metaxas, 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors , to appear in the Proc. of the IEEE Int'l Symposium on Biomedical Imaging: From Nano to Macro, Chicago, Illinois, USA, March 30 - April 2, 2011.
  • Tian Shen, Shaoting Zhang, Junzhou Huang, Xiaolei Huang and Dimitris Metaxas: Integrating Shape and Texture in 3D Deformable Models: From Metamorphs to Active Volume Models, Multi Modality State-of-the-Art Medical Image Segmentation and Registration Methodologies, Springer.