Mathematical methods in medical image processing
HTML articles powered by AMS MathViewer
- by Sigurd Angenent, Eric Pichon and Allen Tannenbaum PDF
- Bull. Amer. Math. Soc. 43 (2006), 365-396 Request permission
Abstract:
In this paper, we describe some central mathematical problems in medical imaging. The subject has been undergoing rapid changes driven by better hardware and software. Much of the software is based on novel methods utilizing geometric partial differential equations in conjunction with standard signal/image processing techniques as well as computer graphics facilitating man/machine interactions. As part of this enterprise, researchers have been trying to base biomedical engineering principles on rigorous mathematical foundations for the development of software methods to be integrated into complete therapy delivery systems. These systems support the more effective delivery of many image-guided procedures such as radiation therapy, biopsy, and minimally invasive surgery. We will show how mathematics may impact some of the main problems in this area, including image enhancement, registration, and segmentation.References
- Luis Álvarez, Frédéric Guichard, Pierre-Louis Lions, and Jean-Michel Morel, Axiomes et équations fondamentales du traitement d’images (analyse multiéchelle et EDP), C. R. Acad. Sci. Paris Sér. I Math. 315 (1992), no. 2, 135–138 (French, with English and French summaries). MR 1197224
- Luis Alvarez, Frédéric Guichard, Pierre-Louis Lions, and Jean-Michel Morel, Axioms and fundamental equations of image processing, Arch. Rational Mech. Anal. 123 (1993), no. 3, 199–257. MR 1225209, DOI 10.1007/BF00375127
- Luis Alvarez, Pierre-Louis Lions, and Jean-Michel Morel, Image selective smoothing and edge detection by nonlinear diffusion. II, SIAM J. Numer. Anal. 29 (1992), no. 3, 845–866. MR 1163360, DOI 10.1137/0729052
- Luis Alvarez and Jean-Michel Morel, Formalization and computational aspects of image analysis, Acta numerica, 1994, Acta Numer., Cambridge Univ. Press, Cambridge, 1994, pp. 1–59. MR 1288095, DOI 10.1017/s0962492900002415
- L. Ambrosio, A compactness theorem for a new class of functions of bounded variation, Boll. Un. Mat. Ital. B (7) 3 (1989), no. 4, 857–881 (English, with Italian summary). MR 1032614 ambrosio:transport —, Lecture notes on optimal transport theory, Euro Summer School, Mathematical Aspects of Evolving Interfaces, CIME Series of Springer Lecture Notes, Springer, July 2000. ando-consistentEdgeDetector S. Ando, Consistent gradient operators, IEEE Transactions on Pattern Analysis and Machine Intelligence 22 (2000), no. 3, 252–265.
- Sigurd Angenent, Steven Haker, and Allen Tannenbaum, Minimizing flows for the Monge-Kantorovich problem, SIAM J. Math. Anal. 35 (2003), no. 1, 61–97. MR 2001465, DOI 10.1137/S0036141002410927
- Sigurd Angenent, Guillermo Sapiro, and Allen Tannenbaum, On the affine heat equation for non-convex curves, J. Amer. Math. Soc. 11 (1998), no. 3, 601–634. MR 1491538, DOI 10.1090/S0894-0347-98-00262-8
- Jean-David Benamou and Yann Brenier, A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem, Numer. Math. 84 (2000), no. 3, 375–393. MR 1738163, DOI 10.1007/s002110050002
- J. D. Benamou and Y. Brenier, Mixed $L^2$-Wasserstein optimal mapping between prescribed density functions, J. Optim. Theory Appl. 111 (2001), no. 2, 255–271. MR 1865668, DOI 10.1023/A:1011926116573
- Yann Brenier, Polar factorization and monotone rearrangement of vector-valued functions, Comm. Pure Appl. Math. 44 (1991), no. 4, 375–417. MR 1100809, DOI 10.1002/cpa.3160440402 brooks2001-emergingMedicalImagingModalities D. Brooks, Emerging medical imaging modalities, IEEE Signal Processing Magazine 18 (2001), no. 6, 12–13. canny1986-edgeDetector J. Canny, Computational approach to edge detection, IEEE Transactions on Pattern Analysis and Machine Intelligence 8 (1986), no. 6, 679–698.
- Vicent Caselles, Francine Catté, Tomeu Coll, and Françoise Dibos, A geometric model for active contours in image processing, Numer. Math. 66 (1993), no. 1, 1–31. MR 1240700, DOI 10.1007/BF01385685 caselles1997-geodesic V. Caselles, R. Kimmel, and G. Sapiro, Geodesic active contours, International Journal of Computer Vision 22 (1997), no. 11, 61–79. caselles1998-reviewPDE V. Caselles, J. Morel, G. Sapiro, and A. Tannenbaum, Introduction to the special issue on partial differential equations and geometry-driven diffusion in image processing and analysis, IEEE Trans. on Image Processing 7 (1998), no. 3, 269–273. chabat2000-computerizedMedicalImaging F. Chabat, D.M. Hansell, and Guang-Zhong Yang, Computerized decision support in medical imaging, IEEE Engineering in Medicine and Biology Magazine 19 (2000), no. 5, 89–96. Vese T. Chan and L. Vese, Active contours without edges, IEEE Trans. Image Processing 10 (2001), 266–277.
- Tony F. Chan, Jianhong Shen, and Luminita Vese, Variational PDE models in image processing, Notices Amer. Math. Soc. 50 (2003), no. 1, 14–26. MR 1948832
- Yun Gang Chen, Yoshikazu Giga, and Shun’ichi Goto, Uniqueness and existence of viscosity solutions of generalized mean curvature flow equations, J. Differential Geom. 33 (1991), no. 3, 749–786. MR 1100211
- Kai-Seng Chou and Xi-Ping Zhu, The curve shortening problem, Chapman & Hall/CRC, Boca Raton, FL, 2001. MR 1888641, DOI 10.1201/9781420035704 Cohen L. D. Cohen, On active contour models and balloons, CVGIP: Image Understanding 53 (1991), no. 2, 211–218.
- C. L. Epstein and Michael Gage, The curve shortening flow, Wave motion: theory, modelling, and computation (Berkeley, Calif., 1986) Math. Sci. Res. Inst. Publ., vol. 7, Springer, New York, 1987, pp. 15–59. MR 920831, DOI 10.1007/978-1-4613-9583-6_{2}
- L. C. Evans and J. Spruck, Motion of level sets by mean curvature. I, J. Differential Geom. 33 (1991), no. 3, 635–681. MR 1100206 Fram-1975 J.R. Fram and E.S. Deutsch, On the quantitative evaluation of edge detection schemes and their comparisions with human performance, IEEE Transaction on Computers 24 (1975), no. 6, 616–627. Fry D. Fry, Shape recognition using metrics on the space of shapes, Ph.D. thesis, Harvard University, 1993.
- M. Gage and R. S. Hamilton, The heat equation shrinking convex plane curves, J. Differential Geom. 23 (1986), no. 1, 69–96. MR 840401
- Wilfrid Gangbo and Robert J. McCann, The geometry of optimal transportation, Acta Math. 177 (1996), no. 2, 113–161. MR 1440931, DOI 10.1007/BF02392620 gerson2004-xrayMania E.S. Gerson, Scenes from the past: X-Ray mania, the X-Ray in advertising, circa 1895, Radiographics 24 (2004), 544–551.
- Enrico Giusti, Minimal surfaces and functions of bounded variation, Monographs in Mathematics, vol. 80, Birkhäuser Verlag, Basel, 1984. MR 775682, DOI 10.1007/978-1-4684-9486-0 gonzalez2001 R. Gonzalez and R. Woods, Digital image processing, Prentice Hall, 2001.
- Matthew A. Grayson, The heat equation shrinks embedded plane curves to round points, J. Differential Geom. 26 (1987), no. 2, 285–314. MR 906392
- Matthew A. Grayson, Shortening embedded curves, Ann. of Math. (2) 129 (1989), no. 1, 71–111. MR 979601, DOI 10.2307/1971486 guichard2002-reviewPDE F. Guichard, L. Moisan, and J.M. Morel, A review of PDE models in image processing and image analysis, Journal de Physique IV (2002), no. 12, 137–154. gunn1999-laplacianGaussian S.R. Gunn, On the discrete representation of the Laplacian of Gaussian, Pattern Recognition 32 (1999), no. 8, 1463–1472. hajnal2001-medicalImageRegistration J. Hajnal, D.J. Hawkes, D. Hill, and J.V. Hajnal (eds.), Medical image registration, CRC Press, 2001. Haker-massTransport S. Haker, L. Zhu, A. Tannenbaum, and S. Angenent, Optimal mass transport for registration and warping, Int. Journal Computer Vision 60 (2004), no. 3, 225–240. Haralick R. Haralick and L. Shapiro, Computer and robot vision, Addison-Wesley, 1992.
- Sigurdur Helgason, The Radon transform, Progress in Mathematics, vol. 5, Birkhäuser, Boston, Mass., 1980. MR 573446 hendee-medicalImagingPhysics W. Hendee and R. Ritenour, Medical imaging physics, 4th ed., Wiley-Liss, 2002. hero2002-mathImaging A.O. Hero and H. Krim, Mathematical methods in imaging, IEEE Signal Processing Magazine 19 (2002), no. 5, 13–14. Hobbie R. Hobbie, Intermediate physics for medicine and biology (third edition), Springer, New York, 1997. horn1986-robotVision B.K.P. Horn, Robot vision, MIT Press, 1986.
- Gerhard Huisken, Flow by mean curvature of convex surfaces into spheres, J. Differential Geom. 20 (1984), no. 1, 237–266. MR 772132 Hummel R. Hummel, Representations based on zero-crossings in scale-space, IEEE Computer Vision and Pattern Recognition, 1986, pp. 204–209. itk Insight Segmentation and Registration Toolkit, http:itk.org. julesz1981-psychophysics B. Julesz, Textons, the elements of texture perception, and their interactions, Nature 12 (1981), no. 290, 91–97. Kant L. V. Kantorovich, On a problem of Monge, Uspekhi Mat. Nauk. 3 (1948), 225–226.
- Satyanad Kichenassamy, Arun Kumar, Peter Olver, Allen Tannenbaum, and Anthony Yezzi Jr., Conformal curvature flows: from phase transitions to active vision, Arch. Rational Mech. Anal. 134 (1996), no. 3, 275–301. MR 1412430, DOI 10.1007/BF00379537
- M. Knott and C. S. Smith, On the optimal mapping of distributions, J. Optim. Theory Appl. 43 (1984), no. 1, 39–49. MR 745785, DOI 10.1007/BF00934745
- Jan J. Koenderink, The structure of images, Biol. Cybernet. 50 (1984), no. 5, 363–370. MR 758126, DOI 10.1007/BF00336961 kolher1959-gestalt W. Köhler, Gestalt psychology today, American Psychologist 14 (1959), 727–734. Rudin S. Osher L. I. Rudin and E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D 60 (1992), 259–268.
- Michael G. Crandall, Hitoshi Ishii, and Pierre-Louis Lions, User’s guide to viscosity solutions of second order partial differential equations, Bull. Amer. Math. Soc. (N.S.) 27 (1992), no. 1, 1–67. MR 1118699, DOI 10.1090/S0273-0979-1992-00266-5 Kass-Ter1 A. Witkin M. Kass and D. Terzopoulos, Snakes: active contour models, Int. Journal of Computer Vision 1 (1987), 321–331. maes1997-rigidRegistrationMI F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens, Multimodality image registration by maximization of mutual information, IEEE Transactions on Medical Imaging 16 (1997), no. 2, 187–198. maintz1998-surveyRegistration J. Maintz and M. Viergever, A survey of medical image registration, Medical Image Analysis 2 (1998), no. 1, 1–36.
- Stéphane Mallat, A wavelet tour of signal processing, Academic Press, Inc., San Diego, CA, 1998. MR 1614527 marr1982-book D. Marr, Vision, Freeman, San Francisco, 1982. marr1980-edgeDetector D. Marr and E. Hildreth, Theory of edge detection, Proc. Royal Soc. Lond. B (1980), no. 207, 187–217. McCann:thesis R. McCann, A convexity theory for interacting gases and equilibrium crystals, Ph.D. Thesis, Princeton University, 1994. Ter-iccv T. McInerney and D. Terzopoulos, Topologically adaptable snakes, Int. Conf. on Computer Vision (Cambridge, MA), June 1995, pp. 840–845. mcinerney1996-deformableModelsSurvey —, Deformable models in medical image analysis: a survey, Medical Image Analysis 1 (1996), no. 2, 91–108.
- J. Milnor, Morse theory, Annals of Mathematics Studies, No. 51, Princeton University Press, Princeton, N.J., 1963. Based on lecture notes by M. Spivak and R. Wells. MR 0163331
- Jean-Michel Morel and Sergio Solimini, Variational methods in image segmentation, Progress in Nonlinear Differential Equations and their Applications, vol. 14, Birkhäuser Boston, Inc., Boston, MA, 1995. With seven image processing experiments. MR 1321598, DOI 10.1007/978-1-4684-0567-5
- Bart M. ter Haar Romeny (ed.), Geometry-driven diffusion in computer vision, Computational Imaging and Vision, vol. 1, Kluwer Academic Publishers, Dordrecht, 1994. MR 1339987, DOI 10.1007/978-94-017-1699-4 mumford1985-existence D. Mumford and J. Shah, Boundary detection by minimizing functionals, IEEE Conference on Computer Vision and Pattern Recognition, 1985, pp. 22–26.
- David Mumford and Jayant Shah, Optimal approximations by piecewise smooth functions and associated variational problems, Comm. Pure Appl. Math. 42 (1989), no. 5, 577–685. MR 997568, DOI 10.1002/cpa.3160420503
- Stanley Osher and Ronald P. Fedkiw, Level set methods: an overview and some recent results, J. Comput. Phys. 169 (2001), no. 2, 463–502. MR 1836523, DOI 10.1006/jcph.2000.6636
- Stanley Osher and James A. Sethian, Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations, J. Comput. Phys. 79 (1988), no. 1, 12–49. MR 965860, DOI 10.1016/0021-9991(88)90002-2
- Jacob Palis Jr. and Welington de Melo, Geometric theory of dynamical systems, Springer-Verlag, New York-Berlin, 1982. An introduction; Translated from the Portuguese by A. K. Manning. MR 669541 penney1998-similarityRegistration G.P. Penney, J. Weese, J.A. Little, P. Desmedt, D.L.O Hill, and D.J. Hawkes, A comparison of similarity measures for use in 2-D-3-D medical image registration, IEEE Transactions on Medical Imaging 17 (1998), no. 4, 586–595. Perona1990 P. Perona and J. Malik, Scale-space and edge detection using anisotropic diffusion, IEEE Trans. Pattern Anal. Machine Intell. 12 (1990), 629–639. pichon2003 E. Pichon, A. Tannenbaum, and R. Kikinis, Statistically based flow for image segmentation, Medical Imaging Analysis 8 (2004), 267–274. pluim2003-specialIssueRegistration J.P.W Pluim and J.M. Fitzpatrick (Editors), Special issue on image registration, IEEE Transactions on Medical Imaging 22 (2003), no. 11. pluim2003-registrationMIsurvey J.P.W Pluim, J.B.A. Maintz, and M.A. Viergever, Mutual-information-based registration of medical images: a survey, IEEE Transactions on Medical Imaging 22 (2003), no. 8, 986–1004. Malladi J. Sethian R. Malladi and B. Vemuri, Shape modeling with front propagation: a level set approach, IEEE Trans. Pattern Anal. Machine Intell. 17 (1995), 158–175. Rachev S. Rachev and L. Rüschendorf, Mass transportation problems, Springer, 1998. historyRadiology Radiology Centennial Inc., A century of radiology, http:www.xray.hmc.psu.edu/rci/centennial.html. roberts1965-edgeDetector L. Roberts, Optical and electro-optical information processing, ch. Machine perception of 3-D solids, MIT Press, 1965. roentgen1898-xrays W.C. Roentgen, Ueber eine neue Art von Strahlen, Annalen der Physik 64 (1898), 1–37.
- Guillermo Sapiro, Geometric partial differential equations and image analysis, Cambridge University Press, Cambridge, 2001. MR 1813971, DOI 10.1017/CBO9780511626319 Sapiro19923 G. Sapiro and A. Tannenbaum, Affine invariant scale-space, International Journal of Computer Vision 11 (1993), no. 1, 25–44.
- Guillermo Sapiro and Allen Tannenbaum, On invariant curve evolution and image analysis, Indiana Univ. Math. J. 42 (1993), no. 3, 985–1009. MR 1254129, DOI 10.1512/iumj.1993.42.42046
- Guillermo Sapiro and Allen Tannenbaum, On affine plane curve evolution, J. Funct. Anal. 119 (1994), no. 1, 79–120. MR 1255274, DOI 10.1006/jfan.1994.1004
- J. A. Sethian, Fast marching methods, SIAM Rev. 41 (1999), no. 2, 199–235. MR 1684542, DOI 10.1137/S0036144598347059 siddiqi1998 K. Siddiqi, Y. Lauziere, A. Tannenbaum, and S. Zucker, Area and length minimizing flows for shape segmentation, IEEE TMI 7 (1998), 433–443.
- Leon Simon, Lectures on geometric measure theory, Proceedings of the Centre for Mathematical Analysis, Australian National University, vol. 3, Australian National University, Centre for Mathematical Analysis, Canberra, 1983. MR 756417 sobel1970-edgeDetector I.E. Sobel, Camera models and machine perception, Ph.D. thesis, Stanford Univ., 1970. sonka1998-imageProc M. Sonka, V. Hlavac, and R. Boyle, Image processing: Analysis and machine vision, 2nd ed., Brooks Cole, 1998. slicer 3D Slicer, http://slicer.org. Toga A. Toga, Brain warping, Academic Press, San Diego, 1999. Tsai A. Tsai, A. Yezzi, and A. Willsky, A curve evolution approach to smoothing and segmentation using the Mumford-Shah functional, CVPR (2000), 1119–1124. heydt1984-contoursPsychophysics R. von de Heydt and E. Peterhans, Illusory contours and cortical neuron responses, Science 224 (1984), no. 4654, 1260–1262.
- Brian White, Some recent developments in differential geometry, Math. Intelligencer 11 (1989), no. 4, 41–47. MR 1016106, DOI 10.1007/BF03025885 witkin1983 A. P. Witkin, Scale-space filtering, Int. Joint. Conf. Artificial Intelligence (1983), 1019–1021. Lei:thesis L. Zhu, On visualizing branched surfaces: An angle/area preserving approach, Ph.D. thesis, Department of Biomedical Engineering, Georgia Institute of Technology, 2004.
Additional Information
- Sigurd Angenent
- Affiliation: Department of Mathematics, University of Wisconsin-Madison, Madison, Wisconsin 53706
- MR Author ID: 26245
- ORCID: 0000-0003-3515-4539
- Email: angenent@math.wisc.edu
- Eric Pichon
- Affiliation: Department of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0250
- Email: eric@ece.gatech.edu.
- Allen Tannenbaum
- Affiliation: Departments of Electrical and Computer and Biomedical Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0250
- Email: tannenba@ece.gatech.edu.
- Received by editor(s): June 15, 2005
- Received by editor(s) in revised form: September 22, 2005
- Published electronically: April 28, 2006
- Additional Notes: The authors would like to thank Steven Haker, Ron Kikinis, Guillermo Sapiro, Anthony Yezzi, and Lei Zhu for many helpful conversations on medical imaging and to Bob McElroy for proofreading the final document.
This research was supported by grants from the NSF, NIH (NAC P41 RR-13218 through Brigham and Women’s Hospital), and the Technion, Israel Institute of Technology. This work was done under the auspices of the National Alliance for Medical Image Computing (NAMIC), funded by the National Institutes of Health through the NIH Roadmap for Medical Research, Grant U54 EB005149. - © Copyright 2006
American Mathematical Society
The copyright for this article reverts to public domain 28 years after publication. - Journal: Bull. Amer. Math. Soc. 43 (2006), 365-396
- MSC (2000): Primary 92C55, 94A08, 68T45; Secondary 35K55, 35K65
- DOI: https://doi.org/10.1090/S0273-0979-06-01104-9
- MathSciNet review: 2223011