Motion detection in diffraction tomography by common circle methods

Quellmalz, Michael; Elbau, Peter; Scherzer, Otmar; Steidl, Gabriele

doi:10.1090/mcom/3869

Motion detection in diffraction tomography by common circle methods
HTML articles powered by AMS MathViewer

by Michael Quellmalz, Peter Elbau, Otmar Scherzer and Gabriele Steidl

Math. Comp. 93 (2024), 747-784

DOI: https://doi.org/10.1090/mcom/3869

Published electronically: July 5, 2023

HTML | PDF | Request permission

Abstract:

The method of common lines is a well-established reconstruction technique in cryogenic electron microscopy (cryo-EM), which can be used to extract the relative orientations of an object given tomographic projection images from different directions.

In this paper, we deal with an analogous problem in optical diffraction tomography. Based on the Fourier diffraction theorem, we show that rigid motions of the object, i.e., rotations and translations, can be determined by detecting common circles in the Fourier-transformed data. We introduce two methods to identify common circles. The first one is motivated by the common line approach for projection images and detects the relative orientation by parameterizing the common circles in the two images. The second one assumes a smooth motion over time and calculates the angular velocity of the rotational motion via an infinitesimal version of the common circle method. Interestingly, using the stereographic projection, both methods can be reformulated as common line methods, but these lines are, in contrast to those used in cryo-EM, not confined to pass through the origin and allow for a full reconstruction of the relative orientations. Numerical proof-of-the-concept examples demonstrate the performance of our reconstruction methods.

References

P.-A. Absil, R. Mahony, and R. Sepulchre, Optimization algorithms on matrix manifolds, Princeton University Press, Princeton, NJ, 2008. With a foreword by Paul Van Dooren. MR 2364186, DOI 10.1515/9781400830244
Robert Beinert and Michael Quellmalz, Total variation-based reconstruction and phase retrieval for diffraction tomography, SIAM J. Imaging Sci. 15 (2022), no. 3, 1373–1399. MR 4469512, DOI 10.1137/22M1474382
T. Bendory, A. Bartesaghi, and A. Singer, Single-particle cryo-electron microscopy: Mathematical theory, computational challenges, and opportunities, IEEE Signal Process. Mag., 37 (2020), no. 2, 58–76.
G. Bortel and M. Tegze, Common arc method for diffraction pattern orientation, Acta Cryst. A67 (2011), 533–543.
David Colton and Rainer Kress, Inverse acoustic and electromagnetic scattering theory, 3rd ed., Applied Mathematical Sciences, vol. 93, Springer, New York, 2013. MR 2986407, DOI 10.1007/978-1-4614-4942-3
A. Devaney, A filtered backpropagation algorithm for diffraction tomography, Ultrason. Imaging, 4 (1982), no. 4, 336–350.
K. Dholakia, B. W. Drinkwater, and M. Ritsch-Marte, Comparing acoustic and optical forces for biomedical research, Nat. Rev. Phys., 2 (2020), no. 9, 480–491.
Peter Elbau, Monika Ritsch-Marte, Otmar Scherzer, and Denise Schmutz, Motion reconstruction for optical tomography of trapped objects, Inverse Problems 36 (2020), no. 4, 044004, 25. MR 4075190, DOI 10.1088/1361-6420/ab67db
Florian Faucher, Clemens Kirisits, Michael Quellmalz, Otmar Scherzer, and Eric Setterqvist, Diffraction tomography, Fourier reconstruction, and full waveform inversion, Handbook of mathematical models and algorithms in computer vision and imaging—mathematical imaging and vision, Springer, Cham, [2023] ©2023, pp. 273–312. MR 4572600, DOI 10.1007/978-3-030-98661-2_{1}15
Markus Fenn, Stefan Kunis, and Daniel Potts, On the computation of the polar FFT, Appl. Comput. Harmon. Anal. 22 (2007), no. 2, 257–263. MR 2295298, DOI 10.1016/j.acha.2006.05.009
Ernst Hairer, Christian Lubich, and Gerhard Wanner, Geometric numerical integration, 2nd ed., Springer Series in Computational Mathematics, vol. 31, Springer-Verlag, Berlin, 2006. Structure-preserving algorithms for ordinary differential equations. MR 2221614
Marzieh Hasannasab, Johannes Hertrich, Sebastian Neumayer, Gerlind Plonka, Simon Setzer, and Gabriele Steidl, Parseval proximal neural networks, J. Fourier Anal. Appl. 26 (2020), no. 4, Paper No. 59, 31. MR 4120056, DOI 10.1007/s00041-020-09761-7
G. Huldt, A. Szőke, and J. Hajdu, Diffraction imaging of single particles and biomolecules, J. Struct. Biol., 144 (2003), no. 1, 219–227.
K. Itoh, Analysis of the phase unwrapping problem, Appl. Optics 21 (1982), no. 14.
P. H. Jones, O. M. Maragò, and G. Volpe, Optical Tweezers, Cambridge University Press, Cambridge, 2015.
Avinash C. Kak and Malcolm Slaney, Principles of computerized tomographic imaging, Classics in Applied Mathematics, vol. 33, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2001. Reprint of the 1988 original. MR 1850949, DOI 10.1137/1.9780898719277
Z. Kam, The reconstruction of structure from electron micrographs of randomly oriented particles, J. Theoret. Biol. 82 (1980), no. 1, 15–39.
J. Keiner, S. Kunis, and D. Potts, NFFT 3.5, C subroutine library, https://www.tu-chemnitz.de/~potts/nfft. Contributors: F. Bartel, M. Fenn, T. Görner, M. Kircheis, T. Knopp, M. Quellmalz, M. Schmischke, T. Volkmer, A. Vollrath, 2022.
Jens Keiner, Stefan Kunis, and Daniel Potts, Using NFFT 3—a software library for various nonequispaced fast Fourier transforms, ACM Trans. Math. Software 36 (2009), no. 4, Art. 19, 30. MR 2738200, DOI 10.1145/1555386.1555388
Jaakko Ketola and Lars Lamberg, An algorithm for recovering unknown projection orientations and shifts in 3-D tomography, Inverse Probl. Imaging 5 (2011), no. 1, 75–93. MR 2773426, DOI 10.3934/ipi.2011.5.75
Clemens Kirisits, Michael Quellmalz, Monika Ritsch-Marte, Otmar Scherzer, Eric Setterqvist, and Gabriele Steidl, Fourier reconstruction for diffraction tomography of an object rotated into arbitrary orientations, Inverse Problems 37 (2021), no. 11, Paper No. 115002, 37. MR 4331236, DOI 10.1088/1361-6420/ac2749
P. Kurlberg and G. Zickert, Formal uniqueness in Ewald sphere corrected single particle analysis, arXiv:2104.05371, 2021.
M. Kvåle Løvmo, B. Pressl, G. Thalhammer, and M. Ritsch-Marte, Controlled orientation and sustained rotation of biological samples in a sono-optical microfluidic device, Lab on a Chip 21 (2021), no 8, 1563–1578.
Jeffrey C. Lagarias, James A. Reeds, Margaret H. Wright, and Paul E. Wright, Convergence properties of the Nelder-Mead simplex method in low dimensions, SIAM J. Optim. 9 (1999), no. 1, 112–147. MR 1662563, DOI 10.1137/S1052623496303470
L. D. Landau and E. M. Lifshitz, Course of theoretical physics. Vol. 1, 3rd ed., Pergamon Press, Oxford-New York-Toronto, 1976. Mechanics; Translated from the Russian by J. B. Skyes and J. S. Bell. MR 475051
Maher Moakher, Means and averaging in the group of rotations, SIAM J. Matrix Anal. Appl. 24 (2002), no. 1, 1–16. MR 1920548, DOI 10.1137/S0895479801383877
P. Müller, M. Schürmann, and J. Guck, The theory of diffraction tomography, 2015. arXiv:1507.00466v3.
Frank Natterer and Frank Wübbeling, Mathematical methods in image reconstruction, SIAM Monographs on Mathematical Modeling and Computation, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2001. MR 1828933, DOI 10.1137/1.9780898718324
Gerlind Plonka, Daniel Potts, Gabriele Steidl, and Manfred Tasche, Numerical Fourier analysis, Applied and Numerical Harmonic Analysis, Birkhäuser/Springer, Cham, 2018. MR 3890075, DOI 10.1007/978-3-030-04306-3
D. Schmutz, Reconstruction of projection orientations in cryo-electron microscopy, 2017. Master’s thesis, University of Vienna.
Nir Sharon, Joe Kileel, Yuehaw Khoo, Boris Landa, and Amit Singer, Method of moments for 3D single particle ab initio modeling with non-uniform distribution of viewing angles, Inverse Problems 36 (2020), no. 4, 044003, 40. MR 4072349, DOI 10.1088/1361-6420/ab6139
A. Singer, R. R. Coifman, F. J. Sigworth, D. W. Chester, and Y. Shkolnisky, Detecting consistent common lines in cryo-EM by voting, J. Struct. Biol., 169 (2010), no. 3, 312–322.
Gabriele Steidl, A note on fast Fourier transforms for nonequispaced grids, Adv. Comput. Math. 9 (1998), no. 3-4, 337–352. MR 1662302, DOI 10.1023/A:1018901926283
G. Thalhammer, R. Steiger, M. Meinschad, M. Hill, S. Bernet, and M. Ritsch-Marte, Combined acoustic and optical trapping, Biomed. Optics Express 2 (2011), no. 10, 2859–2870.
M. van Heel, Angular reconstitution: a posteriori assignment of projection directions for 3d reconstruction, Ultramicroscopy 21 (1987), no. 2, 111–123.
M. van Heel, B. Gowen, R. Matadeen, E. V. Orlova, R. Finn, T. Pape, D. Cohen, H. Stark, R. Schmidt, M. Schatz, and A. Patwardhan, Single-particle electron cryo-microscopy: towards atomic resolution, Q. Rev. Biophys. 33 (2000), no. 4, 307–369.
Lanhui Wang, Amit Singer, and Zaiwen Wen, Orientation determination of cryo-EM images using least unsquared deviations, SIAM J. Imaging Sci. 6 (2013), no. 4, 2450–2483. MR 3134423, DOI 10.1137/130916436
E. Wolf, Three-dimensional structure determination of semi-transparent objects from holographic data, Optics Commun. 1 (1969), 153–156.