Mathematics of Computation

Author(s): Peter Eberhard; Christian Bischof.
Journal: Math. Comp. 68 (1999), 717-731.
MSC (1991): Primary 34A12, 65L05, 65L06; Secondary 68N99
Retrieve article in: PDF
This article is available free of charge

Abstract: Automatic differentiation (AD) is a technique for automatically augmenting computer programs with statements for the computation of derivatives. This article discusses the application of automatic differentiation to numerical integration algorithms for ordinary differential equations (ODEs), in particular, the ramifications of the fact that AD is applied not only to the solution of such an algorithm, but to the solution procedure itself. This subtle issue can lead to surprising results when AD tools are applied to variable-stepsize, variable-order ODE integrators. The computation of the final time step plays a special role in determining the computed derivatives. We investigate these issues using various integrators and suggest constructive approaches for obtaining the desired derivatives.

1.: Martin Berz, Christian Bischof, George Corliss, and Andreas Griewank, Computational differentiation: Techniques, applications, and tools, SIAM, Philadelphia, 1996. MR 97h:65005
2.: Dieter Bestle and Peter Eberhard, Analyzing and optimizing multibody systems, Mechanical Structures and Machinery 20 (1992), no. 1, 67-92.
3.: Christian H. Bischof and Mohammad R. Haghighat, On hierarchical differentiation, Computational Differentiation: Techniques, Applications, and Tools (Martin Berz, Christian Bischof, George Corliss, and Andreas Griewank, eds.), SIAM, Philadelphia, 1996, pp. 83-94.
4.: Christian Bischof, Alan Carle, Peyvand Khademi, and Andrew Mauer, ADIFOR 2.0: Automatic differentiation of Fortran 77 programs, IEEE Computational Science & Engineering 3 (1996), no. 3, 18-32.
5.: Christian Bischof, Lucas Roh, and Andrew Mauer, ADIC - An extensible automatic differentiation tool for ANSI-C, Software-Practice and Experience 27 (1997), no. 12, 1427-1456.
6.: John C. Butcher, The numerical analysis of ordinary differential equations (Runge-Kutta and general linear methods), John Wiley and Sons, New York, 1987. MR 88d:65002
7.: J. Cash and A. Karp, A variable order Runge-Kutta method for initial value problems with rapidly varying right-hand sides, ACM Transactions on Mathematical Software 16 (1990), no. 3, 201-222. CMP 91:01
8.: Evin Cramer, Paul Frank, Gregory Shubin, John Dennis, and Robert Michael Lewis, Problem formulations for multidisciplinary optimization, SIAM J. Optimization 4 (1994), no. 4, 754-776. MR 95h:90002
9.: Peter Eberhard, Zur Mehrkriterienoptimierung von Mehrkörpersystemen, VDI Fortschritt-Berichte 11 (1996), no. 227.
10.: Andreas Griewank, Christian Bischof, George Corliss, Alan Carle, and Karen Williamson, Derivative convergence of iterative equation solvers, Optimization Methods and Software 2 (1993), 321-355.
11.: Andreas Griewank and Shawn Reese, On the calculation of Jacobian matrices by the Markowitz rule, Automatic Differentiation of Algorithms: Theory, Implementation, and Application (Andreas Griewank and George F. Corliss, eds.), SIAM, Philadelphia, 1991, pp. 126-135. MR 92i:65223
12.: Andreas Griewank, On automatic differentiation, Mathematical Programming: Recent Developments and Applications (Amsterdam), Kluwer Academic Publishers, 1989, pp. 83-108. MR 92k:65002
13.: E. Hairer, S. P. Nørsett, and G. Wanner, Solving ordinary differential equations I: Nonstiff problems, Springer Verlag, New York, 1987. MR 87m:65005
14.: E. Hairer and G. Wanner, Solving ordinary differential equations II: Stiff and differential-algebraic problems, Springer Series in Computational Mathematics, vol. 14, Springer-Verlag, New York, 1991. MR 92a:65016
15.: Alan Hindmarsh, ODEPACK, a systematized collection of ODE solvers, pp. 55-64, North-Holland, Amsterdam, 1983. CMP 16:15
16.: William H. Press, Saul A. Teukolsky, William T. Vetterling, and Brian P. Flannery, Numerical recipes in Fortran: The art of scientific computing, 2nd ed., Cambridge University Press, 1992. MR 93i:65001a
17.: Louis B. Rall, Automatic differentiation: Techniques and applications, Lecture Notes in Computer Science, vol. 120, Springer Verlag, Berlin, 1981.
18.: A. Sandu, G. R. Carmichael, and F. A. Potra, Sensitivity analysis for atmospheric chemistry models via automatic differentiation, Atmospheric Environment 31 (1997), no. 3, 475-489.
19.: Granville Sewell, The numerical solution of ordinary and partial differential equations, Academic Press, San Diego, California, 1988. MR 89i:65001
20.: L. Shampine and M. Gordon, Computer solution of ordinary differential equations, Freeman, San Francisco, 1975. MR 57:18104
21.: J. Stoer and R. Bulirsch, Introduction to numerical analysis, Springer Verlag, New York, 1980. MR 83d:65002

Retrieve articles in Mathematics of Computation with MSC (1991): 34A12, 65L05, 65L06, 68N99

Peter Eberhard
Affiliation: Institute B of Mechanics, University of Stuttgart, 70550 Stuttgart, Germany
Email: pe@mechb.uni-stuttgart.de

Christian Bischof
Affiliation: Rheinisch-Westfälische Technische Hochschule Aachen, Seffenter Weg 23, D-52056 Aachen, Germany
Email: bischof@rz.rwth-aachen.de

DOI: 10.1090/S0025-5718-99-01027-3
PII: S 0025-5718(99)01027-3
Received by editor(s): November 11, 1996
Received by editor(s) in revised form: July 24, 1997
Additional Notes: This work was partially completed while the first author was visiting the Department of Mechanical Engineering at the University of California at Berkeley supported by the German Research Council (DFG) under grant EB195/1-1.
The second author was supported by the Mathematical, Information, and Computational Sciences Division subprogram of the Office of Computational and Technology Research, U.S. Department of Energy, under contract W-31-109-Eng-38.
Copyright of article: Copyright 1999, American Mathematical Society

			Journals Home Search Author Info Subscribe Tech Support Help
ISSN 1088-6842(e) ISSN 0025-5718(p)

Previous issue \| Table of contents \| Next issue Articles in press \| Recently posted articles \| Most recent issue \| All issues Previous Article \| Next Article


	Comments: webmaster@ams.org © Copyright 2009, American Mathematical Society Privacy Statement		Search the AMS