Ana I.P.N. Pereira *
Edite M.G.P. Fernandes †
* Departamento de Matemática, Instituto Politécnico de Bragança
† Departamento de Produção e Sistemas, Universidade do Minho
Title: Performance of the truncated Newton method in unconstrained nonlinear optimization
]]> Abstract:Newton's method for unconstrained nonlinear optimization can be a demanding iterative process. Combining Krylov iterative methods with different termination criteria for the inexact solving of the Newton system, a linear or a curvilinear search technique and monotone and nonmonotone globalization criteria, we manage to define a set of truncated Newton algorithms. Computational experiments were carried out in order to evaluate the performance of the defined algorithms.
Keywords: Unconstrained optimization, truncated Newton's method, nonmonotone stabilization technique.
Resumo:
O método de Newton para a resolução de um problema de optimização não linear sem restrições pode originar um processo iterativo exigente. Combinando métodos iterativos de Krylov com diferentes critérios de terminação para a resolução inexacta do sistema Newton, uma técnica de procura que pode ser linear ou curvilínea e critérios de globalização monótonos e não monótonos, conseguimos definir um conjunto de algoritmos do método de Newton truncado. Foram realizadas experiências computacionais para avaliar o desempenho dos diferentes algoritmos.
Texto completo apenas disponível em PDF.
Full text only available in PDF format.
]]>Bibliography
1. R. S. Dembo e T. Steihaug, Truncated-Newton Algorithms for Large-Scale Unconstrained Optimization,Mathematical Programming, Vol. 26, pp. 190-212, 1983. [ Links ]
2. J. E. Dennis Jr e R. B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall Inc., New Jersey, 1983. [ Links ]
3. E. M. G. P. Fernandes, Computação Numérica, 2ª edição, Universidade do Minho, 1998. [ Links ]
4. M. C. Ferris, S. Lucidi e M. Roma, Nonmonotone Curvilinear Line Search Methods for Unconstrained Optimization, Computational Optimization and Applications, Vol. 6, pp. 117-136, 1996. [ Links ]
5. D. Goldfarb, Curvilinear Path Steplength Algorithms for Minimization which Use Directions of Negative Curvature, Mathematical Programming, Vol. 18, pp. 31-40, 1980. [ Links ]
6. G. H. Golub e C. F. Van Loan, Matrix Computations, The Johns Hopkins University Press, 1983. [ Links ]
7. N. I. M. Gould, S. Lucidi, M. Roma e P. L. Toint, Solving the Trust-Region Subproblem Using the Lanczos Method, SIAM Journal on Optimization, Vol. 9, Nº 2, pp. 504-525, 1999. [ Links ]
8. A. Greenbaum, Iterative Methods for Solving Linear Systems,SIAM, 1997. [ Links ]
9. L. Grippo, F. Lampariello e S. Lucidi, A Nonmonotone Line Search Technique for Newton's Method, SIAM Journal on Numerical Analysis, Vol. 23, pp. 707-716, 1986. [ Links ]
10. L. Grippo, F. Lampariello e S. Lucidi, A Class of Nonmonotone Stabilization Methods in Unconstrained Optimization, Numerische Mathematik, Vol. 59, pp. 779-805, 1991. [ Links ]
11. W. Hackbusch, Iterative Solution of Large Sparse Systems of Equations, Applied Mathematical Sciences, 95, Springer-Verlag, 1994. [ Links ]
12. W. Hock e K. Schittkowski, Test Examples for Nonlinear Programming Codes, Springer-Verlag, 1981. [ Links ]
13. C. T. Kelley, Iterative Methods for Linear and Nonlinear Equations, Frontiers in Applied Mathematics, Vol. 16, SIAM, 1995. [ Links ]
14. C. T. Kelley, Iterative Methods for Optimization, Frontiers in Applied Mathematics, SIAM, 1999. [ Links ]
15. S. Lucidi e M. Roma, Numerical Experiences with New Truncated Newton Methods in Large Scale Uncontrained Optimization, Computational Optimization and Applications, Vol. 7. pp 71-87, 1997. [ Links ]
16. G. P. McCormick, A Modification of Armijo's Step-size Rule for Negative Curvature, Mathematical Programming, Vol. 13, pp. 111-115, 1977. [ Links ]
17. J. J. Moré e D. C. Sorensen, On the Use of Directions of Negative Curvature in a Modified Newton Method, Mathematical Programming, Vol. 16, pp. 1-20, 1979. [ Links ]
18. S. G. Nash e A. Sofer, Linear and Nonlinear Programming, McGraw-Hill, 1996. [ Links ]
19. J. Nocedal e S. J. Wright, Numerical Optimization, Springer Series in Operations Research, 1999. [ Links ]
20. J. M. Ortega e W. C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press Inc., New York, 1970. [ Links ]
21. C. C. Paige e M. A. Saunders, Solution of Sparse Indefinite Systems of Linear Equations, SIAM Journal on Numerical Analysis, Vol. 12, Nº 4, pp. 617-629, 1975. [ Links ]
22. A. I. P. N. Pereira, Estudo e Desempenho do Método de Newton Truncado em Optimização, Tese de mestrado, Universidade do Minho, 2000. [ Links ]
23. K. Schittkowski, More Test Examples for Nonlinear Programming Codes, Lectures Notes in Economics and Mathematical Systems, Springer-Verlag, 1987. [ Links ]
24. M. A. Wolfe, Numerical Methods for Unconstrained Optimization, Van Nostrand Reinholds Company, 1978. [ Links ]
]]>