WEKO3
アイテム
NII Technical Report (NII-2014-003E):Jacobian-Free Three-Level Trust Region Method for Nonlinear Least Squares Problems
https://doi.org/10.20736/0002000323
https://doi.org/10.20736/00020003231deb57c4-ab35-4912-b069-a31e1f127011
名前 / ファイル | ライセンス | アクション |
---|---|---|
![]() |
|
Item type | レポート / Report(1) | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
公開日 | 2022-06-08 | |||||||||||||
タイトル | ||||||||||||||
タイトル | NII Technical Report (NII-2014-003E):Jacobian-Free Three-Level Trust Region Method for Nonlinear Least Squares Problems | |||||||||||||
言語 | en | |||||||||||||
言語 | ||||||||||||||
言語 | eng | |||||||||||||
キーワード | ||||||||||||||
言語 | ja | |||||||||||||
主題Scheme | Other | |||||||||||||
主題 | テクニカルレポート | |||||||||||||
キーワード | ||||||||||||||
言語 | en | |||||||||||||
主題Scheme | Other | |||||||||||||
主題 | Technical Report | |||||||||||||
資源タイプ | ||||||||||||||
資源 | http://purl.org/coar/resource_type/c_6501 | |||||||||||||
タイプ | departmental bulletin paper | |||||||||||||
ID登録 | ||||||||||||||
ID登録 | 10.20736/0002000323 | |||||||||||||
ID登録タイプ | JaLC | |||||||||||||
著者 |
Xu, Wei
× Xu, Wei
× Zheng, Ning
× 速水, 謙
|
|||||||||||||
抄録 | ||||||||||||||
内容記述タイプ | Abstract | |||||||||||||
内容記述 | Nonlinear least squares (NLS) problems arise in many applications. The common solvers require to compute and store the corresponding Jacobian matrix explicitly, which is too expensive for large problems. In this paper, we propose an effective Jacobian free method especially for large NLS problems because of the novel combination of using automatic differentiation for J(x)v and JT (x)v along with the preconditioning ideas that do not require forming the Jacobian matrix J(x) explicitly. Together they yield a new and effective three-level iterative approach. In the outer level, the dogleg/trust region method is employed to solve the NLS problem. At each iteration of the dogleg method, we adopt the iterative linear least squares (LLS) solvers, CGLS or BA-GMRES method, to solve the LLS problem generated at each step of the dogleg method as the middle iteration. In order to accelerate the convergence of the iterative LLS solver, we propose an inner iteration preconditioner based on the weighted Jacobi method. Compared to the common dogleg solver and truncated Newton method, our proposed three level method need not compute the gradient or Jacobian matrix explicitly, and is efficient in computational complexity and memory storage. Furthermore, our method does not rely on the sparsity or structure pattern of the Jacobian, gradient or Hessian matrix. Thus, it can be applied to solve any large general NLS problem. Numerical experiments show that our proposed method is much superior to the common trust region method and truncated Newton method. | |||||||||||||
言語 | en | |||||||||||||
書誌情報 |
ja : NIIテクニカル・レポート en : NII Technical Report p. 1-22, 発行日 2014-09-25 |
|||||||||||||
出版者 | ||||||||||||||
出版者 | 国立情報学研究所 | |||||||||||||
言語 | ja | |||||||||||||
ISSN | ||||||||||||||
収録物識別子タイプ | ISSN | |||||||||||||
収録物識別子 | 1346-5597 |