TY - JOUR
T1 - A memoryless symmetric rank-one method with sufficient descent property for unconstrained optimization
AU - Nakayama, Shummin
AU - Narushima, Yasushi
AU - Yabe, Hiroshi
N1 - Publisher Copyright:
© The Operations Research Society of Japan
Copyright:
Copyright 2018 Elsevier B.V., All rights reserved.
PY - 2018/1
Y1 - 2018/1
N2 - Quasi-Newton methods are widely used for solving unconstrained optimization problems. However, it is difficult to apply quasi-Newton methods directly to large-scale unconstrained optimization problems, because they need the storage of memories for matrices. In order to overcome this difficulty, memoryless quasi-Newton methods were proposed. Shanno (1978) derived the memoryless BFGS method. Recently, several researchers studied the memoryless quasi-Newton method based on the symmetric rank-one formula. However existing memoryless symmetric rank-one methods do not necessarily satisfy the sufficient descent condition. In this paper, we focus on the symmetric rank-one formula based on the spectral scaling secant condition and derive a memoryless quasi-Newton method based on the formula. Moreover we show that the method always satisfies the sufficient descent condition and converges globally for general objective functions. Finally, preliminary numerical results are shown.
AB - Quasi-Newton methods are widely used for solving unconstrained optimization problems. However, it is difficult to apply quasi-Newton methods directly to large-scale unconstrained optimization problems, because they need the storage of memories for matrices. In order to overcome this difficulty, memoryless quasi-Newton methods were proposed. Shanno (1978) derived the memoryless BFGS method. Recently, several researchers studied the memoryless quasi-Newton method based on the symmetric rank-one formula. However existing memoryless symmetric rank-one methods do not necessarily satisfy the sufficient descent condition. In this paper, we focus on the symmetric rank-one formula based on the spectral scaling secant condition and derive a memoryless quasi-Newton method based on the formula. Moreover we show that the method always satisfies the sufficient descent condition and converges globally for general objective functions. Finally, preliminary numerical results are shown.
KW - Memoryless quasi-Newton method
KW - Nonlinear programming
KW - Sufficient descent condition
KW - Symmetric rank-one formula
KW - Unconstrained optimization
UR - http://www.scopus.com/inward/record.url?scp=85040363909&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85040363909&partnerID=8YFLogxK
U2 - 10.15807/jorsj.61.53
DO - 10.15807/jorsj.61.53
M3 - Article
AN - SCOPUS:85040363909
SN - 0453-4514
VL - 61
SP - 53
EP - 70
JO - Journal of the Operations Research Society of Japan
JF - Journal of the Operations Research Society of Japan
IS - 1
ER -