A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios

Masahiro Yukawa; Isao Yamada

doi:10.23919/APSIPA.2018.8659576

A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios

Masahiro Yukawa, Isao Yamada

Department of Electronics and Electrical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper, we analyze the properties of a fixed point of a certain mapping that is implicitly used in each of the regularized dual averaging (RDA) and projection-based RDA (PDA) algorithms. It turns out that, if the loss function has a nonexpansive (1-Lipschltz) gradient such as in the case of a half squared-distance function, RDA converges to a minimizer of the penalized loss function under a restrictive condition. Meanwhile, the fixed point for PDA gives a minimizer of the 'unpenalized' loss function. Some simulation studies are also presented to support the theoretical findings.

Original language	English
Title of host publication	2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	207-211
Number of pages	5
ISBN (Electronic)	9789881476852
DOIs	https://doi.org/10.23919/APSIPA.2018.8659576
Publication status	Published - 2019 Mar 4
Event	10th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Honolulu, United States Duration: 2018 Nov 12 → 2018 Nov 15

Publication series

Name	2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings

Conference

Conference	10th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018
Country	United States
City	Honolulu
Period	18/11/12 → 18/11/15

ASJC Scopus subject areas

Information Systems

Access to Document

10.23919/APSIPA.2018.8659576

Fingerprint Dive into the research topics of 'A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios'. Together they form a unique fingerprint.

Cite this

Yukawa, M., & Yamada, I. (2019). A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios. In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings (pp. 207-211). [8659576] (2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/APSIPA.2018.8659576

A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios. / Yukawa, Masahiro; Yamada, Isao.

2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. p. 207-211 8659576 (2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Yukawa, M & Yamada, I 2019, A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios. in 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings., 8659576, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings, Institute of Electrical and Electronics Engineers Inc., pp. 207-211, 10th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018, Honolulu, United States, 18/11/12. https://doi.org/10.23919/APSIPA.2018.8659576

Yukawa M, Yamada I. A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios. In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. p. 207-211. 8659576. (2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings). https://doi.org/10.23919/APSIPA.2018.8659576

Yukawa, Masahiro ; Yamada, Isao. / A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios. 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 207-211 (2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings).

@inproceedings{e367a4251ddc448b8f9808fbbf3b4068,

title = "A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios",

abstract = "In this paper, we analyze the properties of a fixed point of a certain mapping that is implicitly used in each of the regularized dual averaging (RDA) and projection-based RDA (PDA) algorithms. It turns out that, if the loss function has a nonexpansive (1-Lipschltz) gradient such as in the case of a half squared-distance function, RDA converges to a minimizer of the penalized loss function under a restrictive condition. Meanwhile, the fixed point for PDA gives a minimizer of the 'unpenalized' loss function. Some simulation studies are also presented to support the theoretical findings.",

author = "Masahiro Yukawa and Isao Yamada",

note = "Funding Information: ACKNOWLEDGMENT This work was supported in part by JSPS Grants-in-Aids (18H01446, 15K13986, 15H02757).; 10th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 ; Conference date: 12-11-2018 Through 15-11-2018",

year = "2019",

month = mar,

day = "4",

doi = "10.23919/APSIPA.2018.8659576",

language = "English",

series = "2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "207--211",

booktitle = "2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings",

}

TY - GEN

T1 - A Fixed-Point Analysis of Regularized Dual Averaging under Static Scenarios

AU - Yukawa, Masahiro

AU - Yamada, Isao

N1 - Funding Information: ACKNOWLEDGMENT This work was supported in part by JSPS Grants-in-Aids (18H01446, 15K13986, 15H02757).

PY - 2019/3/4

Y1 - 2019/3/4

N2 - In this paper, we analyze the properties of a fixed point of a certain mapping that is implicitly used in each of the regularized dual averaging (RDA) and projection-based RDA (PDA) algorithms. It turns out that, if the loss function has a nonexpansive (1-Lipschltz) gradient such as in the case of a half squared-distance function, RDA converges to a minimizer of the penalized loss function under a restrictive condition. Meanwhile, the fixed point for PDA gives a minimizer of the 'unpenalized' loss function. Some simulation studies are also presented to support the theoretical findings.

AB - In this paper, we analyze the properties of a fixed point of a certain mapping that is implicitly used in each of the regularized dual averaging (RDA) and projection-based RDA (PDA) algorithms. It turns out that, if the loss function has a nonexpansive (1-Lipschltz) gradient such as in the case of a half squared-distance function, RDA converges to a minimizer of the penalized loss function under a restrictive condition. Meanwhile, the fixed point for PDA gives a minimizer of the 'unpenalized' loss function. Some simulation studies are also presented to support the theoretical findings.

UR - http://www.scopus.com/inward/record.url?scp=85063503000&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063503000&partnerID=8YFLogxK

U2 - 10.23919/APSIPA.2018.8659576

DO - 10.23919/APSIPA.2018.8659576

M3 - Conference contribution

AN - SCOPUS:85063503000

T3 - 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings

SP - 207

EP - 211

BT - 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 10th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018

Y2 - 12 November 2018 through 15 November 2018

ER -