Projection-Based Regularized Dual Averaging for Stochastic Optimization

Asahi Ushio, Masahiro Yukawa

    研究成果: Article

    2 引用 (Scopus)

    抜粋

    We propose a novel stochastic-optimization framework based on the regularized dual averaging (RDA) method. The proposed approach differs from the previous studies of RDA in three major aspects. First, the squared-distance loss function to a 'random' closed convex set is employed for stability. Second, a sparsity-promoting metric (used implicitly by a certain proportionate-type adaptive filtering algorithm) and a quadratically-weighted \ell -1 regularizer are used simultaneously. Third, the step size and regularization parameters are both constant due to the smoothness of the loss function. These three differences yield an excellent sparsity-seeking property, high estimation accuracy, and insensitivity to the choice of the regularization parameter. Numerical examples show the remarkable advantages of the proposed method over the existing methods (including AdaGrad and the adaptive proximal forward-backward splitting method) in applications to regression and classification with real/synthetic data.

    元の言語English
    記事番号8680689
    ページ(範囲)2720-2733
    ページ数14
    ジャーナルIEEE Transactions on Signal Processing
    67
    発行部数10
    DOI
    出版物ステータスPublished - 2019 5 15

    ASJC Scopus subject areas

    • Signal Processing
    • Electrical and Electronic Engineering

    フィンガープリント Projection-Based Regularized Dual Averaging for Stochastic Optimization' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用