MLMG: Multi-Local and Multi-Global Model Aggregation for Federated Learning

Yang Qin, Masaaki Kondo

研究成果: Conference contribution

2 被引用数 (Scopus)

抄録

Federated learning has attracted much interest and attention as a solution to collaboratively learn a prediction model without sharing the training data of users. Existing federated learning approaches usually develop a single independent local model for each client to train their privacy-sensitive data, afterward adopt a single centralized global model to exchange the trained parameters of clients that participate in federated training. However, given the diverse characteristics of local data and the heterogeneity across participating clients, the conventional federated learning paradigm may not achieve uniformly good performance over all users. In this work, we propose a novel federated learning mechanism which suggests using a Multi-Local and Multi-Global (MLMG) model aggregation to train the non-IID user data with clustering methods. Then a Matching algorithm is introduced to derive the appropriate exchanges between local models and global models. The new federated learning mechanism helps separate the data and user with different characteristics, thus makes it easier to capture the heterogeneity of data distributions across the users. We choose the latest on-device neural network for anomaly detection to evaluate the proposal, and experimental results based on several benchmark datasets demonstrate better detection accuracy (up to 2.83% accuracy improvement) of the novel paradigm compared with a conventional federated learning approach.

本文言語English
ホスト出版物のタイトル2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2021
出版社Institute of Electrical and Electronics Engineers Inc.
ページ565-571
ページ数7
ISBN(電子版)9781665404242
DOI
出版ステータスPublished - 2021 3月 22
外部発表はい
イベント2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2021 - Kassel, Germany
継続期間: 2021 3月 222021 3月 26

出版物シリーズ

名前2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2021

Conference

Conference2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2021
国/地域Germany
CityKassel
Period21/3/2221/3/26

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • ハードウェアとアーキテクチャ
  • ソフトウェア

フィンガープリント

「MLMG: Multi-Local and Multi-Global Model Aggregation for Federated Learning」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル