PPMDS: A Distributed Metadata Server Based on Nonblocking Transactions

Kohei Hiraga, Osamu Tatebe, Hideyuki Kawashima

研究成果: Conference contribution

3 被引用数 (Scopus)

抄録

There is a critical problem of metadata performance scalability in high-performance computing when accessing many small files from millions of clients. This paper proposes a design of PPMDS, a scalable distributed metadata server, to improve metadata performance and scalability. To efficiently manage hierarchical namespace of file system across multiple servers, it manages inode entries using a parent inode number and an entry name as a key. To update multiple inode entries atomically, it uses a nonblocking distributed transaction based on an algorithm of dynamic software transactional memory. It improves the metadata performance by introducing server-side transaction processing, multi-reader, and a shared lock mode to reduce the number of remote procedure calls and to prevent unnecessary blocking. A prototype implementation achieves 62,000 operations per second when creating files in a single directory using 8 metadata servers, which is 2.58x performance improvement compared to a single metadata performance.

本文言語English
ホスト出版物のタイトル2018 5th International Conference on Social Networks Analysis, Management and Security, SNAMS 2018
出版社Institute of Electrical and Electronics Engineers Inc.
ページ202-208
ページ数7
ISBN(電子版)9781538695883
DOI
出版ステータスPublished - 2018 11 30
イベント5th International Conference on Social Networks Analysis, Management and Security, SNAMS 2018 - Valencia, Spain
継続期間: 2018 10 152018 10 18

出版物シリーズ

名前2018 5th International Conference on Social Networks Analysis, Management and Security, SNAMS 2018

Other

Other5th International Conference on Social Networks Analysis, Management and Security, SNAMS 2018
国/地域Spain
CityValencia
Period18/10/1518/10/18

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • 情報システムおよび情報管理
  • 安全性、リスク、信頼性、品質管理
  • 通信

フィンガープリント

「PPMDS: A Distributed Metadata Server Based on Nonblocking Transactions」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル