Request Distribution for Heterogeneous Database Server Clusters with Processing Time Estimation

Minato Omori, Hiroaki Nishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recently, data traffic on the Internet has increased due to the rapid growth of various Internet-based services. The convergence of user requests means that servers are overloaded. To solve this problem, service providers generally install multiple servers and distribute requests using a load balancer. The existing load balancing algorithms do not estimate the size of the load of unknown requests. However, the requested contents are heterogeneous and complex, so the size of the load is dependent on the servers and the contents of the requests. In this study, we propose a load balancing algorithm that distributes the requests based on estimates of the processing time, which avoids mismatches between the characteristics of servers and the request contents. The processing time for requests is estimated based on the requested contents by online machine learning, and a strategy to cover the latency of machine learning is proposed and partially conducted. To test the algorithm, we built a model of multiple database servers and performed an experiment using real log data for database requests. The simulation results showed that the proposed algorithm reduced the average processing time for requests by 94.5% compared with round robin and by 28.3% compared with least connections.

Original languageEnglish
Title of host publicationProceedings - IEEE 16th International Conference on Industrial Informatics, INDIN 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages278-283
Number of pages6
ISBN (Electronic)9781538648292
DOIs
Publication statusPublished - 2018 Sep 24
Event16th IEEE International Conference on Industrial Informatics, INDIN 2018 - Porto, Portugal
Duration: 2018 Jul 182018 Jul 20

Other

Other16th IEEE International Conference on Industrial Informatics, INDIN 2018
CountryPortugal
CityPorto
Period18/7/1818/7/20

Keywords

  • Database server
  • Load balancing
  • Online machine learning
  • Processing time estimation

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Information Systems and Management
  • Industrial and Manufacturing Engineering

Fingerprint Dive into the research topics of 'Request Distribution for Heterogeneous Database Server Clusters with Processing Time Estimation'. Together they form a unique fingerprint.

Cite this