TY - JOUR
T1 - Semi-Supervised Machine Learning Aided Anomaly Detection Method in Cellular Networks
AU - Lu, Yutao
AU - Wang, Juan
AU - Liu, Miao
AU - Zhang, Kaixuan
AU - Gui, Guan
AU - Ohtsuki, Tomoaki
AU - Adachi, Fumiyuki
N1 - Funding Information:
Manuscript received November 20, 2019; revised February 27, 2020; accepted May 13, 2020. Date of publication May 19, 2020; date of current version August 13, 2020. This work was supported in part by the Project Funded by the National Science and Technology Major Project of the Ministry of Science and Technology of China under Grant TC190A3WZ-2, in part by the National Natural Science Foundation of China under Grant 61671253, in part by the Innovation and Entrepreneurship of Jiangsu High-level Talent under Grant CZ0010617002, in part by the Six Top Talents Program of Jiangsu under Grant XYDXX-010, in part by the Project Supported by Chongqing Municipal Key Laboratory of Institutions of Higher Education under Grant cqupt-mct-201802, and in part by the 1311 Talent Plan of Nanjing University of Posts and Telecommunications. The review of this article was coordinated by Prof. I. Bisio. (Corresponding author: Guan Gui.) Yutao Lu, Juan Wang, Miao Liu, Kaixuan Zhang, and Guan Gui are with the FocusLab, College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210003, China (e-mail: 1019010403@njupt.edu.cn; 1219012920@njupt.edu.cn; liumiao@njupt.edu.cn; 1218012502@njupt.edu.cn; guiguan@njupt.edu.cn).
Publisher Copyright:
© 1967-2012 IEEE.
PY - 2020/8
Y1 - 2020/8
N2 - The ever-increasing amount of data in cellular networks poses challenges for network operators to monitor the quality of experience (QoE). Traditional key quality indicators (KQIs)-based hard decision methods are difficult to undertake the task of QoE anomaly detection in the case of big data. To solve this problem, in this paper, we propose a KQIs-based QoE anomaly detection framework using semi-supervised machine learning algorithm, i.e., iterative positive sample aided one-class support vector machine (IPS-OCSVM). There are four steps for realizing the proposed method while the key step is combining machine learning with the network operator's expert knowledge using OCSVM. Our proposed IPS-OCSVM framework realizes QoE anomaly detection through soft decision and can easily fine-Tune the anomaly detection ability on demand. Moreover, we prove that the fluctuation of KQIs thresholds based on expert knowledge has a limited impact on the result of anomaly detection. Finally, experiment results are given to confirm the proposed IPS-OCSVM framework for QoE anomaly detection in cellular networks.
AB - The ever-increasing amount of data in cellular networks poses challenges for network operators to monitor the quality of experience (QoE). Traditional key quality indicators (KQIs)-based hard decision methods are difficult to undertake the task of QoE anomaly detection in the case of big data. To solve this problem, in this paper, we propose a KQIs-based QoE anomaly detection framework using semi-supervised machine learning algorithm, i.e., iterative positive sample aided one-class support vector machine (IPS-OCSVM). There are four steps for realizing the proposed method while the key step is combining machine learning with the network operator's expert knowledge using OCSVM. Our proposed IPS-OCSVM framework realizes QoE anomaly detection through soft decision and can easily fine-Tune the anomaly detection ability on demand. Moreover, we prove that the fluctuation of KQIs thresholds based on expert knowledge has a limited impact on the result of anomaly detection. Finally, experiment results are given to confirm the proposed IPS-OCSVM framework for QoE anomaly detection in cellular networks.
KW - Machine learning
KW - anomaly detection
KW - key quality index
KW - one-class support vector machine
KW - quality of experience
UR - http://www.scopus.com/inward/record.url?scp=85090135149&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85090135149&partnerID=8YFLogxK
U2 - 10.1109/TVT.2020.2995160
DO - 10.1109/TVT.2020.2995160
M3 - Article
AN - SCOPUS:85090135149
SN - 0018-9545
VL - 69
SP - 8459
EP - 8467
JO - IEEE Transactions on Vehicular Communications
JF - IEEE Transactions on Vehicular Communications
IS - 8
M1 - 9096623
ER -