Abstract
A large amount of power consumption information generated from private houses is being aggregated nowadays, particularly by the spread of smart electric meters. Applications that utilize these data are widely studied, and several services have been proposed. In order to utilize the power demand information effectively, an appropriate feature extraction and selection method is necessary. In this paper, a feature extraction method for power consumption information is proposed. Extracted features are used to predict the “number of household members (number of residents)” using typical machine learning algorithms, namely, Support Vector Machine (SVM), k-Nearest Neighborhood (k-NN), and Random Forest (RF). The number of residents represents significant information for the marketing departments of several industries such as real estate and construction industries. The proposed feature extraction method consists of two steps: feature variable generation and feature variable selection. In the feature variable generation step, we have used both fundamental statics and an ARMA model to generate 33 feature variables. In the feature variable selection step, the extracted feature variables are first ranked by applying Analysis of Variance (ANOVA). An appropriate feature variable set is selected by assessing several combinations of the 33 features, based on proposed extended algorithm of Recursive Feature Elimination (RFE). Our overall feature extraction method is evaluated based on the prediction accuracy using extracted feature variables. Compared with the accuracy using feature variables extracted by conventional methods, the accuracy is improved by 6.78%, 4.98%, and 8.11% for k-NN, SVM, and RF, respectively, and we have successfully proven validity of our proposition.
| Original language | English |
|---|---|
| Pages (from-to) | 227-236 |
| Number of pages | 10 |
| Journal | IEEJ Transactions on Electronics, Information and Systems |
| Volume | 139 |
| Issue number | 3 |
| DOIs | |
| Publication status | Published - 2019 Jan 1 |
Fingerprint
Keywords
- Analysis of variance (ANOVA)
- ARMA model
- Feature extraction
- Feature selection
- Machine learning
- Smart electric meter
ASJC Scopus subject areas
- Electrical and Electronic Engineering
Cite this
Feature extraction and resident number prediction method using power consumption data. / Yoshida, Masahiro; Imanishi, Tomoya; Nishi, Hiroaki.
In: IEEJ Transactions on Electronics, Information and Systems, Vol. 139, No. 3, 01.01.2019, p. 227-236.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Feature extraction and resident number prediction method using power consumption data
AU - Yoshida, Masahiro
AU - Imanishi, Tomoya
AU - Nishi, Hiroaki
PY - 2019/1/1
Y1 - 2019/1/1
N2 - A large amount of power consumption information generated from private houses is being aggregated nowadays, particularly by the spread of smart electric meters. Applications that utilize these data are widely studied, and several services have been proposed. In order to utilize the power demand information effectively, an appropriate feature extraction and selection method is necessary. In this paper, a feature extraction method for power consumption information is proposed. Extracted features are used to predict the “number of household members (number of residents)” using typical machine learning algorithms, namely, Support Vector Machine (SVM), k-Nearest Neighborhood (k-NN), and Random Forest (RF). The number of residents represents significant information for the marketing departments of several industries such as real estate and construction industries. The proposed feature extraction method consists of two steps: feature variable generation and feature variable selection. In the feature variable generation step, we have used both fundamental statics and an ARMA model to generate 33 feature variables. In the feature variable selection step, the extracted feature variables are first ranked by applying Analysis of Variance (ANOVA). An appropriate feature variable set is selected by assessing several combinations of the 33 features, based on proposed extended algorithm of Recursive Feature Elimination (RFE). Our overall feature extraction method is evaluated based on the prediction accuracy using extracted feature variables. Compared with the accuracy using feature variables extracted by conventional methods, the accuracy is improved by 6.78%, 4.98%, and 8.11% for k-NN, SVM, and RF, respectively, and we have successfully proven validity of our proposition.
AB - A large amount of power consumption information generated from private houses is being aggregated nowadays, particularly by the spread of smart electric meters. Applications that utilize these data are widely studied, and several services have been proposed. In order to utilize the power demand information effectively, an appropriate feature extraction and selection method is necessary. In this paper, a feature extraction method for power consumption information is proposed. Extracted features are used to predict the “number of household members (number of residents)” using typical machine learning algorithms, namely, Support Vector Machine (SVM), k-Nearest Neighborhood (k-NN), and Random Forest (RF). The number of residents represents significant information for the marketing departments of several industries such as real estate and construction industries. The proposed feature extraction method consists of two steps: feature variable generation and feature variable selection. In the feature variable generation step, we have used both fundamental statics and an ARMA model to generate 33 feature variables. In the feature variable selection step, the extracted feature variables are first ranked by applying Analysis of Variance (ANOVA). An appropriate feature variable set is selected by assessing several combinations of the 33 features, based on proposed extended algorithm of Recursive Feature Elimination (RFE). Our overall feature extraction method is evaluated based on the prediction accuracy using extracted feature variables. Compared with the accuracy using feature variables extracted by conventional methods, the accuracy is improved by 6.78%, 4.98%, and 8.11% for k-NN, SVM, and RF, respectively, and we have successfully proven validity of our proposition.
KW - Analysis of variance (ANOVA)
KW - ARMA model
KW - Feature extraction
KW - Feature selection
KW - Machine learning
KW - Smart electric meter
UR - http://www.scopus.com/inward/record.url?scp=85062404260&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85062404260&partnerID=8YFLogxK
U2 - 10.1541/ieejeiss.139.227
DO - 10.1541/ieejeiss.139.227
M3 - Article
AN - SCOPUS:85062404260
VL - 139
SP - 227
EP - 236
JO - IEEJ Transactions on Electronics, Information and Systems
JF - IEEJ Transactions on Electronics, Information and Systems
SN - 0385-4221
IS - 3
ER -