Efficient cloud resource management using neuromorphic modeling and prediction for virtual machine resource utilization

Zhe Li, Xiaolong Ma, Ji Li, Qinru Qiu, Yanzhi Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

With the rapid development of Cloud Computing and Data Centers, Virtual Machine consolidation has become an important issue to achieve economic scale. In order to support such feature, a robust scheme for Virtual Machine resource demands prediction is critical. Previous prediction models such as Auto-Regressive Moving Average model lacks the ability to give an acceptable accuracy for a large prediction window and conventional machine learning based methods suffer from high complexity problem. In this work, a neuromorphic system based on cogent confabulation is built to predict the resource usages from statistics of historical records in comprehensive dimensions. The system exploits the correlations between observations in multiple dimensions and models a probability network to be finely tuned to support the prediction application. The experimental results show the cogent confabulation model based Virtual Machine resource utilization prediction gives a better accuracy than previous work and has an intrinsic advantage in dynamic prediction with a wider prediction window. Using the accurate confabulation-based VM resource prediction, the cloud resource management can improve the energy efficiency (in terms of electricity price) by up to 26.52%.

Original languageEnglish (US)
Title of host publication2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728124377
DOIs
StatePublished - Jun 1 2019
Event2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019 - Las Vegas, United States
Duration: Jun 2 2019Jun 3 2019

Publication series

Name2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019

Conference

Conference2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019
CountryUnited States
CityLas Vegas
Period6/2/196/3/19

Fingerprint

resources management
resources
predictions
autoregressive moving average
machine learning
Virtual machine
consolidation
Cloud computing
electricity
Consolidation
Energy efficiency
Learning systems
economics
Electricity
Statistics
statistics
Economics

ASJC Scopus subject areas

  • Software
  • Instrumentation
  • Computer Networks and Communications
  • Hardware and Architecture

Cite this

Li, Z., Ma, X., Li, J., Qiu, Q., & Wang, Y. (2019). Efficient cloud resource management using neuromorphic modeling and prediction for virtual machine resource utilization. In 2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019 [8782503] (2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICESS.2019.8782503

Efficient cloud resource management using neuromorphic modeling and prediction for virtual machine resource utilization. / Li, Zhe; Ma, Xiaolong; Li, Ji; Qiu, Qinru; Wang, Yanzhi.

2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8782503 (2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Li, Z, Ma, X, Li, J, Qiu, Q & Wang, Y 2019, Efficient cloud resource management using neuromorphic modeling and prediction for virtual machine resource utilization. in 2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019., 8782503, 2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019, Institute of Electrical and Electronics Engineers Inc., 2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019, Las Vegas, United States, 6/2/19. https://doi.org/10.1109/ICESS.2019.8782503
Li Z, Ma X, Li J, Qiu Q, Wang Y. Efficient cloud resource management using neuromorphic modeling and prediction for virtual machine resource utilization. In 2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019. Institute of Electrical and Electronics Engineers Inc. 2019. 8782503. (2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019). https://doi.org/10.1109/ICESS.2019.8782503
Li, Zhe ; Ma, Xiaolong ; Li, Ji ; Qiu, Qinru ; Wang, Yanzhi. / Efficient cloud resource management using neuromorphic modeling and prediction for virtual machine resource utilization. 2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019. Institute of Electrical and Electronics Engineers Inc., 2019. (2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019).
@inproceedings{34d57ff7797445b0aa2080dc3f32363c,
title = "Efficient cloud resource management using neuromorphic modeling and prediction for virtual machine resource utilization",
abstract = "With the rapid development of Cloud Computing and Data Centers, Virtual Machine consolidation has become an important issue to achieve economic scale. In order to support such feature, a robust scheme for Virtual Machine resource demands prediction is critical. Previous prediction models such as Auto-Regressive Moving Average model lacks the ability to give an acceptable accuracy for a large prediction window and conventional machine learning based methods suffer from high complexity problem. In this work, a neuromorphic system based on cogent confabulation is built to predict the resource usages from statistics of historical records in comprehensive dimensions. The system exploits the correlations between observations in multiple dimensions and models a probability network to be finely tuned to support the prediction application. The experimental results show the cogent confabulation model based Virtual Machine resource utilization prediction gives a better accuracy than previous work and has an intrinsic advantage in dynamic prediction with a wider prediction window. Using the accurate confabulation-based VM resource prediction, the cloud resource management can improve the energy efficiency (in terms of electricity price) by up to 26.52{\%}.",
author = "Zhe Li and Xiaolong Ma and Ji Li and Qinru Qiu and Yanzhi Wang",
year = "2019",
month = "6",
day = "1",
doi = "10.1109/ICESS.2019.8782503",
language = "English (US)",
series = "2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019",

}

TY - GEN

T1 - Efficient cloud resource management using neuromorphic modeling and prediction for virtual machine resource utilization

AU - Li, Zhe

AU - Ma, Xiaolong

AU - Li, Ji

AU - Qiu, Qinru

AU - Wang, Yanzhi

PY - 2019/6/1

Y1 - 2019/6/1

N2 - With the rapid development of Cloud Computing and Data Centers, Virtual Machine consolidation has become an important issue to achieve economic scale. In order to support such feature, a robust scheme for Virtual Machine resource demands prediction is critical. Previous prediction models such as Auto-Regressive Moving Average model lacks the ability to give an acceptable accuracy for a large prediction window and conventional machine learning based methods suffer from high complexity problem. In this work, a neuromorphic system based on cogent confabulation is built to predict the resource usages from statistics of historical records in comprehensive dimensions. The system exploits the correlations between observations in multiple dimensions and models a probability network to be finely tuned to support the prediction application. The experimental results show the cogent confabulation model based Virtual Machine resource utilization prediction gives a better accuracy than previous work and has an intrinsic advantage in dynamic prediction with a wider prediction window. Using the accurate confabulation-based VM resource prediction, the cloud resource management can improve the energy efficiency (in terms of electricity price) by up to 26.52%.

AB - With the rapid development of Cloud Computing and Data Centers, Virtual Machine consolidation has become an important issue to achieve economic scale. In order to support such feature, a robust scheme for Virtual Machine resource demands prediction is critical. Previous prediction models such as Auto-Regressive Moving Average model lacks the ability to give an acceptable accuracy for a large prediction window and conventional machine learning based methods suffer from high complexity problem. In this work, a neuromorphic system based on cogent confabulation is built to predict the resource usages from statistics of historical records in comprehensive dimensions. The system exploits the correlations between observations in multiple dimensions and models a probability network to be finely tuned to support the prediction application. The experimental results show the cogent confabulation model based Virtual Machine resource utilization prediction gives a better accuracy than previous work and has an intrinsic advantage in dynamic prediction with a wider prediction window. Using the accurate confabulation-based VM resource prediction, the cloud resource management can improve the energy efficiency (in terms of electricity price) by up to 26.52%.

UR - http://www.scopus.com/inward/record.url?scp=85070887614&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070887614&partnerID=8YFLogxK

U2 - 10.1109/ICESS.2019.8782503

DO - 10.1109/ICESS.2019.8782503

M3 - Conference contribution

AN - SCOPUS:85070887614

T3 - 2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019

BT - 2019 IEEE International Conference on Embedded Software and Systems, ICESS 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -