TY - JOUR
T1 - Bulk Savings for Bulk Transfers
T2 - Minimizing the Energy-Cost for Geo-Distributed Data Centers
AU - Lu, Xingjian
AU - Kong, Fanxin
AU - Liu, Xue
AU - Yin, Jianwei
AU - Xiang, Qiao
AU - Yu, Huiqun
N1 - Funding Information:
This work was partially supported by the NSF of China under grant No. 61602175, the National Key Research and Development Plan under grant No. 2016YFA0502300, the National Science and Technology Supporting Program of China under grant No. 2015BAH18F02, the Model Information Service Industry Program of Guangdong Province under grunt No. GDEID2010IS049, the Fundamental Research Funds for the Central Universities under grant Nos. 222201514331 and ZH1726108, and the Special Funds for Informatization Development in Shanghai under grant No. 201602008.
Publisher Copyright:
© 2017 IEEE.
PY - 2020/1/1
Y1 - 2020/1/1
N2 - With the fast proliferation of cloud computing, major cloud service providers, e.g., Amazon, Google, Facebook, etc., have been deploying more and more geographically distributed data centers to provide customers with better reliability and quality of services. A basic demand in such a geo-distributed data center system is to transfer bulk volumes of data from one data center to another. Geographic distribution and large delay-tolerance of such inter-data-center bulk data transfers provide cloud service providers opportunities to optimize the operating cost. Most existing studies on inter-data-center bulk data transfers focus on minimizing the network bandwidth cost. However, the energy-cost of the bulk data transfers, which also accounts for a large proportion of operating cost in the data centers, still remains unexplored. This is an important problem, especially in the multi-electricity-market environment, where the electricity price exhibits both spatial and temporal diversities. In this paper, we systematically study the problem of how to route and schedule inter-data-center bulk data transfers to minimize the energy-cost for geo-distributed data centers. We model this problem as a min-cost multi-commodity flow problem and develop an efficient two-stage optimization method to solve it. Extensive evaluations with real-life inter-data-center network and electricity prices show that our method brings significant energy-cost savings over existing bulk data transfer methods.
AB - With the fast proliferation of cloud computing, major cloud service providers, e.g., Amazon, Google, Facebook, etc., have been deploying more and more geographically distributed data centers to provide customers with better reliability and quality of services. A basic demand in such a geo-distributed data center system is to transfer bulk volumes of data from one data center to another. Geographic distribution and large delay-tolerance of such inter-data-center bulk data transfers provide cloud service providers opportunities to optimize the operating cost. Most existing studies on inter-data-center bulk data transfers focus on minimizing the network bandwidth cost. However, the energy-cost of the bulk data transfers, which also accounts for a large proportion of operating cost in the data centers, still remains unexplored. This is an important problem, especially in the multi-electricity-market environment, where the electricity price exhibits both spatial and temporal diversities. In this paper, we systematically study the problem of how to route and schedule inter-data-center bulk data transfers to minimize the energy-cost for geo-distributed data centers. We model this problem as a min-cost multi-commodity flow problem and develop an efficient two-stage optimization method to solve it. Extensive evaluations with real-life inter-data-center network and electricity prices show that our method brings significant energy-cost savings over existing bulk data transfer methods.
KW - Data center
KW - bulk data transfer
KW - energy-cost
KW - geographical load balance
UR - http://www.scopus.com/inward/record.url?scp=85028449614&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85028449614&partnerID=8YFLogxK
U2 - 10.1109/TCC.2017.2739160
DO - 10.1109/TCC.2017.2739160
M3 - Article
AN - SCOPUS:85028449614
SN - 2168-7161
VL - 8
SP - 73
EP - 85
JO - IEEE Transactions on Cloud Computing
JF - IEEE Transactions on Cloud Computing
IS - 1
M1 - 8010368
ER -