Online Rack Placement in Large-Scale Data Centers

This paper optimizes the configuration of large-scale data centers toward cost-effective, reliable and sustainable cloud supply chains. We formulate an integer optimization model that optimizes the placement of racks of servers within a data center to maximize demand coverage, adhere to space, power and cooling restrictions, and pace resource utilization for future demand. We also define a tractable single-sample online approximation (SSOA) approach to multi-stage stochastic optimization, which approximates unknown parameters with a single realization and re-optimizes decisions dynamically. Theoretical results provide strong performance guarantees of SSOA in the canonical online generalized assignment and online bin packing settings. Computational results using real-world data show that our optimization approach can enhance utilization and reduce power stranding in data centers. Following iterative improvements in collaboration with data center managers, our algorithm has been packaged into a software solution deployed in Microsoft’s data centers worldwide. Deployment data indicate a significant increase in adoption, leading to improved power utilization, multi-million-dollar annual cost savings, and concomitant savings in greenhouse gas emissions. Ultimately, this paper constitutes one of the first large-scale deployments of a decision-making tool in data centers, contributing an interactive decision-making process at the human-machine interface.