OSDI '23

Currently Playing: OSDI '23 - Hyrax: Fail-in-Place Server Operation in Cloud Platforms

OSDI '23 - Hyrax: Fail-in-Place Server Operation in Cloud Platforms Jialun Lyu, Microsoft Azure and University of Toronto, Marisa You, Microsoft Azure, Celine Irvene, Microsoft Azure, Mark Jung, Microsoft Azure, Tyler Narmore, Microsoft Azure, Jacob Shapiro, Microsoft Azure, Luke Marshall, Microsoft Azure, Savyasachi Samal, Microsoft Azure, Ioannis Manousakis, Formerly of Microsoft Azure, Lisa Hsu, Formerly of Microsoft Azure, Preetha Subbarayalu, Microsoft Azure, Ashish Raniwala, Microsoft Azure, Brijesh Warrier, Microsoft Azure, Ricardo Bianchini, Microsoft Azure, Bianca Schroeder, University of Toronto, Daniel S. Berger, Microsoft Azure and University of Washington Today’s cloud platforms handle server hardware failures by shutting down the affected server and only turning it back online once it has been repaired by a technician. At cloud scale, this all-or-nothing operating model is becoming increasingly unsustainable. This model is also at odds with technology trends, such as the need for new cooling technology. This paper introduces Hyrax, a datacenter stack that enables compute servers with failed components to continue hosting VMs while hiding the underlying degraded capacity and performance. A key enabler of Hyrax is a novel model of changes in memory interleaving when deactivating faulty memory modules. Experiments on cloud production servers show that Hyrax overcomes common hardware failures without impacting peak VM performance. In large-scale simulations with production traces, Hyrax reduces server repair requirements by 50-60% without impacting VM scheduling. View the full OSDI '23 program at https://www.usenix.org/conference/osdi23/technical-sessions