We consider various scheduling problems that arise in large clusters including multi-resource packing and dependency-aware scheduling. Our solutions have analytical foundations and are used in Microsoft’s data-parallel clusters. Some have also shipped with Yarn. Skim through the publications for more details. A closely related project, lead by our applied scientist partner team, is here.
People
Ganesh Ananthanarayanan
Senior Principal Researcher
Peter Bodík
Principal Researcher
Ishai Menache
Partner Research Manager