In Search of I/O-Optimal Recovery from Disk Failures
- Osama Khan ,
- Randal Burns ,
- James Plank ,
- Cheng Huang
HotStorage'11 Proceedings of the 3rd USENIX conference on Hot topics in storage and file systems, Portland, OR |
Published by USENIX Association Berkeley, CA, USA
We address the problem of minimizing the I/O needed to recover from disk failures in erasure-coded storage systems. The principal result is an algorithm that finds the optimal I/O recovery from an arbitrary number of disk failures for any XOR-based erasure code. We also describe a family of codes with high-fault tolerance and low recovery I/O, e.g. one instance tolerates up to 11 failures and recovers a lost block in 4 I/Os. While we have determined I/O optimal recovery for any given code, it remains an open problem to identify codes with the best recovery properties. We describe our ongoing efforts toward characterizing space overhead versus recovery I/O tradeoffs and generating codes that realize these bounds.