Netflix Principles
1. No Service Should be a Single point of failure.
2. Never Trust That you have done #1 correctly https://github.com/Netflix/chaosmonkey
it’s better to be in a constant state of minor failure than occasionally catastrophic failure.
You could find the presentation here
What do you think?