I already referred to the danger in relying on automation. The Asiana Airlines Boeing 777 passenger jet, that crashed while landing at San Francisco International Airport on July 2013, is a good example for what can go wrong when operators rely on automation.
In a June 24 press release said NTSB acting chairman Christopher A. Hart: "In this accident, the flight crew over-relied on automated systems without fully understanding how they interacted. Automation has made aviation safer. But even in highly automated aircraft, the human must be the boss.".
This lesson must be learned before we start implementing automation in healthcare.