David Cameron reportedly told aides following his resignation speech: "Why should I do all the hard s**t?"