Drum has the best simple explanation of what happened in the Padilla case that I've seen. Shorter Michael Luttig:
We fucked up! We trusted you!
And that, I think, gets at the heart of it. Even judges willing to give almost unlimited power to the executive imagine that the executive is dealing with them in good faith.
