I generally have a good sense of direction, and handle maps well, but I first need to be anchored, knowing which way is North, etc. Once I establish that I can generally keep track of it pretty well.
Still, the DC taxi maps always mystified me, and I eventually stopped bothering to try to figure out why. Now I know why - up on the maps is not North.