I actually don't think Philadelphia drivers are all that bad with respect to pedestrians, with not infrequent exceptions. But it's a more obviously a pedestrian zone than most places (in much of city, anyway). There are small streets, and lights or stop signs and pedestrian crossings at every intersection. The drivers that do get enraged when you dare to try to cross a street at an intersection probably aren't local.
Pedestrians can behave badly, too, but when they do they're unlikely to kill people. Police should do more to address drivers behaving badly.