The EU project is complicated. I think it's difficult to dismiss it as "good" or "bad" because it has so many pieces. But some of those pieces clearly benefit the majority of people and some of them really don't. Borderless travel in the Schengen zone is one of the big benefits.
Taking that away really undermines the whole project.