Building and maintaining a proper cadastre is really difficult. It takes decades, centuries even, relying on both formal law and common law constructs. There are many elements built in to preserve real property boundaries and proof of ownership--as granted (and owned) ultimately by the state. But once it is in place, it is a very resilient construct.
You can't just wave it all away. Not even in New Jersey.