I can override the route with my own, and for example redirect somewhere, but in such a case route cache does not work, as it throws an exception like using Closure in routes ..
Then don't use closure. Have a dummy controller method.
If the routes come with the package, there's no way of getting rid of it completely. At best, you can have your server not serve them. You can block them in server's config file as well if you wish.