[RFC] Add the possibility to fix release-breaking changes

There might be some changes in-between releases that require user action. Since we want to avoid our users to fix those, this adds a new function that will fix whichever release-breaking changes happen.

Naming might be a bit crap, but it's Sunday evening and I'm out of ideas.