Hate to say it, but this issue will probably happen more often now, and that's not necessarily, a bad thing. It is a test build after all.
We just need to have changes to plugs done separately.
It's time for a compiled plugin repository.
I don't know how hard it would be to add an updater to Construct Classic itself, but a tool made in CC that would do it for you should be pretty straight forward.