Chrome not showing latest version of game

[zzmmorgan]

I was initially thinking perhaps the server I'm using as a test host while I'm developing my game was doing some caching as after I delete the existing version and upload the new one I still see the old one for quite some time even after tinkering around with clearing cache and such in Chrome. But I just got it to instantly show the new version apparently by going into Chrome's Dev Tools and telling it to disable caching while Dev Tools is up. Is this a common issue? The crazy thing is when I first go to the site after the new build is up I'll briefly see the new version in the name of the browser window until the title screen pops up and then the title is showing the prior version number. Also if I click on Patch Notes (I'm using most of Yanfly's plugins) I get my current patch notes but the title screen is the old version and when I go to new game I get old copies of any maps that have changed.
So I guess my big question is whether there's something I can do to ensure anyone playtesting will get the latest version without having them go into Chrome Dev Tools?