It seems that cached files might be saved between nginx restarts (I'm not 100% about this as there are a few moving parts involved in this configuration).
However, proxy cache is stored in /var/cache/nginx and it safe to delete it, then restart nginx to refresh.