How to concatit ansible-playbook on a server that was turned off?
Imagine such a scenario.
We have 1000 servers. All you need to update your version of Nginx (say security bugfix).
But we have one of the servers is off right now because he burned down the power unit.
Updated version of ansible nginx playbook and run it on all servers. Yeah, we all pre-tested on test environment.
Accordingly, nginx will be updated on the 999 servers, and one is not (it is off).
The power supply was repaired, the server is enabled, and HERE it is IMPORTANT, it is the old non-updated nginx.
It's good that I remember that it is not updated nginx. After switching on I can re-lose playbook. BUT it's done by hand. What if I have 1,000 was off 10 and they vkluchaetsia at different times by different employees?
I want the automatics!
The crux of the matter is this: as for starting the server automatically to play on it last actual playbook and only after that to put it into operation?
For example, we have ha-proxy is configured healt check and if the node is unavailable, then requests for her not Sluts.
And if available, requests for it are. In the example above, from the point of view ha-proxy walking gcd is quite in order. Responds to requests normally. Only here the version of nginx there leaky.
To nginx please do not cling. Updated could be absolutely any software or library. This is the essence of the matter does not change.
Who as solves this problem?
Or maybe I've got the whole approach wrong? If Yes, then tell me in what direction to look?