There is a php script that runs through the console phantomjs, you need to parse the page every few minutes. Pages ~500 on every page for 2 seconds, how best to break the script?
Here's an idea:
1) Divided into several parties, and to run consecutively, at the time the same
2) to Divide into parties, but to run multiple jobs.
3) Use some kind of handler, enter the Url in the database/memory/file, and 1 single handle
Without specifics kosaemo of all, you can only guess what you want. Want, to do one job and do it or take a few, depends on the implementation of the script, the capabilities of the scheduler and your capabilities.
andre_Erdman43 answered on July 9th 19 at 14:03
Run 20 handlers via supervisor (to be a little more docente), for each select a list of URLs, sobsno all. P - Parallelization