What and how to loaded page without a browser?

Than I do in the background is loaded each page with an interval of 5-8 seconds?
From the list tekstowego or sitemap.
About 50 000 pages.
Autoclicker not to offer baked and not stable!
There are serv on linux if using the command line, the solution is what..

If you need someone too, mirroring of the site: wget-m https://base-cinema.com/ or Spika wget -i urllist.txt -m https://base-cinema.com/
+
screen
July 9th 19 at 10:57

Related questions

More answers about "What and how to loaded page without a browser?"
3 answers
July 9th 19 at 10:59
Solution
Wget zhezh ...
July 9th 19 at 11:01
phantomjs
July 9th 19 at 11:03
The task ranges from trivial: for loop in bash
to very interesting in which you:
  • Create and maintain a rotating proxy server through tor(20 instacal running tor behind a load balancer, to change the ip )
  • Support concurrent downloading(and thus the message queue) to a unique current/deleted/inaccessible at the moment URL
  • Support automatic crawling URL on the page, if you want to follow links
  • Supports several types crawlers(phantomjs/casperjs/standard http request)
  • Support spoofing client(that you have not spotted bartolovecki with the captcha)
  • Support some heuristics which should detect if it's a real page or honeypot for bot

And this is only the first problems which come to mind.
------
If you need a dirty socialist. Yes, wget in a for loop the best solution. (Not the fact that working)
YES!!!!!!! Wrap EVERYTHING!!!!! )))))
And it's put there: https://github.com/segmentio/nightmare ))) - Kyleigh_Hills commented on July 9th 19 at 11:06
well, wget was easier if the site your - Wilber.Rohan commented on July 9th 19 at 11:09

Find more questions by tags BrowsersPHPJavaScript