How to parse with python requests?

Everything is great you know the main library for parsing python's requests. So the question arose, do I need to go to the site every 5-7 seconds, it is obvious that so frequent treatment of the site will perceive as ddos and limit the access to the site. Is there for example a possibility as once open the site and continuously read information from it, not to establish a connection every 5 seconds? Tried to contact the site with the Torah, arrives from the captchas, that is not an option, TorCrawler too wide (same Thor, just a little on the side).
April 19th 20 at 12:12
1 answer
April 19th 20 at 12:14
1) 5-7 seconds is a lot, so this is no ddos attack. Many commercial companies that parse sites(including MVideo, ozone and other shops) just parse one item in 5-7 seconds.
2)
Is there for example a possibility as once open the site and continuously read information from it, not to establish a connection every 5 seconds?
Is, unless the website gives information on the websocket(not encrypted).
3) Or to load a page every 5-7 seconds, or you can look in devtools, maybe the site gives info using xhr request. In this case, it may be easier to parse.

Find more questions by tags Parsing