Questions tagged [Beautiful Soup] (1)

1
answer

Parsing Yandex.Market, the problem with the change of page?

Hi! I need a large list of AsRock, the source decided to take Yandex.Market. Faced with a ban + a very strange thing, after 7 pages inclusive issued for 33 cards goods, although in the settings it is still "Show 48". When switching to 7 page and further does not change the Page parameter for the page, thus in a file .csv co...
ron_Kilba asked April 19th 20 at 12:44
2
answers

How to share the same classes python bs4?

I need to separate information (the text), and put it in lists, but alas, it is under the same classes and share standard ways findAll does not work. . How can I do that?
minerva asked April 19th 20 at 12:39
2
answers

What is this error?

'NoneType' object has no attribute 'text' earlier run. code: tomsk = "https://yandex.ru/search/?text=%D0%BF%D0%BE%D0%B3%D0%BE%D0%B4%D0%B0%20%D0%B2%20%D1%82%D0%BE%D0%BC%D1%81%D0%BA%D0%B5&lr=67" full_page_tomsk = requests.get(tomsk) soup_tomsk = BeautifulSoup(full_page_tomsk.content, "html.parser") div_tomsk = soup_tomsk....
miracle_Armstrong99 asked April 19th 20 at 12:18
1
answer

How to parse requests from the network(the developer console)?

Give advice how to do it and in what direction to dig?
ross.Feeney asked April 18th 20 at 13:24
3
answers

How to get data from a dynamic website ( Python, BeautifulSoup, Selenium )?

All kind time of day! Thanks in advance for your answers. Is there a site that displays dynamic content: https://www.tradingview.com/chart/mTxoGgAC/ Using Beautiful Soup I can get any values if they appear in html. In this case, the website (if I understand correctly) displays the scripts that in turn is output to the brow...
Lora.Hayes asked April 16th 20 at 10:43
1
answer

How to get text from div using beautifulSoup?

<div class="amount"> 1271 </div> There is such code,you need to get out 1271,but when you run the program: full_page = requests.get(self.DOLLAR_RUB, headers=self.headers) # Parse using BeautifulSoup soup = BeautifulSoup(full_page.content, 'html.parser') # Get the value and return it self.convert = soup.findAll...
raquel.Ratke asked April 9th 20 at 10:49
1
answer

Is it possible to supersite an item from the table?

There are these items(the table): Here is the xpath: /html/body/div[1]/div[7]/div[2]/div[1]/div[4]/div[1]/div[3]/div[4]/div[1]/div[3]/div[1]/div/table/tbody/tr[1]/th[2] Is it possible to parse through the BS to get specifically the item "Number"? If you write: convert = soup.find_all('table', {'class' : 'market_commodity...
Iliana_Thompso asked April 9th 20 at 10:33
1
answer

Beautiful Soup, how to effectively catch tags?

Is there a website rusprofil'.ru, do the parsing of the name. url = 'https://www.rusprofile.ru/codes/561010/' fio = soup.select('.company-item > .company-item-info > dl > dd') The fact that it is not always the number of tags in each block are equal. Just one more, somewhere less. In the end, the first page is p...
louie.Rice asked April 9th 20 at 09:37
1
answer

How to put the size of the site?

Is there a website usa.tommy.com scab it with bs4 + requests. Field size default available, after some time the server sends a reply with the available sizes and the field changes to disabled. Manually shoveled all theoretically simple json, with the size nowhere to be found. Which query should be sent to the server to ge...
Manley_Auer94 asked April 9th 20 at 09:35
1
answer

How to put the contents of the class with bs4 in python?

In General, there is class<div class="fight-stats _enemy"> <table width="100%" border="0" cellpadding="0" cellspacing="0" class="fight-stats-table"> <tbody> <tr valign="top"> <td width="33%" align="center" valign="top"> <div class="fight-stat" id="enemy-stat-strength">5</div> &...
Aisha.Carter asked April 8th 20 at 18:08