Relative Content

Tag Archive for pythonparsingweb-scrapingweb

Scrape comments from dynamically changing site

I need to scrape/parse comments from Debank site’s posts.
For example: https://debank.com/stream/2057406
The problem is that if I scroll the site the html changes and rendering comments in real time.
Every comment has it’s id, and when I scroll the site the new comments adds and the previous one disappears.
Dynamic code
For example first comment has attribute data-index="0", second has data-index="1" and it works like this:

Scrap comments from dynamically changing site

I need to scrap/parse comments from Debank site’s posts.
For example: https://debank.com/stream/2057406
The problem is that if I scroll the site the html changes and rendering comments in real time.
Every comment has it’s id, and when I scroll the site the new comments adds and the previous one disappears.
Dynamic code
For example first comment has attribute data-index="0", second has data-index="1" and it works like this: