Scrape comments from dynamically changing site
I need to scrape/parse comments from Debank site’s posts.
For example: https://debank.com/stream/2057406
The problem is that if I scroll the site the html changes and rendering comments in real time.
Every comment has it’s id, and when I scroll the site the new comments adds and the previous one disappears.
Dynamic code
For example first comment has attribute data-index="0"
, second has data-index="1"
and it works like this:
Scrap comments from dynamically changing site
I need to scrap/parse comments from Debank site’s posts.
For example: https://debank.com/stream/2057406
The problem is that if I scroll the site the html changes and rendering comments in real time.
Every comment has it’s id, and when I scroll the site the new comments adds and the previous one disappears.
Dynamic code
For example first comment has attribute data-index="0"
, second has data-index="1"
and it works like this: