In scrapy shell I entered these 3 commands
In [11]: fetch("https://www.ageofempires.com/stats/ageiide/")
2024-04-27 13:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.ageofempires.com/stats/ageiide/> (referer: None)
In [12]: response
Out[12]: <200 https://www.ageofempires.com/stats/ageiide/>
In [13]: response.css('table.leaderboard')
Out[13]: []
I’m not sure why it returns an empty list. as shown in the screenshot below there is a table with class=”leaderboard”.
example of website
Does anyone have any idea why this doesn’t work?
New contributor
user24728842 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.