I’m currently blocking a site for web scraping data on it.
Here is the address:
https://data.qualifelec.fr/recherche/?boundingBox%5BnorthEast%5D%5Blat%5D=51.3682119&boundingBox%5BnorthEast%5D%5Blng%5D=11.4548613&boundingBox%5BsouthWest%5D%5Blat%5D=40.8531652&boundingBox%5BsouthWest%5D%5Blng%5D=-6.272655599999999&isFromSearchBox=true&hierarchicalMenu%5BLOTtypeOfWork.lvl1%5D=&hierarchicalMenu%5BtypeOfWork.lvl0%5D=Tertiaire%20-%20Industriel%20-%20Agricole%20%3E%20Travaux%20%C3%A9lectriques%20ERT%20inf%C3%A9rieur%20%C3%A0%20400m%C2%B2&page=1&configure%5BhitsPerPage%5D=10&query=
I succeeded in part of the code which manages to open the browser as well as the window of the 1st provider, but when I try to initiate a loop to do it on all the providers of the page, it blocks.
What is the code to retrieve the information from each supplier (a window opens when you click on each supplier on the page) and repeat the operation on all pages with the selected filters (see my image)?
Romain FRANCO is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
1