The image below shows a message in the Chrome DevTools console when I click on the search button on the website I want to scrape.
console
I’m using Python Selenium for this project and need to retrieve the URLs from it.
I attempted to use a JavaScript script with self.addEventListener(‘fetch’, event) and driver.execute_script(js_script) in Python, but it didn’t capture the URLs.
I’ve seen people recommend using browsermob-proxy for accessing developer tools, but it requires downloading a .bat file, and I’d prefer a simpler solution.