Scraping Only First Page Using Proxy Server: Subsequent Pages Fail to Load
I’m working on a web scraping project using Python and Playwright to collect data from a website. When accessing the website without a proxy server, my IP gets blocked. To prevent this, I use a proxy server (ScraperAPI) and rotate user agents. While the first page scrapes successfully, subsequent pages fail to load.