I am trying to scrape one Cloudflare protected site using Python, Selenium and using proxies and param from zenrows. Initially I was getting 403 error but that got resolved. Now using selenium when I am trying to login to site I am getting “Cookies are blocked or not supported by your browser. You must enable cookies to use WordPress.” I have tried all other ways but getting this error.
# installed selenium 4.11+
from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.common.by import By
from seleniumwire import webdriver # Import from seleniumwire
import time
service = Service()
options = webdriver.ChromeOptions()
options.add_argument("--headless=new")
# configure the ZenRows proxy
proxy_url = proxy
seleniumwire_options = {
"proxy": {
"http": f"{proxy_url}"
},
}
driver = webdriver.Chrome(
service=service,
seleniumwire_options=seleniumwire_options,
options=options
)
driver.get(url)
time.sleep(200)
1