I try to scrap professionnal numbers from a french website but I get 403 error and I get blocked by Clouflares. I use Selenium and Scrapy. I added the scrapy cloudflares middleware but it still does not work. I also added some options args to selenium options.

spider.py:

import scrapy
import random
from scrapy_selenium import SeleniumRequest
from scrapy.selector import Selector
from selenium import webdriver


class ApiPbSpider(scrapy.Spider):
    name = 'api_pb'

    def start_requests(self):
        yield SeleniumRequest(
            url = 'https://www.pagesjaunes.fr/pagesblanches/recherche?quoiqui=sylvie&ou=Saint+Beno%C3%AEt+%2886280%29&univers=pagesblanches&idOu=L08621400',
            callback=self.parse,
            wait_time = 15,
         )
    
def parse(self, response):
    driver = response.meta['driver']
    code_page = driver.page_source
    print(code_page)

Settings.py:

SELENIUM_DRIVER_NAME = 'chrome'
SELENIUM_DRIVER_EXECUTABLE_PATH = which('chromedriver')
SELENIUM_DRIVER_ARGUMENTS=['--headless']  # '--headless' if using chrome instead of firefox


# Crawl responsibly by identifying yourself (and your website) on the user-agent
USER_AGENT = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36'


# Obey robots.txt rules
ROBOTSTXT_OBEY = False


# Configure maximum concurrent requests performed by Scrapy (default: 16)
#CONCURRENT_REQUESTS = 32

# Configure a delay for requests for the same website (default: 0)
# See https://docs.scrapy.org/en/latest/topics/settings.html#download-delay
# See also autothrottle settings and docs
#DOWNLOAD_DELAY = 3
# The download delay setting will honor only one of:
#CONCURRENT_REQUESTS_PER_DOMAIN = 16
#CONCURRENT_REQUESTS_PER_IP = 16

# Disable cookies (enabled by default)
COOKIES_ENABLED = True

# Disable Telnet Console (enabled by default)
#TELNETCONSOLE_ENABLED = False

# Override the default request headers:
DEFAULT_REQUEST_HEADERS = {
    'Accept': '/',
    'Accept-Encoding': 'gzip, deflate, br',
    'Accept-Language':'fr-FR,fr;q=0.9,en-US;q=0.8,en;q=0.7',
    'Origin': 'https://www.pagesjaunes.fr/pagesblanches/',
    'Referer':'https://www.pagesjaunes.fr/pagesblanches/',
    'Sec-Ch-Ua':'"Google Chrome";v="113", "Chromium";v="113", "Not-A.Brand";v="24"',
    'Sec-Ch-Ua-Mobile':'?0',
    'Sec-Ch-Ua-Platform':'"Windows"',
    'Sec-Fetch-Dest':'empty',
    'Sec-Fetch-Mode': 'cors',
    'Sec-Fetch-Site': 'same-site',
}

# Enable or disable spider middlewares
# See https://docs.scrapy.org/en/latest/topics/spider-middleware.html
#SPIDER_MIDDLEWARES = {
#    'api_pages_blanches.middlewares.ApiPagesBlanchesSpiderMiddleware': 543,
#}

# Enable or disable downloader middlewares
# See https://docs.scrapy.org/en/latest/topics/downloader-middleware.html
DOWNLOADER_MIDDLEWARES = {
    # The priority of 560 is important, because we want this middleware to kick in just before the scrapy built-in `RetryMiddleware`.
    'scrapy_cloudflare_middleware.middlewares.CloudFlareMiddleware': 560,
    'scrapy_selenium.SeleniumMiddleware': 800
}

Howerver if I add a residential proxy, I get code 200 but I receive an empty body. did you have any idea?