I am scrapping this amazon page:
https://www.amazon.com/s?k=mercedes&crid=37ZCGOIJ0A8V4&sprefix=me%2Caps%2C1587&ref=nb_sb_noss_2
Here’s my code:

import requests
from bs4 import BeautifulSoup
import pandas as pd
URL = "https://www.amazon.com/s?k=mercedes&crid=37ZCGOIJ0A8V4&sprefix=me%2Caps%2C1587&ref=nb_sb_noss_2"
HEADER = ({'User-Agent':'', 'Accept-Language': 'en-US, en;q=0.5'})
r = requests.get(URL, headers=HEADER)

soup = BeautifulSoup(r.content, "html.parser")

aTag = soup.find_all("a")
print(aTag)

I even mentioned my right user agent but still it return status code 503. But when I replace URL with amazon.com so it returns status 200. Please help me!

I expected the status code to be 200. Even after trying everything it still doesn’t worked.