I am trying to scrape the links of mobile phones from amazon . There are 10 pages and 233 items
but my following code only scrape 72 items . This is my code :
links = []
for page_num in range(1 , 11):
driver.get(f'https://www.amazon.eg/-/en/s?i=electronics&bbn=21832883031&rh=n%3A21832883031%2Cp_89%3AApple%7CHONOR%7CHUAWEI%7CItel%7CNokia%7COPPO%7CRedmi%7CSAMSUNG%7CXiaomi%7Crealme&dc&page={page_num}&language=en&qid=1719775062&rnid=22541269031&ref=sr_pg_{page_num}')
content = driver.page_source
soup = BeautifulSoup(content, features='html.parser')
mobile_info = soup.find_all('h2' , {'class': 'a-size-mini a-spacing-none a-color-base s-line-clamp-4'})
#Add link of each mobile item in list
for i in range(len(mobile_info)) :
links.append('https://www.amazon.eg'+ mobile_info[i].find('a').attrs['href'])
So how can I fix this problem
I tried many things but i can’t fix it . So I need help