from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.chrome.options import Options
from bs4 import BeautifulSoup
import time
from openpyxl import Workbook

I’m taking a look at this site: https://silkroadmed.com/hospitals/

I cannot get html of web-page with Selenium in headless mode. Without headless mode everything was ok. Below you can find code without image loading, however, it doesnt make any sense: result is the same with adding this option or not. url = "https://www.arrow.com/" what ive tried:
With Chrome:

I want to scrape village level data from https://pmfby.gov.in/adminStatistics/dashboard from “State Wise Report” section given on the top right hand side of the website. But the tables on the website are dynamic, which mean first table we see are at state level. Then we can click on each states to go to their respective district, thereafter block, followed by GP, villages etc. so villages are available at last.

I’m looking to scrape a list from a website, where you have to select “Yes”, check the “Show by State” box, click the “Submit and Find Doctor”, and then select a state from the dropdown, and note the doctor’s name.

This question already has answers here: How can I scrape a page with dynamic content (created by JavaScript) in Python? (17 answers) Closed 50 mins ago. This post was edited and submitted for review 2 mins ago. I’m scaping booking.com with selenium, it has over 600 results, but selenium is scaping only 51 results. I […]

This question already has answers here: How can I scrape a page with dynamic content (created by JavaScript) in Python? (17 answers) Closed 3 mins ago. I’m scaping booking.com with selenium, it has over 600 results, but selenium is scaping only 51 results. I do not know what I am doing wrong. This is my […]

I’m trying to scrape this website: https://www.lavoro.gov.it/ and I have a problem when i search for a keyword in the searchbar and I get to the following page:

Now as you can see, I’m trying to cicle the pages in the website by auto-clicking with selenium on the arrow, but whenever I copy an XPATH linked to the arrow I get the following: #it-block-italiagov-content and the exception
[DEBUG] Exception: 'list' object has no attribute 'click'

I would like to scrape all exhibitor names and information from this link: https://asiatechxsg.com/exhibitors/ into a csv file.

I need to scrape this webpage https://www.mef.gov.it/ and as I try to run the following code that searches in the search bar: