• Don’t rely on time.sleep(100) which may cause long delays.
• Instead,replace the delay with WebDriverWait to wait for elements to load properly.
• Here is the update version of code:

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.chrome.options import Options
import time

username = "rahbar"
password = "password"
chrome_options = Options()
chrome_options.add_argument("--start-maximized")
driver = webdriver.Chrome(options=chrome_options)
driver.get("https://plp.irbroker.com/index.do")
try:
    WebDriverWait(driver, 10).until(
        EC.presence_of_element_located((By.NAME, "j_username"))
    )
    driver.find_element(By.NAME, "j_username").send_keys(username)
    driver.find_element(By.NAME, "j_password").send_keys(password)
    driver.find_element(By.XPATH, "//button[@type='submit']").click()
    print("Login fields populated successfully.")
    
except Exception as e:
    print(f"Error occurred: {e}")
finally:
    time.sleep(10)
    driver.quit()

Let’s improve the code before the actual scraping.

It is recommended that all data be moved to the beginning of the code. It is easier to see all the necessary data in one place:

# data for log-in
username = "rahbar"
password = "password"
site_url = "https://plp.irbroker.com/index.do"

Now let’s concentrate on optimizing and refining a few points.

First, let’s get website login and browser initialization out of the way and add fullscreen mode to the browser startup parameters:

# initialize driver
chrome_options = Options()
chrome_options.add_argument("--start-maximized")
driver = webdriver.Chrome(options=chrome_options)
driver.get(site_url) 

Now, instead of time.sleep(),let’s implement a method that returns the element after it has been displayed on the site, although it is not always accurate and correct:

# wait until both input elements will be on screen
username_element = WebDriverWait(driver, 10).until(
            EC.element_to_be_clickable((By.CSS_SELECTOR, "input[name='j_username']")))
password_element = WebDriverWait(driver, 10).until(
            EC.element_to_be_clickable((By.CSS_SELECTOR, "input[name='j_password']")))

If you are entering data into an input element, it is better to use EC.element_to_be_clickable. This method checks not only for the presence of the element on the page, but also for interactivity(i.e.,whether the element is visible or disabled).

Now, let’s clear the input field (if necessary) and enter the value:

# clear them (not important is site does not use start value)
username_element.clear()
password_element.clear()
# set values
username_element.send_keys(username)
password_element.send_keys(password)

And finally, we move on to the last part (optional since it wasn’t mentioned in the question) now we wait until the login button can be clicked (this works the same as with the input field):

# wait until login button will be clickable and then press it
log_in = WebDriverWait(driver, 10).until(
            EC.element_to_be_clickable((By.CSS_SELECTOR, "button[type='submit']"))).click()

Now the code is optimized and clear!

Here is the full version:

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.chrome.options import Options

# data for log-in
username = "rahbar"
password = "password"
site_url = "https://plp.irbroker.com/index.do"

# something before scrape

# initialize driver
chrome_options = Options()
chrome_options.add_argument("--start-maximized")
driver = webdriver.Chrome(options=chrome_options)
driver.get(site_url)

# wait until both input elements will be on screen
username_element = WebDriverWait(driver, 10).until(
            EC.element_to_be_clickable((By.CSS_SELECTOR, "input[name='j_username']")))
password_element = WebDriverWait(driver, 10).until(
            EC.element_to_be_clickable((By.CSS_SELECTOR, "input[name='j_password']")))
# clear them (not important is site does not use start value)
username_element.clear()
password_element.clear()
# set values
username_element.send_keys(username)
password_element.send_keys(password)
# wait until login button will be clickable and then press it
log_in = WebDriverWait(driver, 10).until(
            EC.element_to_be_clickable((By.CSS_SELECTOR, "button[type='submit']"))).click()

# and then thing after scrape, good luck with scrape btw