Relative Content

Tag Archive for pythonhtmlselenium-webdriverweb-scraping

Scrape live appearing elements

So i have a website i am scraping data off, and it has live appearing elements i need to keep getting. I see them on screen and can get them as html via inspect. However i’ve been searching for hours and only thing i found is to simulate the request to get an element.

How to scrape data from arbitrary number of row listings using python selenium?

So I’m trying to create a bot that identifies nft loan listings on blur that meet certain criteria such as the loans total value being 80% or less than its floor price or APY being greater than 100%. I’ve figured out the basics of loading up chrome using selenium and navigating to the correct section of the website to view a collections loans. But I’m struggling to actually extract the data from the table of loans. What id like to be able to do is extract the table of loan listings into an array of arrays or array of dictionaries, with each array/dictionary containing data representing each name, status, borrow amount, LTV, and APY.

How to scrape data from arbitrary number of row listings on NFT trading platform using python selenium?

So I’m trying to create a bot that identifies nft loan listings on blur that meet certain criteria such as the loans total value being 80% or less than its floor price or APY being greater than 100%. I’ve figured out the basics of loading up chrome using selenium and navigating to the correct section of the website to view a collections loans. But I’m struggling to actually extract the data from the table of loans. What id like to be able to do is extract the table of loan listings into an array of arrays or array of dictionaries, with each array/dictionary containing data representing each name, status, borrow amount, LTV, and APY.

Selenium Scrape Issue

I am building a web scraper that scrapes the beatport top 100.
I am having an issue where some items are located, but others get an error.

Extract specific elements from a table with Selenium in Python

I am trying to extract specific data from a table displayed on the web server of a device.
I am running into an error while running the code that I cannot seem to understand.
I believe the error is coming when trying to find the specific element on the table column which is an invalid expression.

How to get the html from Wordle

I tried using Beautiful soup to scrap the html elements on the site text and it does not work as intended(most likely because it is dynamic with javascript) so I tried looking around and figured out that I have to use selenium in order to scrap the html elements. I have tried Selenium on the website and it seems to work better than Beautifulsoup in getting some of the html elements but it does not have the html elements of what I need.