I am trying to scrape the data from the table from this website.
Screenshot
Unfortunately, web scraping from this table is more difficult than I imagined.
- How do I navigate within the Power BI table using $findElement or similar tools?
- The links in the final column are stored as hyperlinks, but the actual link itself is the most important piece of information I need.
How do I get not just the text of the table but also the hyperlinks from the last column?
Finally, it seems that the fact that Power BI needs to buffer each time the scroll bar is used will make this more difficult.
The end results should be a simple .csv with 7 columns (County, Jurisdiction, Planning Period, Status, Received Date, Link) where the last column Link is the actual link and not “Click to View Housing Element”.
I have tried using RSelenium to navigate the page in a dynamic way but seem stuck since I do not know how to reference elements within the BI table.