I’m trying to parse a page from this url:
https://www.mathworks.com/help/radar/referencelist.html?type=block
I need to get all the links from the list of blocks under “Radar Toolbox — Blocks” header i.e. inside <div id="reflist_content">
.
I’m using requests_html
like this:
from requests_html import HTMLSession
session = HTMLSession()
url = 'https://www.mathworks.com/help/radar/referencelist.html?type=block'
r = session.get(url)
r.html.arender()
results = r.html.find('div')
res_str = ''
for item in results:
#print(item)
#print(item.text)
res_str += str(item) + 'n'
res_str += item.text + 'nn'
The text of reflist_content
in the results is empty.
I cannot find any of the needed content in the results. I tried to search by different html tags or keywords but it seems that the table with blocks is not rendered at all.
What am I doing wrong?