I’m attempting a mini project using Python and BS4 to compare listings on Depop. I am able to use inspect on the site to see all of the fields I wish to sort through and parse, but when I try to use requests to store the URL contents in a file, all the HTML code becomes gibberish and says I don’t have authorization. Is there a way around this? I know Depop specifically has everything disallowed in their robots.txt, is that why I can’t scrape the data?

I am developing a personal project that involves collecting data from Sofascore, during this process I have an obstacle which would be the collection of hyperlinks/URLs of some objects, these hyperlinks do not appear in the page source,