I have this website that I want to scrape through python requests, and not a headless browser, the problem is I couldn’t find how the url changes when you click on a filter (e.g 1 BHK or something else) when make a filter, the relative url changes to a weird typo !
Here is the link : https://housing.com/in/buy/searches/mumbai
Try to change the Bhk type and select two types of bhk for example, you’ll have a link like this : https://housing.com/in/buy/searches/CcPskwz0ocdh7q42r5 (selected 2 bhk, 3 bhk).
Please help me out to reverse engineer this website, I spent nights without no results !
I inspected all the APIs in network tab, the first api sent has in its payload the hash value that I want, so I don’t know from where he get it !
1