I am currently trying to scrap the data from a website CCMT 2021 OR/CR which has dynamic structure and table is present in it and to navigate to other page there is option of ‘Next’ or clicking on the ‘2’ or ‘3’ or required button. I want to extract all the data and keep it in a excel file. Previously I have extracted the similar link of CCMT 2023 OR/CR with same approach, and scraping of one page(21 rows) was taking approx 23 seconds and there was total of 383 pages and total time taken was aprrox 2 hours, and this CCMT 2021 OR/CR has also almost similar no. of rows in all pages. How can I scrap the table efficiently. I am beginner at Web Scraping and with the help of Chatgpt I was successful to scrap the previous website data.