Hello Stack Overflow Community,

I am planning to develop an e-commerce website specifically for dropshipping, and I need some advice and suggestions on the best practices and technologies to use. Here’s what I am aiming to achieve:

Project Overview:

Data Sources: I will be pulling product data from 120 different websites.
Data Updates: I need to regularly update product prices.
Order Management: When a user places an order, my system will deduct my fees and place the order on behalf of the user on the target website.
Proposed Tech Stack:

Frontend: Next.js, React.js
Backend: Node.js, Express.js
Databases: MySQL, MongoDB
Scraping Tool: Octoparse (to pull data from various websites)

Order Processing:

Implementing a system to manage orders, deduct fees, and place orders on target websites.
Using MySQL to handle transactional data and order management.

Challenges and Questions:

Data Scraping and Management:

How can I efficiently scrape and update data from 120 websites using Octoparse or any other tool?
Are there any better alternatives to Octoparse for handling such a large scale of data sources?

I appreciate any feedback, suggestions, or experiences you can share to help me successfully develop this dropshipping e-commerce website.

Thank you in advance for your help!

I prepared only my solution but now i want help from Stack Overflow Community