I have a scrapper that must make custom requests to an api. The point is that these requests need to be dynamic, as they can be managed, that is, added or removed. Every time a request is added, the system needs to immediately start scraping.
I’ve been researching NodeJS workers and promises, but I haven’t found a way to build this pool in realtime yet. Could you give me some guidance on this problem?