Any assitance would be appreciated. Since scrapy is based on twisted, it has an archaeic way to deploy and run spiders. “Twisted Reactor” can only started and stop once and cannot be restarted for starters, which makes it quite a challenge to integrate with modern workflows. For instance, I’m trying to create a prefect task, flow so that I can track the progress of each spider and also run them all at once. Componentizing them is important for the code quality and I can’t just clump them together and run the reactor at last as shown in the docs.