I’m new to ADF, I ended up creating a pipeline with 2 data flow in the pipeline.
I tested the pipeline and everything is working up until I start the trigger!
After I start the trigger, I start receiving failure messages in the monitor Triggered section. (see image below)
The error message that I get under the status column is
Execution has been throttled as concurrency value is set and maximum
number of waiting runs have been queued. Please wait for current runs
to complete or cancel stuck runs.
Under the Parameters column when I click the link it shows:
Parameter Name is pipelineFileName and the value of the parameter is part-00004-1ec52bd3-a83a-41a6-9bd0-d63b719c2448-c000.csv
This file is nowhere to be found in blob storage, the blob storage is currently empty of any csv files.
At one point when I was designing this pipeline, I tested it and it created bunch of files with weird names on the blob storage. I ended up stopping the trigger then, could these files are still in the queue of the trigger?! If yes, what do I do? is there a way to clear them so I can start fresh?
Thank you in advance for your assistance.