To be clear this is not a requirement to identify and redirect or dedupe rows in the data flow task leveraging the Sort Transformation. Instead the requirement is to identify duplicate values in a column then redirect those rows. As an example, using the attached table, ProductID 1001 is duplicated therefore rows 3 and 4 should be redirected. Likewise, for column ProductCode, the A01 code is duplicated hence rows 2 and 6 need to be redirected. Any help is appreciated. Thanks!

enter image description here

I tried splitting the dataset then performing joins but that didn’t work as intended.