How to efficiently copy 400,000 files between S3 buckets with different names and paths?
I have millions of files in an S3 bucket located in one AWS region. I need to copy about 400,000 of these files to another S3 bucket located in a different region, but with different file names and paths. I have a CSV file that maps the source keys to the destination keys, specifying where each file should be copied and what its new name should be.