I am trying to refactor my current existing code base to download multiple files from S3. If I understand correctly the documentation, I am doing too many requests in a short period of time (1), (2) & (3).
Looking at the AWS SDK documentation it appears that a proper implementation exists, as described at:
- https://docs.aws.amazon.com/sdkref/latest/guide/feature-retry-behavior.html
However I have been unable to use it so far. I did check the example page:
See “Upload or download large files” at:
- https://docs.aws.amazon.com/sdk-for-net/v3/developer-guide/csharp_s3_code_examples.html
Anyone knows how to use AWS SDK to properly download multiple files from S3 using a pre-signed URL ? I have a reproducable case where a basic HTTP client setup fails for number of files equals 7000.
References:
- https://repost.aws/knowledge-center/http-5xx-errors-s3
- https://docs.aws.amazon.com/sdkref/latest/guide/feature-retry-behavior.html
- https://docs.aws.amazon.com/sdk-for-net/v3/developer-guide/retries-timeouts.html
you can clone your s3 bucket on your local directory which will automatically download your videos
Haseeb Khan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.