Scrapy – uploading images to S3 storage uses HEAD instead of PUT => the images are not uploaded
I run a spider to obtain some data and part of it is downloading images to the S3 storage. I noticed that sometimes the images are not uploaded to S3 and when checking the log, I see that when an image is successfully uploaded, boto3 used the PUT method. When an image is not successfully uploaded, it uses the HEAD method.