Level 8
Can you not add each upload to a job and let a queue worker process each one?
Jun 12, 2017
2
Level 11
Upload Thousands of Files to Amazon s3
Currently my site is dynamically creating images with watermarks and then uploading these to amazon s3, with details being saved to a MySql table.
What would be the best way to perform this action for all images that I want to upload. There are approx 19,000 images within the database which need uploading. Could I handle this with a scheduled event to run every 30 minutes to take the first 100 and upload those. Would this timeout?
Level 1
For Upload or Download, I use the following Package which works great.
https://zappysys.com/products/ssis-powerpack/ssis-amazon-s3-task/
Hope this Helps!
Please or to participate in this conversation.