you could split to buckets like alphanumerically and parallelize it if you don't want to wait that long. Probably need to launch a few instances but still cheaper lol.
A credit union wants to get their own data out of a vendor's online system. Vendor wants $160,000. I wrote a script with to download the data just as though a user would. It's going to run for about 6 weeks to download around 250k records and 70GB of images.