home ¦ Archives ¦ Atom ¦ RSS

Cyberduck S3 Multipart Uploading

Cyberduck Icon Taking some “vacation” time this week, and what am I doing? Uploading multi-gigabyte files to Amazon S3. So I’m a nerd.

Turns out though that uploading files greater than 5GB requires multipart uploading, which breaks the file up into chunks for better throughput and reliability. Client support for this part of the S3 API is not obvious.

Hat tip to Joe Miller for cataloging a few S3 clients that do support multipart uploads, including Cyberduck. Open source, free as in beer, cross platform, and eminently usable, Cyberduck is the Swiss Army knife of file uploading. Just for this capability I will be making a donation shortly.

© 2008-2024 C. Ross Jam. Built using Pelican. Theme based upon Giulio Fidenteā€™s original svbhack, and slightly modified by crossjam.