s5cmd
s5cmd
is a very fast S3 and local filesystem execution tool. It comes with support for a multitude of operations including tab completion and wildcard support for files, which can be very handy for your object storage workflow while working with large number of files.
There are already other utilities to work with S3 and similar object storage services, thus it is natural to wonder what
s5cmd
has to offer that others don't.
In short,
s5cmd
offers a very fast speed. Thanks to Joshua Robinson for his study and experimentation ons5cmd;
to quote his medium post:
For uploads, s5cmd is 32x faster than s3cmd and 12x faster than aws-cli. For downloads, s5cmd can saturate a 40Gbps link (~4.3Â GB/s), whereas s3cmd and aws-cli can only reach 85 MB/s and 375 MB/s respectively.