rlmcpherson/s3gof3r

Health v2 · maintenance only

Adoption not part of the score

1143 stars · 180 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

s3gof3r is a Go library providing fast, parallelized, streaming access to Amazon S3, optimized for large object transfers. It also ships gof3r, a CLI that supports streaming uploads/downloads through Unix pipes with end-to-end integrity checking and automatic retries.

Use cases

• stream large files to and from amazon s3 at high speed
• pipe a tar archive directly into s3 from the command line
• upload big objects to s3 with parallel multipart transfers
• download s3 objects with md5 integrity verification
• stream data through unix pipes while uploading to s3

When to choose

• you need maximum-throughput streaming transfers of large objects to/from S3 from Go or the shell
• you want built-in md5 integrity checking and automatic retries on every part
• you want to compose S3 transfers with other tools via pipes

When to avoid

• you need broad AWS SDK features beyond S3 or support for other cloud providers
• you need a maintained, actively developed client - the project has seen little activity since 2021
• you only transfer small files where parallelism offers no benefit

Facets

library · maturity maintenance

http-client cli file-upload concurrency cloud-computing developer-tools files go cli cloud amazon-s3 streaming multipart-upload object-storage pipes linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="rlmcpherson/s3gof3r")