Join us

How AWS S3 serves 1 petabyte per second on top of slow HDDs

How AWS S3 serves 1 petabyte per second on top of slow HDDs

AWS S3 doesn’t need fancy hardware. It wrings performance out of cheap HDDs, log-structured merge trees, and erasure coding. The trick? Shard everything. Hit it in parallel.

Randomized placement dodges hotspots. Hedged requests race the slowest links. And when things get lopsided, S3 rebalances - constantly pulling in fresh drives, spreading the load, keeping IO sane.


Let's keep in touch!

Stay updated with my latest posts and news. I share insights, updates, and exclusive content.

Unsubscribe anytime. By subscribing, you share your email with @faun and accept our Terms & Privacy.

Give a Pawfive to this post!


Only registered users can post comments. Please, login or signup.

Start writing about what excites you in tech — connect with developers, grow your voice, and get rewarded.

Join other developers and claim your FAUN.dev() account now!

Avatar

The FAUN

@faun
A worldwide community of developers and DevOps enthusiasts!
Developer Influence
3k

Influence

302k

Total Hits

3712

Posts