Join us

walrus: ingesting data at memory speeds

walrus: ingesting data at memory speeds

Walrus is a lock-free, single-node Write Ahead Log in Rust that rips through a million ops/sec and moves 1 GB/s of write bandwidth - on bare-metal, nothing fancy. It leans on mmap-backed sparse files, atomic counters, and zero-copy reads to get there.

Each topic gets its own line of 10MB memory-mapped blocks, stuffed inside 1GB files. Cleanup’s handled with checkpoint-driven deletion. No coordination overhead - just a lean async job runner and CPU-pinned writers keeping things moving.


Let's keep in touch!

Stay updated with my latest posts and news. I share insights, updates, and exclusive content.

Unsubscribe anytime. By subscribing, you share your email with @faun and accept our Terms & Privacy.

Give a Pawfive to this post!


Only registered users can post comments. Please, login or signup.

Start writing about what excites you in tech β€” connect with developers, grow your voice, and get rewarded.

Join other developers and claim your FAUN.dev() account now!

Avatar

The FAUN

@faun
A worldwide community of developers and DevOps enthusiasts!
Developer Influence
3k

Influence

302k

Total Hits

3712

Posts