Join us

walrus: ingesting data at memory speeds

walrus: ingesting data at memory speeds

Walrus is a lock-free, single-node Write Ahead Log in Rust that rips through a million ops/sec and moves 1 GB/s of write bandwidth - on bare-metal, nothing fancy. It leans on mmap-backed sparse files, atomic counters, and zero-copy reads to get there.

Each topic gets its own line of 10MB memory-mapped blocks, stuffed inside 1GB files. Cleanup’s handled with checkpoint-driven deletion. No coordination overhead - just a lean async job runner and CPU-pinned writers keeping things moving.


Let's keep in touch!

Stay updated with my latest posts and news. I share insights, updates, and exclusive content.

By subscribing, you share your email with @faun and accept our Terms & Privacy. Unsubscribe anytime.

Give a Pawfive to this post!


Only registered users can post comments. Please, login or signup.

Start blogging about your favorite technologies, reach more readers and earn rewards!

Join other developers and claim your FAUN.dev() account now!

Avatar

The FAUN

@faun
A worldwide community of developers and DevOps enthusiasts!
Developer Influence
3k

Influence

302k

Total Hits

3715

Posts