Intelligent, automatic restarts for unhealthy Kafka consumers

Cloudflare utilizes Kafka to ensure resilient failure-level infrastructure. Kafka helps manage and segregate messages into topics and partitions. Health checks are notoriously hard to implement, but Cloudflare uses the offset value to ensure forward progress and detects consumer failure. Kafka allows Cloudflare to focus on message ingestion and makes their application operation and health checks less manual.