Join us
@faun ・ Aug 18,2024
Zomato's production generated over 50 TB of uncompressed logs per day, peaking at 150 million logs per minute. To handle this, they transitioned from Elasticsearch to Clickhouse, leveraging its horizontal scalability and low latency. Custom Golang workers efficiently batched log insertions, using AWS spot instances for cost savings and using a semi-structured schema to optimize data management. They also implemented query throttling mechanisms and advanced monitoring to ensure performance and resiliency.
Share with your friends and followers
Join other developers and claim your FAUN account now!
Only registered users can post comments. Please, login or signup.