How we built ngrok's data platform

At ngrok, a solo engineer manages a data lake, embracing a unique approach where data engineering blends deeply with backend work, leveraging open-source tools like Airbyte, Flink, and dbt, alongside AWS and Clickhouse, facilitating a highly collaborative environment within a Go monorepo, tackling schema inconsistencies and efficient Protobuf streaming to ensure robust data handling and effective abuse prevention.