Handling Schema Evolution in the Data Pipelines at KOHO

Koho's event data pipeline handles schema evolution. The catalog service maintains a history of schema evolution, the ingestion service consumes multiple event versions, multiple table versions are maintained, and users can query them via a view or ad hoc query. This approach ensures data consumers have access to a complete dataset that is up-to-date.