Join us

Handling Schema Evolution in the Data Pipelines at KOHO

Handling Schema Evolution in the Data Pipelines at KOHO

Koho's event data pipeline handles schema evolution. The catalog service maintains a history of schema evolution, the ingestion service consumes multiple event versions, multiple table versions are maintained, and users can query them via a view or ad hoc query. This approach ensures data consumers have access to a complete dataset that is up-to-date.


Only registered users can post comments. Please, login or signup.

Start blogging about your favorite technologies, reach more readers and earn rewards!

Join other developers and claim your FAUN account now!

Avatar

The FAUN

@faun
A worldwide community of developers and DevOps enthusiasts!
User Popularity
3k

Influence

283k

Total Hits

1

Posts