Concepts overview
Understand the ideas behind real-time data movement in Streamkap, including change data capture, inserts and upserts, schema evolution, snapshots, and metadata.
Whether you’re an experienced data engineer or new to real-time data processing, the links below will help you understand some key concepts about real-time data processing and our platform’s architecture:”
What is CDC?
Inserts/Upserts
Schema Evolution Support
Snapshots & Backfilling
Batch vs Streaming Data
Metadata
Also worth reading
Data encoding explains how records are serialised, and the schema registry how their schemas are stored and evolved.