OpenMetaData

OpenMetaData is an open standard and platform for unified metadata management. It connects to your databases, Kafka clusters, and dashboards to create a "Metadata Graph." It allows you to track data as it transforms from a raw event in Kafka to a table in Snowflake and finally to a dashboard in Tableau.

‍

Why use it in EDA? It solves the "Black Box" problem. In EDA, it’s hard to see the impact of changing a schema. OpenMetaData provides column-level lineage, so you can see exactly which downstream reports will break if you change an event field. It brings data governance to the streaming world.

‍

How do we use it?

• Impact Analysis: Checking dependencies before deploying schema changes.
• Data Quality: defining and monitoring quality tests for your data streams.‍
• Collaboration: Allowing data teams to tag, document, and discuss data assets in one place.