Overview of Data Quality and Profiler

With OpenMetadata, you can build trust in your data by creating tests to monitor that the data is complete, fresh, and accurate. OpenMetadata supports data quality tests for all of the supported database connectors. Users can run tests at the table and column levels to verify their data for business as well as technical use cases.

The profiler in OpenMetadata helps to understand the shape of your data and to quickly validate assumptions. The data profiler helps to capture table usage statistics over a period of time. This happens as part of profiler ingestion. Data profiles enable you to check for null values in non-null columns, for duplicates in a unique column, etc. You can gain a better understanding of column data distributions through the descriptive statistics provided.

OpenMetadata provides Data Quality workflows, which helps with:

• Native tests for all database connectors to run assertions.
• Alerting system to send notifications on test failure.
• Health dashboard to track realtime test failure and to prioritize efforts.
• Resolution workflow to inform the data consumer on test resolutions.

The data quality in OpenMetadata is also extensible to adapt to your needs.

Profiler & Data Quality

Watch the video to understand OpenMetadata’s native Data Profiler and Data Quality tests.

Watch the video on Data Quality Simplified to effortlessly build, deploy, monitor, and configure alerts using OpenMetadata's no-code platform