Root Cause Analysis
Failed Rows Sample
Some tests will produce a failed sample upon failure. This allows the platform users to understand the nature of the failure and take corrective actions. The failed sample will be a subset of the rows that failed the test.
The sample will be collected when the option computePassedFailedRowCount
is set.
Supported Test Definitions
- Column Values to Be Not Null
- Column Values to Match Regex
- Column Values to not Match Regex
- Column Values to Be in Set
- Column Values to Be Not In Set
- Column Values to Be Between
- Column Values Lengths to Be Between
- Custom SQL
Deleting Sample Rows
If you wish to delete sample rows, you can do so by clicking on the three dots above the table of sample rows. This will open a window with the Delete
option. Note that failed sample rows will automatically be deleted upon test success.
Example
Inspection Query
Supported test will generate an inspection query upon failure. This query can be run on the source data to understand the nature of the failure and take corrective actions.
This query can be added to the table and shared with other users.