Data Quality Tasks

Definition

This module is used to configure and execute Data Quality evaluation tasks, helping users comprehensively understand indicators such as data accuracy, completeness, consistency, uniqueness, and timeliness, and supporting closed-loop Data Governance management.

Module Features

• ✅ Quality Evaluation Task Management: supports adding, editing, deleting, and viewing quality tasks. The task list displays categories, table counts, rule counts, execution strategies, latest status, and operation items;
• 📝 Basic Information Configuration: fill in metadata such as task name and category to facilitate task classification and identification;
• 📋 Evaluation Object Selection: loads table structures from the specified data source and supports selecting multiple tables as evaluation targets;
• 🧩 Rule Configuration Management: each table can be configured with multiple Audit Rules and supports adding, enabling, disabling, editing, and deleting rules;
• 🧯 Issue Data View: supports viewing abnormal data details from the latest execution result to help locate issues;
• 📊 Quality Report Records: each task execution generates an independent report, forming a historical archive for quality evaluation and supporting traceability.

Notes

Quality rules should be configured together with standard fields, Data Elements, and actual business logic. We recommend setting scheduling strategies reasonably to avoid frequent execution causing pressure on source databases.

Scope

For users with Data Governance responsibilities, this module is used to build quality evaluation tasks, perform multi-dimensional checks on specified data tables, identify issue data, and generate quality reports. It is applicable to Data Quality monitoring and traceability analysis for various structured data sources.

• Asset Map
• Project Assets

1. Data Quality Tasks Page

Click Data Assets -> Data Quality -> Data Quality Tasks to open the Data Quality Tasks page. The page uses a left-right layout: the left side displays Data Quality Categories in a tree structure, and the right side displays the Data Quality Tasks list, including ID, task name, number of audit objects, number of Audit Rules, Task Status, execution strategy, category, and other fields.

1. Add Data Quality Task

Click Add. The dialog that appears includes three parts: basic information, audit objects, and Audit Rules. After filling them in, click OK to complete adding the Data Quality Task. If the basic information, audit objects, or Audit Rules need to be changed while filling them in, click Previous to edit them.

1.1. Basic Information

Fill in the basic information and attribute information. After completing it, click Next to fill in the audit object data.

Basic Information.png

1.2. Audit Object

Click Add, fill in the audit object information in the dialog, and click OK to complete adding the audit object. After completing it, click Next to fill in the Audit Rules data.

Audit Object 1.png

Audit Object 2.png

1.3. Audit Rules

Click Add, select the audit object in the Add Evaluation Information dialog, fill in the Audit Rules - Enumeration Value Check information, and click OK to complete adding the Audit Rules. After completing it, click Save and Exit to create the Data Quality Task.

Audit Rules 1.png

Audit Rules 2.png

Audit Rules 3.png

2. Edit Data Quality Task

Click the Data Quality Task to edit, then click Configuration in the operation column to open the Data Quality Task edit page. (Same as 1)

Edit Data Quality Task.png

3. Data Quality Tasks Details

Click the Data Quality Task whose details need to be viewed, then click Details in the operation column to open the Data Quality Task details page.

Data Quality Tasks Details 1.png

Data Quality Tasks Details 2.png

Data Quality Tasks Details 3.png

4. Run Once

Select the Data Quality Task that needs to run once, click More -> Run Once in the operation column, and the system will run the task once and display related information. (Note: the task must be enabled before running once)

Run Once.png

5. View Execution Records

Select the Data Quality Task whose execution records need to be viewed, click More -> Execution Records in the operation column, and view the execution record list in the dialog.

View Execution Records.png

5.1. View Logs

Select the execution record whose logs need to be viewed, click View Logs in the operation column, and view the logs in the dialog.

View Logs.png

5.2. Execution Record Details

Select the execution record whose details need to be viewed, click Details in the operation column, and jump to qualitytasklog to view details.

Details.png