Data Integrity: Data Quality Rules
Creating a Data Quality Rule
Data8 Data Integrity allows the creation of customised data quality scores for any table across Dataverse. Navigate to “Rules” table on the main sitemap and click “New” to create a new rule.
By default, new rules will be in a draft status, allowing them to be created and refined before publishing them. Published rules are read only to prevent issues with the score validity as rules can be amended over time. Each rule has a version number that is managed by the Data8 Data Integrity solution and this version number is stored for each recalculation.
When creating a new rule, you’ll need to input a name, select the table from the drop down menu before selecting the field in which to store the score – this field will need to be created by you and will need to of a “whole number” field.
Once you have selected the table name and the scoring field name, the “Rule Definition” box should load in the metadata and allow you to start building a rule.
Advanced Data Quality Rules Settings
You can to specify a “Next Calculation” field – this field is only used if you use a rule that is time based as the score will change over time. This should be a Date Time field.
By default, we store score changes for 1 year but this can be override here.
Lookup Override Field & Lookup Override Field Logical Name:
There may be some situations where you cannot make a score on the table you want (think systemuser) – this option allows you to make a new table with a lookup and it will act like an interim table, so you may make a “System User Score” table which has a score and a look up to the systemuser. By setting these values, the rule definition context will be override from the logical name set earlier on, to this new override value.
For information on score types, Click Here.
