Different types of Data play different roles within an organization. They also have different management requirements. Malcolm Chisholm has proposed a six-layer Taxonomy of Data that includes Metadata, Reference Data, …
Reference and Master Data Management – Guiding Principles
Shared Data: Reference and Master Data must be managed so that they are shareable across the organization. Ownership: Reference and Master Data belong to the organization, not to a particular …
Data Quality – Parsing and Transformation
Data Parsing and Formatting Data Parsing is the process of analyzing data using pre-determined rules to define its content or value. Data parsing enables the data analyst to define sets …
Data Quality – Cleansing and Enrichment
Data Cleansing / Scrubbing Data Cleansing or Scrubbing transforms data to make it conform to data standards and domain rules. Cleansing includes detecting and correcting data errors to bring the …
Data Quality – Data Profiling
Data Profiling is a form of data analysis used to inspect data and assess quality. Data profiling uses statistical techniques to discover the true structure, content, and quality of a …
Data Quality – Causes of Data Quality Issues – Part-03
Issues Caused by System Design Failure to Enforce Referential Integrity: Referential integrity is necessary to ensure high quality data at an application or system level. If referential integrity is not …
Data Quality – Causes of Data Quality Issues – Part-02
Issues Caused by Data Entry Processes Data Entry Interface Issues: Poorly designed data entry interfaces can contribute to data quality issues. If a data entry interface does not have edits …
Data Quality – Causes of Data Quality Issues – Part-01
Data Quality issues can emerge at any point in the data lifecycle, from creation to disposal. When investigating root causes, analysts should look for potential culprits, like problems with data …
Data Quality – Business Rules
Business Rules are commonly implemented in software, or by using Document Templates for Data Entry. Some common simple Business Rule types are: Definitional Conformance: Confirm that the same understanding of …
Data Quality Programs – Guidance and Principles
Criticality: A Data Quality program should focus on the data most critical to the enterprise and its customers. Priorities for improvement should be based on the criticality of the data …