Data Cleansing / Scrubbing Data Cleansing or Scrubbing transforms data to make it conform to data standards and domain rules. Cleansing includes detecting and correcting data errors to bring the …
Data Quality – Data Profiling
Data Profiling is a form of data analysis used to inspect data and assess quality. Data profiling uses statistical techniques to discover the true structure, content, and quality of a …
Data Quality – Causes of Data Quality Issues – Part-03
Issues Caused by System Design Failure to Enforce Referential Integrity: Referential integrity is necessary to ensure high quality data at an application or system level. If referential integrity is not …
Data Quality – Causes of Data Quality Issues – Part-02
Issues Caused by Data Entry Processes Data Entry Interface Issues: Poorly designed data entry interfaces can contribute to data quality issues. If a data entry interface does not have edits …
Data Quality – Causes of Data Quality Issues – Part-01
Data Quality issues can emerge at any point in the data lifecycle, from creation to disposal. When investigating root causes, analysts should look for potential culprits, like problems with data …
Data Quality – Business Rules
Business Rules are commonly implemented in software, or by using Document Templates for Data Entry. Some common simple Business Rule types are: Definitional Conformance: Confirm that the same understanding of …
Data Quality – Components and Tools
Data Quality Components Data Profiling Data Quality Analysis Validation Data Cleansing Matching Eliminate Errors, Duplications and Inconsistencies Data Quality Monitoring Views, Reports and Dashboards Data Quality Tools Examples Informatica Data …
Data Management – Data Profiling
Understanding Data Content and Structure is essential for Data Governance, Data Architecture, Data Modeling and Design, Data Storage and Operations, Data Security, Data Quality and Data Integration and Interoperability. Data …