The Data Cleaning component incorporates algorithms and techniques for detecting and correcting (or removing) corrupt or inaccurate records from all the diverse types of collected data that will be ingested into the PolicyCLOUD platform.
Data Validation, Data Cleaning, Data Verification
The Data Cleaning component will offer all the appropriate algorithms and techniques for detecting and correcting (or removing) corrupt or inaccurate records from all the collected data that will be inserted into the PolicyCLOUD platform. As a result, all the parties that will exploit this mechanism will be able to initially identify all the incomplete, incorrect, inaccurate or irrelevant parts of this data, and then replace, modify, or delete the dirty or coarse data that they are willing to ingest into the platform. To this end it should be mentioned that the component has been designed in such a way that it can work independently by the PolicyCLOUD platform, offering a global approach, and thus being exploited by different parties for their own cleaning purposes. On top of this, all the offered features of the component include a level of customization in terms of rules for validation, cleansing, etc., tailored to the needs of each different party that exploits the component.