OpenRefine is a free, open source power tool for working with messy data and improving it

A Scalable Data Cleaning Library for PySpark.

Table Enforcer is my attempt to apply a sort of "test driven development" workflow to data cleaning and validation. A python package to facilitate the iterative process of developing and using schema-like representations of DataFrames in pandas for recoding and validating instances of these data.

Examples for Optimus a Data Cleansing Library for Big Data.

Data cleansing and validation for Data Science Master degree

CSVParser is a tool to parse csv file using univocity and commons csv parsers. It cleans new line (\n) character & special characters between data. It also handle various garbage data like odd no of quotes or delimiters in side quotes. It validate each record with specified delimiter count and separate it out to _GoodRecords.CSV and _BadRecords.CSV file. This is a Data Cleaner tool to run before ingestion to Data Lake. It make sure data is in right csv format to build table on it.

we use keras and tensorflow and sklearn to classify health level of student by using Nursey UCI Dataset

Programs I write for my Data Mining course