The Preprocessor Python package provides a simple and easy-to-use interface for data preprocessing in machine learning projects. It includes various methods for data cleaning, scaling, and encoding.

You can install the Preprocessor package using pip:

pip install rhinorefine

The Preprocessor class is the main class of this package. You can create an instance of this class by providing the filepath of the CSV file that you want to preprocess.

from rhinorefine import Preprocessor
preprocessor = Preprocessor('path/to/your/csv/file.csv')

The fillwithmean, fillwithmedian, and fillwithmode methods can be used to fill the missing values in a column with the mean, median, or mode value of that column, respectively.

preprocessor.fillwithmean('column_name')
preprocessor.fillwithmedian(['column_name_1', 'column_name_2'])
preprocessor.fillwithmode('column_name')

The removeColumn method can be used to remove a column from the dataset. You can pass the column name as an argument.

preprocessor.removeColumn('column_name')

The nullValues method returns a dictionary containing the number of null values in each column.

null_values = preprocessor.nullValues()
print(null_values)

The standardizeColumn and standardizeData methods can be used to standardize the data by subtracting the mean and dividing by the standard deviation. You can pass the column name as an argument.

preprocessor.standardizeColumn('column_name')
preprocessor.standardizeData()

The normalizeColumn and normalizeData methods can be used to normalize the data by scaling the values between 0 and 1. You can pass the column name or a list of column names as an argument.

preprocessor.normalizeColumn('column_name')
preprocessor.normalizeData()

The categoricalEncoding method can be used to perform one-hot encoding on a categorical column. You can pass the column name or a list of column names as an argument.

preprocessor.categoricalEncoding('column_name')

The compressLossy method can be used to compress the data using the K-Means algorithm. You can pass the number of clusters as an argument.

preprocessor.compressLossy(10)

The compressNonLossy method can be used to compress the data using Principal Component Analysis (PCA). You can pass the number of components as an argument.

preprocessor.compressNonLossy(5)

The save method can be used to save the preprocessed data to a CSV file.

preprocessor.save()

The Preprocessor Python package provides a simple and effective way to preprocess data for machine learning projects. It includes various methods for data cleaning, scaling, encoding, and compression. It can save a lot of time and effort for data scientists as well as machine learning engineers.