Skip to content

SelvamathanS/Outlier_treatment-and-Data_transformation-using-various-methods

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

Outlier_treatment-and-Data_transformation-using-various-methods

This repository focuses on statistical techniques for handling missing values, detecting and treating outliers, and transforming data distributions to improve data quality for machine learning models.

Concepts Covered

  • Identifying missing values
  • Filling missing data using:
    • Mean
    • Median
    • Mode
  • Outlier detection using IQR method
  • Removing outliers using boolean masking (~)
  • Handling outliers across multiple numerical columns
  • Capping / Winsorization (1st–99th percentile)
  • Data transformation techniques:
    • Log transformation
    • Square root / Power transformation (Yeo-Johnson)
    • Box-Cox transformation
  • Scaling
  • Normalizing

Libraries Used

  • pandas, numpy
  • scikit-learn
  • scipy

🎯 Why This Matters

Outlier treatment and data transformation help stabilize variance, reduce skewness, and improve the performance of machine learning algorithms.


⭐ Star the repository if you find it useful!

About

Statistical techniques for handling missing values, encoding, scaling, normalizing, detecting and treating outliers, and transforming data distributions

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors