Do I have to do normalization on my data if all the features are of the same scale? for example, all the columns are features and each row/sample is the number of occurrences for each feature? And if normalization is required do I need feature-wise or sample-wise normalization?
When to perform Normalization or Standardization in machine learning?
562 views Asked by Martina Morcos At
1
There are 1 answers
Related Questions in MACHINE-LEARNING
- How to cluster a set of strings?
- Enforcing that inputs sum to 1 and are contained in the unit interval in scikit-learn
- scikit-learn preperation
- Spark MLLib How to ignore features when training a classifier
- Increasing the efficiency of equipment using Amazon Machine Learning
- How to interpret scikit's learn confusion matrix and classification report?
- Amazon Machine Learning for sentiment analysis
- What Machine Learning algorithm would be appropriate?
- LDA generated topics
- Spectral clustering with Similarity matrix constructed by jaccard coefficient
Related Questions in NEURAL-NETWORK
- How to choose good SURF feature keypoints?
- How to avoid overfitting (Encog3 C#)?
- Run out of VRAM using Theano on Amazon cluster
- Calculating equation from image in Java
- Print output of a Theano network
- Torch Lua: Why is my gradient descent not optimizing the error?
- How can I train a neural (pattern recognition) network multiple times in matlab?
- Using Convolution Neural Net with Lasagne in Python error
- Random number of hidden units improves accuracy/F-score on test set
- Matlab example code for deep belief network for classification
Related Questions in DATASET
- Is there a data format lighter than json?
- How to remove datatable from dataset?
- fetch data from web service to dataset in Delphi
- Find All Rows in DataTable Where Column Value is NOT Unique Using Linq Query
- Binding DataGirdComboBoxColumn to DataSet doesn't work
- Visual Studio Professional 2012 says dataset is not a member of my form
- Fastest way to query SQL Server CE database file in Windows Mobile 6.5?
- to_char(Column_name) what would be the column name in dataset
- A column named 'Prize' already belongs to this DataTable
- InvalidCastException when trying to make a list from xml file
Related Questions in NORMALIZATION
- Database normalization for electricity monitoring system
- How to build this table optimally, skills per user based on another table
- Data normalization using traditional and machine learning approach?
- Normalize a feature in this table
- What is level of normalization HR Oracle Sample Database?
- How do I match "i" with Turkish i in java?
- Third Normal Form in DBMS
- Normalise relation
- Data Logical organization
- Naive Bays classifier: output percentage is too low
Related Questions in STANDARDIZATION
- How to implement PySpark StandardScaler on subset of columns?
- What is the correct way to use standardization/normalization in combination with K-Fold Cross Validation?
- KeyError on indexing a dataframe on an index that should exist
- Standardisation Across Different Datasets Before Lasso Regression
- Pytorch Normalize() receiving torch.float32 tensor but recognising it as torch.int32
- When to perform Normalization or Standardization in machine learning?
- Standardizing or Normalizing discrete variable?
- Does XGBoost need standardization or normalization?
- Calculate crude and ajusted rates per subgroup using ageadjust.direct
- How can I report the coefficients of my regression in a way they have a reasonable scale?
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
No, you do not have to do normalization on your data if all your features are on the same scale.
For standardization, you want to check the statistical distribution of your data to make sure they have a standard normal distribution with mean,μ=0 and standard deviation, σ=1; where μ is the mean (average) and σ is the standard deviation from the mean.
You can do this in pandas by calling
.describe()on your data and investigating themeanandstd. If it happens that some features have normal distribution while others don't, you can carry-our sample-wise standardization (on the entire dataset).