Comments (5)
Hi, here I am simulating a case where we do not have the clean dataset at all. All we have to work with is the "noisy" data. The goal of the this autoencoder is to ignore the noise and instead learn to reconstruct just the core elements of X_train_AE. We don't want the autoencoder to learn to reconstruct perfectly X_train_AE_noisy at all. We want the autoencoder to learn to ignore the noise while it's learning. That's why we train on X_train_AE_noisy but we evaluate on X_train_AE. Please drop me a note if this is still unclear.
from handson-unsupervised-learning.
Great question. By underfitting the autoencoder on the noisy data, the autoencoder learns the common "signal" but ignores the rare "noise". If the noise truly drowns out the signal in an overwhelming way, even underfitting the autoencoder won't cut it. But, in instances where the noise is present but not the majority of the data, underfitting works well in practice.
Does this underfitting clarify how using an autoencoder on a noisy dataset still achieves the end objective of learning the signal in the data but ignoring the noise?
from handson-unsupervised-learning.
from handson-unsupervised-learning.
Thank you for the reply,
The goal of the this autoencoder is to ignore the noise and instead learn to reconstruct just the core elements of X_train_AE.
The concept is clear, but what is not clear to me is how we get this if the objective of the learning (the target of training) is the noisy input Itselfs. How do we "teach" to the Autoencoder what is the noise if It only sees noised data ?
from handson-unsupervised-learning.
Yeah thank you! I have a more clear idea now.
Anyway, what about training the Autoencoder to reconstruct the original data (without noise) ? Could be an effective alternative ? (Just to complete my overview on this topic)
Obiously with the constraint that we have the un-noised data.
from handson-unsupervised-learning.
Related Issues (17)
- xgboost on mac
- Train set for anomaly detection with PCA HOT 4
- Anomaly score for anomaly detection HOT 1
- about reproducibility HOT 1
- How to use this repository with the Hands-on Unsupervised Learning Book? / Missing files HOT 5
- 02_end_to_end_machine_learning_project.ipynb Error HOT 1
- credit_card.csv is missing HOT 7
- why not splitting them before scaling datasets HOT 2
- Unnecessary complexity (I think)
- Group segmentation
- Where is the code for the optimal number of principal components (Chapter 4)?
- 02_end_to_end_machine_learning_project - LightGBM model not working
- 08 Autoencoders possible error HOT 1
- function view_digit (chapter 3) has hard-coded value HOT 7
- 09_semisupervised - LightGBMError: Do not support special JSON characters in feature name. HOT 1
- 09_semisupervised - ValueError: Error when checking target: expected dense_3 to have shape (29,) but got array with shape (30,) HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from handson-unsupervised-learning.