This repository contains small projects mainly related to Deep Learning but also Data Science in general. Subjects are closely linekd with articles I publish on Medium and are intended to complement the blog posts. I hope that the content of the repository will turn out to be interesting and, above all, useful. I encourage you both to read as well as to check how the code works in the action.

# clone repository
git clone https://github.com/SkalskiP/ILearnDeepLearning.py.git

# navigate to main directory
cd ILearnDeepLearning.py

# set up and activate python environment
python3 -m venv .env
source .env/bin/activate

# install all required packages
pip install -r requirements.txt

This project is mainly focused on visualizing quite complex issues related to gradient descent, activation functions and visualization of classification boundaries while teaching the model. It is a code that complements the issues described in more detail in the article Deep Dive into Math Behind Deep Networks. Here are some of the visualizations that have been created.

Figure 1. A classification boundaries graph created in every iteration of the Keras model.
Finally, the frames were combined to create an animation.

Figure 2. Visualization of the gradient descent.

This time I focused on the analysis of the reasons for overfitting and ways to prevent it. I made simulations of neural network regulation for different lambda coefficients, analyzing the change of values in the weight matrix. Take a look at the visualizations that were created in the process. Also check the article Preventing Deep Neural Network from Overfitting.

Figure 3. Figure 3. Classification boundaries created by: top right corner - linear regression;
bottom left corner - neural network; bottom right corner - neural network with regularisation

Figure 4. Change of accuracy values in subsequent epochs during neural network learning.

Both in my articles and projects I try to create interesting visualizations, which very often allow me to communicate my ideas much more effectively. I decided to create a short tutorial to show you how to easily create animated visualizations using Matplotlib. I also encourage you to read - Simple Method of Creating Animated Graphs - where I described, among other things, how to create a visualization of neural network learning process.

Figure 5. Lorenz Attractor created using the Matplotlib animation API.

This project is licensed under the MIT License - see the LICENSE.md file for details

This is a place where I collect links to interesting articles and papers, which I hope will become the basis for my next projects in the future.

1. Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
2. Sequence to Sequence Learning with Neural Networks
3. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
4. BLEU: a Method for Automatic Evaluation of Machine Translation
5. Neural Machine Translation by Jointly Learning to Align and Translate