**Neural Network Tutorials - Herong's Tutorial Examples** - v1.22, by Herong Yang

Neural Network Tutorials - Herong's Tutorial Examples

https://www.herongyang.com/Neural-Network

© 2019-2023 Herong Yang. All rights reserved.

This book is a collection of notes and sample codes written by the author while he was learning Neural Networks in Machine Learning. Topics include Neural Networks (NN) concepts: nodes, layers, activation functions, learning rates, training sets, etc.; deep playground for classical neural networks; building neural networks with Python; walking through Tariq Rashi's 'Make Your Own Neural Network' source code; using 'TensorFlow' and 'PyTorch' machine learning platforms; understanding CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), GNN (Graph Neural Network). Updated in 2023 (Version v1.22) with minor updates.

Table of Contents

Deep Playground for Classical Neural Networks

Impact of Extra Input Features

Impact of Additional Hidden Layers and Neurons

Impact of Neural Network Configuration

Impact of Activation Functions

Building Neural Networks with Python

NumPy - Python Library for Matrix operations

SciPy - Python Library for Mathematical Functions

Simple Example of Neural Networks

"Make Your Own Neural Network" in Python

TensorFlow - Machine Learning Platform

"tensorflow" - TensorFlow Python Library

"tensorflow" Interactive Test Web Page

TensorFlow Session Class and run() Function

TensorFlow Variable Class and load() Function

Linear Regression with TensorFlow

tensorflow.examples.tutorials.mnist Module

mnist.read_data_sets() Is Deprecated

Simple TensorFlow Model on MNIST Database

Commonly Used TensorFlow functions

PyTorch - Machine Learning Platform

Commonly Used 'torch' functions

CNN (Convolutional Neural Network)

What Is CNN (Convolutional Neural Network)

RNN (Recurrent Neural Network)

What Is RNN (Recurrent Neural Network)

What Is LSTM (Long Short-Term Memory)

What Is GRU (Gated Recurrent Unit)

GAN (Generative Adversarial Network)

Performance Evaluation Metrics

**Keywords:** Neural Network, Machine Learning, Artificial Intelligence