Understand Gumbel-Softmax Distribution with Examples
In this tutorial, we will use some examples to show what is the gumbel-softmax distribution and how to use it.
Machine Learning Tutorials and Examples for Beginners
Machine learning is a data analytics technique that teaches computers to do what comes naturally to humans and animals: learn from experience.
In this page, we write some tutorials and examples on machine learning algorithms and applications. You can learn how to use machine learning in life by following our tutorials.
Fix use_cache=True is incompatible with gradient checkpointing – LLM Tutorial
In this tutorial, we will introduce how to fix use_cache=True is incompatible with gradient checkpointing when finetuning a llm model.
LLM Temperature Explained – LLM Tutorial
When we use LLM model to generate a text, we may see a temerature parameter. In this tutorial, we will discuss it.
Llama2 LlamaRMSNorm Explained – LLM Tutorial
Llama2 has used LlamaRMSNorm module to save training time. In this tutorial, we will introduce it for beginners.
The Order of BatchNorm and ReLU in Convolutional Networks
conv(weight)+BN+ReLU is the basic operation when building convolutional networks. How about conv(weight)+ReLU+BN? In this tutorial, we will discuss this topic.
Mixed Precision Training for Beginners – Deep Learning Tutorial
In this tutorial, we will introduce what is mixed precision training, how about the effect of it and how to use it.
Layer Normalization Effect in RNN, CNN and Feed-Forward Networks – Deep Learning Tutorial
In this tutorial, we will discuss the different effect of layer normalization in RNN, CNN and Feed-Forward Networks.
Resnet V1 vs Resnet V2: Compare the Structure – Deep Learning Tutorial
In this tutorial, we will introduce the structure of Resnet V1 and Resnet V2, we also discuss the performance of them.
Understand Causal Padding in Convolutional Neural Networks – Deep Learning Tutorial
In this tutorial, we introduce what is causal padding, and discuss the difference SAME or VALID padding. It will be very useful to you.
Python Generate Hash Audio Fingerprinting for Audio Retrieval and Detection – Machine Learning Tutorial
In this tutorial, we will introduce you how to use python to generate hash audio fingerprinting for audio retrieval and detection. It contains three parts, we will introduce you one by one.