Implement Convolution Module in Conformer Using TensorFlow – TensorFlow Tutorial
In this tutorial, we will introduce how to use tensorflow to implement convolution module in conformer.
Python __call__(): Call Function with Dynamic Parameters – Python Tutorial
In this tutorial, we will introduce how to use python __call__() function to call other functions with dynamic parameters.
Understand Dropout – Place it Before or After Activation Function in Dense Layer?
In deep learning, we usually place a dropout layer after a dense layer. However, here is a problem? Dropout layer is placed before or after activation function.
Understand Convolution Subsampling Module in Conformer – Deep Learning Tutorial
Convolution subsampling module is an important part for processing inputs in conformer. In this tutorial, we will introduce how to implement it using tensorflow.
Implement Sinusoidal Position Encoding in TensorFlow – TensorFlow Tutorial
Sinusoidal position encoding or postion embedding is used in transformer. In this tutorial, we will introduce you how to implement it using tensorflow.
Step Guide to Plot Multiple Lines in Matplotlib – Matplotlib Tutorial
In this tutorial, we will introduce you how to plot multiple lines in a chart using python matplotlib. It is very easy.
Implement Feed Forward Module in Conformer Using TensorFlow – TensorFlow Tutorial
In this tutorial, we will introduce conformer feed forword module and how to implement it using tensorflow.
Post-Norm and Pre-Norm Residual Units Explained – Deep Learning Tutorial
In this tutorial, we will introduce post-norm and pre-norm residual units, they are often used to improve transformer in deep learning.
Dropout vs Batch Normalization – Which is Better for Multilayered Neural Network
Dropout and batch normalization are two well-recognized approaches to tackle overfitting in multilayered neural networks, which one is better? In this tutorial, we will discuss this topic.
Swish (Silu) Activation Function in TensorFlow: An Introduction – TensorFlow Tutorial
In this tutorial, we will introduce how to implement swish or silu activation function in tensorflow. There are some tips you should notice.