PyTorch Tutorials and Examples for Beginners

When we are training a pytorch model, we may want to freeze some layers or parameter. In this tutorial, we will introduce you how to freeze and train.

In this tutorial, we use an example to show you what is PyTorch model.state_dict() and how to use it.

In pytorch, TensorDataset allows us to zip serial of pytorch tensors as python zip() function. In this tutorial, we will use some examples to show you how to use.

In this tutorial, we will introduce how to implement mixed precision training with torch.cuda.amp.GradScaler in PyTorch, wich can speed up our training.

Pytorch tensor.repeat() function can repeat a tensor along the specified dimensions. In this tutorial, we will use some examples to show you how to use it.

PyTorch torch.split() function can split a tensor into some chunks. In this tutorial, we will create some exampls to show how to use it.

In this tutorial, we will discuss the difference between model.zero_grad() and optimizer.zero_grad() when we are training an model.

Swish activation function is proposed in comformer model. In this tutorial, we will introduce how to implement in pytorch.

In this tutorial, we will create an example to show you how to create a wrapper class of torch.nn.Linear().

Pytorch torch.unbind() function can remove a tensor dimension and return a tuple. In this tutorial, we will use some examples to show you how to use it.