PyTorch Tutorials and Examples for Beginners

In pytorch, we can use torch.nn.init.normal_() to initialize a tensor value. In this tutorial, we will use some examples to show you how to use it.

torch.optim.lr_scheduler.ExponentialLR() is often used to change the learning rate in pytorch. In this tutorial, we will use some examples to show you how to use it correctly.

In this tutorial, we will introduce pytorch @ operation. It is often used in some pytorch scripts. You can lean what it is by our example.

In this tutorial, we will introduce the difference between torch.matmul() and torch.mul(), both of them are common used in pytorch script.

In pytorch, torch.nn.functional.pad() can allow us to pad a tensor easily. In this tutorial, we will introduce you how to use it with some examples.

We may see torch.backends.cudnn.benchmark in some pytorch scripts. In this tutorial, we will discuss how to use it in pytorch.

In this tutorial, we will introduce how to implement cosine annealing with warm up in pytorch.

When we are using SGD optimizer to train a pytorch model, we may use warm-up strategy to improve the training efficiency. In this tutorial, we will introduce you how to implement this strategy in pytorch.

When we are computing variance and standard-deviation of a pytorch tensor, we will see unbiased parameter. In this tutorial, we will introduce the effect of it.

In pytorch, in order to compute the variance and mean of a tensor, we can use torch.var_mean() function. In this tutorial, we will use some examples to show you how to do.