Dense Layer is also called fully connected layer, which is widely used in deep learning model. In this tutorial, we will introduce it for deep learning beginners.
The structure of dense layer
The structure of a dense layer look like:
Here the activation function is Relu.
What is dense layer in neural network?
A dense layer can be defined as:
y = activation(W * x + b)
where W is weight, b is a bias, x is input and y is output, * is matrix multiply.
It can be viewed as: MLP (Multilayer Perceptron)
In keras, we can use tf.keras.layers.Dense() to create a dense layer.