A neuron with multiple inputs can calculate its output using a dot product:
y=w⋅x+b
When we have many inputs and many neurons, we need to calculate many dot products at once.
Matrix multiplication lets us do this.
4.4 Vectors as Matrices
A weight vector can be written as:
w=w1w2w3
and the input vector:
x=x1x2x3
To calculate the dot product, we use the transpose of (w):
wTx=[w1w2w3]x1x2x3
Expanding:
wTx=w1x1+w2x2+w3x3
Therefore:
y=wTx+b