Neural network basics
Let's try to familiarize ourselves with some of the basic concepts behind neural networks that make all deep learning models tick!
A simple linear neuron
A linear neuron is the most basic building block of a deep neural network. It can be schematically represented as shown in the following figure. Here,
represents the input vector and wis are the weights of the neuron. Given a training set consisting a of set of input, target value pairs, a linear neuron tries to learn a linear transformation that can map the input vectors to the corresponding target value. Basically, a linear neuron approximates the input output relationship by a linear function
:
Schematic representation of a simple linear neuron and a simple non-linear neuron
Lets try to model a toy problem with this simple neuron. Employee A buys lunch from the cafeteria. Their diet consists of fish, chips, and ketchup. They get several portions of each. The cashier only tells them the total price of the meal. After...
