Visualize how weights and biases shape decision boundaries.
Lines represent weights. Thickness equals importance (magnitude). Color equals polarity.
Displayed above each hidden and output neuron. Biases shift the activation function left or right. A negative bias means the incoming weighted sum must be strong enough to overcome the deficit before the neuron activates.
Formula: max(0, x)
If the sum of (Inputs × Weights) + Bias is negative, ReLU violently clamps it to exactly 0. This non-linearity is what allows neural networks to learn complex, curving boundaries rather than just straight lines.