Definition
Perceptron
A perceptron is a basic algorithm that tries to find a hyperplane that separates your data into two classes (positive and negative).
XOR Problem
A simple linear model fails on complex, non-linear data, such as separating XOR data points.
Layering up: Instead of one line, multiple lines could be used (neural networks. We need a non-linear decision boundary.