Learning Algorithm

Definition

Learning Algorithm

A learning algorithmm $\mathcal{A}$ is an algorithm that uses or experience to construct or update a model, representation, or policy in order to improve performance on a given task.

Types

Supervised

Definition

Supervised Learning Algorithm

A supervised learning algorithm is a learning algorithm that uses labelled training examples

$$(x,y)\in \mathcal{X}\times \mathcal{Y}$$

to select a hypothesis

$$h:\mathcal{X}\to \mathcal{Y}h\in \mathcal{H}$$

from a hypothesis class $\mathcal{H}$.

The goal is for the selected hypothesis to predict the correct label for previously unseen instances.

Link to original

Unsupervised

Definition

Unsupervised Learning Algorithm

An unsupervised learning algorithm is a learning algorithm that maps unlabelled training data to a specific hypothesis:

$$A:{\mathcal{X}}^m\to \mathcal{H}$$

where:

• $\mathcal{X}$ is the instance space.
• $\mathcal{H}$ is the hypothesis class.

Link to original

Reinforcement

Definition

Reinforcement Learning Algorithm

Define your knowledge here…

Link to original