Representation Learning

machine-learning unsupervised-learning

Definition

Representation Learning

Representation learning is a paradigm concerned with the automatic discovery of feature representations from raw data that are useful for downstream tasks. Formally, given an instance space , the learner identifies an encoding function that maps input to a latent space .

Characteristics

Information Preservation: The mapping must preserve the salient information of the original distribution while potentially satisfying constraints such as lower dimensionality, disentanglement, or invariance to nuisance variables.

Utility: The discovered features are typically transferred to supervised tasks where they often yield improved generalisation or faster convergence compared to learning from raw features.