Lukas' Notes

Softmax

Feb 03, 20261 min read

machine-learning

Definition

Softmax

The softmax function σ is a function that takes a vector x∈Rn and maps it into a probability distribution of n possible outcomes:

σ(x)=∑i=1n​exi​ex​

Graph View

Backlinks

  • Scaled Dot-Product Attention

Created with Quartz v4.4.0 © 2026

  • GitHub