Definition
Action Space
An action space is the set of all actions an agent is allowed to choose from in an environment.
At each time step , the agent observes a state and selects an action
More generally, if the available actions depend on the current state, the action space may be state-dependent:
where is the set of actions available in state .