Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Classic Control

Classic Control environments integrate compact analytic models in native Rust. All four can select discrete or continuous control at construction through their configuration.

EnvironmentObservationDiscrete actionContinuous actionDefault horizon
Acrobot6 values3 torques1 torque in \([-1,1]\)500
CartPole4 valuesleft/right1 force command in \([-1,1]\)500
MountainCar2 valuesleft/coast/right1 force command in \([-1,1]\)200 (999 in continuous preset)
Pendulum3 valuesconfigurable torque grid1 bounded torque200

Angles are radians, angular velocities are radians per step unit, and each page states its integrator and clipping rules.

Info is () for Acrobot, CartPole, and Pendulum. MountainCar uses Option<()> and currently returns None.