The training loop
One RL update
Follow a prompt through Verifiers, vLLM, the orchestrator and the trainer.
An environment does not train the model by itself. Verifiers defines the task, runs the episode and supplies a reward. vLLM generates tokens. The orchestrator turns completed episodes into training samples. PyTorch and FSDP2 execute the update.