Two copies of the policy
vLLM owns an inference representation of the policy. The trainer owns trainable parameters, gradients and optimizer state. FSDP2 supplies the training machinery, but this profile runs on one physical GPU; it does not gain another device’s memory by calling it distributed. The small presets reduce context, sequence slots, concurrent rollouts and temporary buffers. Activation checkpointing trades recomputation for activation memory. Chunked optimizer state and per-tensor checkpoint writes address different peaks: updating weights and saving them.
These are tested configurations for specific workloads. They do not establish capacity for arbitrary batches, context lengths or 1B models.