Skip to content

RTX 4080 sampled-k1 PG systems workload

This workload measures runtime and semantic conformance for verl-opd-v0.8-single-gpu-pg-k1-v1. The source profile pins verl v0.8.0 at 7aed6b230776f963fa09509c10d9c3a767d1102c.

Item Measured value
Hardware one NVIDIA RTX 4080, 15.992 GiB
Models Qwen3-0.6B actor / Qwen3-1.7B teacher, pinned NF4 snapshots
Workload 32 distinct prompts, response bound 64, 8 strict updates
Target sampled-token teacher log-probability; k1 + vanilla policy loss
Peak CUDA 2.3032 GiB allocated / 3.1914 GiB reserved
Time to first update 30.0902 s
Steady rollout 13.4693 generated tokens/s
Steady teacher scoring 893.86 sampled positions/s
Steady actor update 221.0899 positions/s

The matched run stopped after update 4, reconstructed the trainer from its checkpoint, and finished at update 8 with byte-identical trajectories, adapter and optimizer tensors and identical training-state fields (apart from the deliberately run-specific resolved-config digest). Every update recorded rollout policy version == parameter version before update; each successful update incremented the parameter version once.

The standard PEFT adapter exported with tokenizer metadata. A separate checksummed scale-out bundle preserved the sampled-k1 fields without a top-k requirement; exact student and teacher snapshots were materialized transactionally, the pinned upstream config merge and sequential CPU model/data load smoke passed, and the local bundle became launchable: true. No distributed verl job ran, and algorithm-wide parity is not claimed.

The complete machine-readable record is evidence/rtx4080-verl-pg-k1-v1.json (SHA-256 b549905b2b62b5e51d721ba2932befb7b910284ff1b4016095d341ec232a725f). The estimator/scalar/gradient contract is documented in ADR 0010.

Scope

The endpoints are local runtime, recovery and the documented scalar/gradient contract. Task quality and algorithm comparisons were not evaluated.