Skip to main content
Training goes through the top-level pixi tasks. Pass the task ID with --task.

Train

--agent.upload-model False keeps checkpoints local only. Drop it and set WANDB_API_KEY to also push the final-iteration checkpoint to W&B as a model artifact. Either way, local .pt files land on every save_interval boundary. Checkpoints and W&B logs write to logs/rsl_rl/<run_name>/.

Task Configurations

Two task IDs share the same MDP but trade GPU memory against policy quality.
If pixi run train runs out of memory, switch to the lower-VRAM variant:
WujiHand_Reorient_Light fits comfortably under ~12 GB but converges to a weaker policy, with occasional cube drops and finger-jam behavior on harder reorientations.

Replay and Evaluate

Replay a trained checkpoint in the interactive viewer, or run a success-rate eval over many trials:
For headless, machine-readable output suited to CI or sweeps:

Programmatic Evaluation

The eval core is importable and supports batch evaluation from Python without the CLI:

Export to ONNX

Deployment consumes an ONNX policy plus a sidecar JSON that records the control-mode parameters (action_scale, ema_alpha, warmup_time_s, control_mode, history_len, ctrl_dt) captured at export time:
The sidecar keeps deploy inference identical to the sim policy that produced the ONNX. Continue to Sim-to-real Deployment to run it on the physical hand.

Development Utilities