pixi tasks. Pass the task ID with --task.
Train
--agent.upload-model False keeps checkpoints local only. Drop it and set WANDB_API_KEY to also push the final-iteration checkpoint to W&B as a model artifact. Either way, local .pt files land on every save_interval boundary.
Checkpoints and W&B logs write to logs/rsl_rl/<run_name>/.
Task Configurations
Two task IDs share the same MDP but trade GPU memory against policy quality.If
pixi run train runs out of memory, switch to the lower-VRAM variant:WujiHand_Reorient_Light fits comfortably under ~12 GB but converges to a weaker policy, with occasional cube drops and finger-jam behavior on harder reorientations.Replay and Evaluate
Replay a trained checkpoint in the interactive viewer, or run a success-rate eval over many trials:Programmatic Evaluation
The eval core is importable and supports batch evaluation from Python without the CLI:Export to ONNX
Deployment consumes an ONNX policy plus a sidecar JSON that records the control-mode parameters (action_scale, ema_alpha, warmup_time_s, control_mode, history_len, ctrl_dt) captured at export time: