hpc_submit_chain
Submit a chain of dependent jobs that checkpoint and resume to run workloads beyond the 24-hour GPU walltime limit on the DTU HPC cluster.
Instructions
Submit a checkpoint-resume chain of dependent jobs for runs longer than the 24h GPU walltime cap. The training command must support --resume-from and checkpoint on SIGUSR2 -- verify this BEFORE submitting.
Args: profile_path: Path to the local profile YAML. run_id: Short identifier; segments become .0, .1, ... project_dir: Local project directory for manifests. segments: Number of walltime-sized segments (total = segments x walltime). resource_overrides: Optional JSON object overriding profile resources. confirmed_by_user: Set ONLY after explicit human approval when above the profile's confirmation thresholds. Chains are always above the 12h default threshold in total, so this usually requires asking.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| run_id | Yes | ||
| segments | Yes | ||
| project_dir | Yes | ||
| profile_path | Yes | ||
| confirmed_by_user | No | ||
| resource_overrides | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |