hpc_sync_project
Upload local project source files to the cluster before job submission. Ensures jobs run fresh code by syncing files defined in profile YAML patterns.
Instructions
Upload the project's source files to its remote root on the cluster.
Run this BEFORE submitting, whenever local code has changed — the connector does not upload anything automatically, and a job will happily run stale code. Source and configs only: files over 4MB are refused, and datasets or model weights must go via the transfer node or be downloaded by the job.
Args: profile_path: Path to the local profile YAML (its sync_include / sync_exclude patterns decide what is sent). project_dir: Local project directory to upload from. dry_run: List what would be uploaded without sending anything.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| dry_run | No | ||
| project_dir | Yes | ||
| profile_path | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |