get_dataset_upload_urls
Obtain signed upload URLs for dataset files too large or local for direct fetching, then PUT file bytes to the provided URL.
Instructions
Get signed upload URLs for dataset files the server cannot fetch.
Backs ``POST /prod/v1/trainers/datasets/{dataset_id}/get-upload-endpoint``.
Use this for local files and for anything over 150 MB: the caller
PUTs each file's bytes to the returned ``upload_url`` using the
returned ``method`` and ``headers``.
Args:
dataset_id: Target dataset.
filename_to_byte_size: Map of filename → exact size in bytes,
e.g. ``{"img_0001.jpg": 2000000, "img_0001.txt": 12000}``.
The signature is derived from the size, so a wrong value is
rejected by storage at PUT time.
Signed URLs are short-lived; call this again for a fresh one if it
expires. After every PUT succeeds, poll ``get_dataset_status`` until
the dataset is ``READY``.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| dataset_id | Yes | ||
| filename_to_byte_size | Yes |