create_deployment
Create a new AI Gateway deployment, optionally linked to a pipeline, with configurable mode, sizing, and replica settings for managed or serverless execution.
Instructions
Creates a new deployment (AI Gateway), optionally linked to a pipeline.
A deployment created without an origin_pipeline_id has no active revision until you call
create_deployment_revision and activate_deployment_revision. Default service sizing follows
Development unless explicit sizing fields are provided.
:param name: Name of the deployment.
:param description: Optional description.
:param group_label: Optional label used to group related deployments.
:param origin_pipeline_id: ID of the platform pipeline to link, if any.
:param deployment_mode: Execution mode, "MANAGED" or "SERVERLESS" (default "MANAGED").
:param service_level: Sizing tier, "PRODUCTION", "DEVELOPMENT", or "CUSTOM" (default "DEVELOPMENT").
:param idle_timeout_in_seconds: Seconds of inactivity before scaling down.
:param min_query_replica_count: Minimum number of query replicas.
:param max_query_replica_count: Maximum number of query replicas.
:param max_index_replica_count: Maximum number of index replicas.
:param cpu_request: Requested CPU per replica.
:param cpu_limit: CPU limit per replica.
:param memory_request: Requested memory per replica.
:param memory_limit: Memory limit per replica.
:param gpu_limit_gigabyte: GPU memory limit in gigabytes.
:returns: The created deployment or error message.
All parameters accept object references in the form @obj_id or @obj_id.path.to.value.
Examples::
# Direct call with values
create_deployment(data={'key': 'value'}, threshold=10)
# Call with references
create_deployment(data='@obj_123', threshold='@obj_456.config.threshold')
# Mixed call
create_deployment(data='@obj_123.items', threshold=10)The output is automatically stored and can be referenced in other functions.
Returns a formatted preview with an object ID (e.g., @obj_123).
Use the object store tools in combination with the object ID to view nested properties of the object.
Use the returned object ID to pass this result to other functions.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | ||
| cpu_limit | No | ||
| cpu_request | No | ||
| description | No | ||
| group_label | No | ||
| memory_limit | No | ||
| service_level | No | DEVELOPMENT | |
| memory_request | No | ||
| deployment_mode | No | MANAGED | |
| gpu_limit_gigabyte | No | ||
| origin_pipeline_id | No | ||
| idle_timeout_in_seconds | No | ||
| max_index_replica_count | No | ||
| max_query_replica_count | No | ||
| min_query_replica_count | No |