model_deploy
Deploy a Ray Serve application from a Python import path into a cluster's declarative config, preserving existing apps and using the app's replica settings.
Instructions
[WRITE][risk=medium] Deploy a Serve application from an import path.
The app is merged into the cluster's declarative Serve config (existing apps preserved). Replica counts come from the app's own config; set them afterward with serve scale (deployment names are known only once the app materialises).
Args: application: Serve application name to create/replace. import_path: Python import path of the Serve app (e.g. 'module:app'). target: Inference target name from config; omit for the default.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"application": "<application>",
"import_path": "<import_path>"
},
"name": "model_deploy"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No | ||
| application | Yes | ||
| import_path | Yes |