MCP Toolbox for Databases

--- title: "Serverless for Apache Spark" type: docs weight: 1 description: > Google Cloud Serverless for Apache Spark lets you run Spark workloads without requiring you to provision and manage your own Spark cluster. --- ## About The [Serverless for Apache Spark](https://cloud.google.com/dataproc-serverless/docs/overview) source allows Toolbox to interact with Spark batches hosted on Google Cloud Serverless for Apache Spark. ## Available Tools - [`serverless-spark-list-batches`](../tools/serverless-spark/serverless-spark-list-batches.md) List and filter Serverless Spark batches. - [`serverless-spark-get-batch`](../tools/serverless-spark/serverless-spark-get-batch.md) Get a Serverless Spark batch. - [`serverless-spark-cancel-batch`](../tools/serverless-spark/serverless-spark-cancel-batch.md) Cancel a running Serverless Spark batch operation. - [`serverless-spark-create-pyspark-batch`](../tools/serverless-spark/serverless-spark-create-pyspark-batch.md) Create a Serverless Spark PySpark batch operation. - [`serverless-spark-create-spark-batch`](../tools/serverless-spark/serverless-spark-create-spark-batch.md) Create a Serverless Spark Java batch operation. ## Requirements ### IAM Permissions Serverless for Apache Spark uses [Identity and Access Management (IAM)](https://cloud.google.com/bigquery/docs/access-control) to control user and group access to serverless Spark resources like batches and sessions. Toolbox will use your [Application Default Credentials (ADC)](https://cloud.google.com/docs/authentication#adc) to authorize and authenticate when interacting with Google Cloud Serverless for Apache Spark. When using this method, you need to ensure the IAM identity associated with your ADC has the correct [permissions](https://cloud.google.com/dataproc-serverless/docs/concepts/iam) for the actions you intend to perform. Common roles include `roles/dataproc.serverlessEditor` (which includes permissions to run batches) or `roles/dataproc.serverlessViewer`. Follow this [guide](https://cloud.google.com/docs/authentication/provide-credentials-adc) to set up your ADC. ## Example ```yaml sources: my-serverless-spark-source: kind: serverless-spark project: my-project-id location: us-central1 ``` ## Reference | **field** | **type** | **required** | **description** | | --------- | :------: | :----------: | ----------------------------------------------------------------- | | kind | string | true | Must be "serverless-spark". | | project | string | true | ID of the GCP project with Serverless for Apache Spark resources. | | location | string | true | Location containing Serverless for Apache Spark resources. |