livy_create_session
Create a Spark session for executing PySpark, Scala, or SparkR code in Microsoft Fabric. Initialize a session to run data processing and analytics tasks on specified workspace and lakehouse resources.
Instructions
Create a new Livy session for Spark code execution.
Creates a Spark session for executing PySpark, Scala, or SparkR code. Session creation can take 6+ minutes on first startup as Spark initializes. It's recommended to keep with_wait=True to ensure the session is ready before use.
Parameters: workspace_id: Fabric workspace ID (use list_workspaces tool to find by name). lakehouse_id: Fabric lakehouse ID (use list_items tool with item_type="Lakehouse"). environment_id: Optional Fabric environment ID for pre-installed libraries. kind: Session kind - 'pyspark' (default), 'scala', or 'sparkr'. conf: Optional Spark configuration as key-value pairs (e.g., {"spark.executor.memory": "4g"}). with_wait: If True (default), wait for session to become available before returning. timeout_seconds: Maximum time to wait for session availability (default: from config).
Returns: Dictionary with session details including id, state, kind, appId, appInfo, and log.
Example: ```python # Create a PySpark session result = livy_create_session( workspace_id="12345678-1234-1234-1234-123456789abc", lakehouse_id="87654321-4321-4321-4321-210987654321", kind="pyspark", with_wait=True )
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| workspace_id | Yes | ||
| lakehouse_id | Yes | ||
| environment_id | No | ||
| kind | No | pyspark | |
| conf | No | ||
| with_wait | No | ||
| timeout_seconds | No |