Create a Databricks Connection

This guide shows you how to create a Databricks connection in Ascend.

Prerequisites

• Ascend Project
• Ascend Workspace
• Credentials for your Databricks instance
  • Username: Account username for Databricks
  • Password: Account password for Databricks
• [Additional requirements specific to the connection]

Create a new Databricks Connection

Begin from your workspace Super Graph view. Follow these steps to create your connection:

Using the Connection Form

1. To start creating a connection, either:
   • Click the + button next to Connections in the left Build panel
   
   • Or right-click anywhere in the Super Graph and hover over Create Connection
   
2. Name your connection `data_plane_databricks`
3. Select Databricks from the available options
4. Complete the required form fields (along with any desired optional fields)

5. Scroll to the bottom and click Save to create your Connection

Using the Files Panel

1. Open the files panel in the top left corner
2. Right-click on the Connections directory and choose New File

3. Name your file with a descriptive name like `data_plane_databricks.yaml` and press enter

To learn more about the different options for Connections, check out our reference guide.

Example

Use the following YAML template for your Databricks connection. Customize the highlighted values with your specific connection details:

/my_project/connections/databricks_connection.yaml

connection:
  databricks:
    workspace_url: <workspace-url>
    client_id: <client-id>
    client_secret: ${vaults.<your_vault>.<secret_key>}
    cluster_id: <cluster-id>
    http_path: <warehouse-http-path>
    catalog: <catalog>
    schema: <schema>
    max_concurrent_queries: 50