Skip to main content

Databricks

This guide shows you how to create a Databricks Connection in Ascend.

Prerequisites

Ascend Project
Ascend Workspace
Credentials for your Databricks instance
- Username: Account username for Databricks
- Password: Account password for Databricks
[Additional requirements specific to the Connection]

Create a Databricks Connection

From your Workspace Super Graph view, follow these steps:

Form
Files panel

Create a Connection by either:
- Clicking the + button next to Connections in the left Build panel
- Right-clicking in the Super Graph and selecting Create Connection
Enter a descriptive name like data_plane_databricks
Select Databricks from the available options
Fill in the required fields (and any optional fields as needed)
Click Save at the bottom to create your Connection

form

Open the Files panel in the top left
Right-click the Connections directory and select New File

new_file

Give your file a descriptive name like data_plane_databricks.yaml

For complete configuration options, see our Connection reference guide.

Example

Use the following YAML template for your Databricks Connection. Customize the highlighted values with your specific Connection details:

/my_project/connections/databricks_connection.yaml
connection:
  databricks:
    workspace_url: <workspace-url>
    client_id: <client-id>
    client_secret: ${vaults.<your_vault>.<secret_key>}
    cluster_id: <cluster-id>
    http_path: <warehouse-http-path>
    catalog: <catalog>
    schema: <schema>
    max_concurrent_queries: 50

🎉 Congratulations, you just set up a Databricks Connection in Ascend!

Prerequisites
Example