databricks-configure-connection-profile
Note
When you use a connection profile to connect to Databricks, if you use ADLS (for Azure) or S3 (for AWS) as the external stage you must also use a connection profile for that.
Connection Profile Name: Enter a name that uniquely identifies the external resource.
Namespace:.Select the namespace where the profile will be stored. All users who will use this profile must have READ and SELECT permissions on the namespace.
Endpoint Type: Select Databricks.
Authentication Type: Select the type of authentication you want to use, then set the properties for that type as described below.
Setting Databricks Entra ID properties
Click Sign in using Entra ID and log in with an Entra ID account that has the following permissions:
USE CATALOG and CREATE SCHEMA on the Databricks catalog that will contain the target schema (see Learn / Azure Databricks documentation / Create schemas)
CAN USE permission on the Databricks workspace (see Learn / Azure Databricks documentation / Monitor and manage access to personal access tokens)
CAN ATTACH TO on the workspace's Compute (see Learn / Azure Databricks documentation / Security / Access control lists)
Once you log in successfully, close the browser window (if you do not, sign-in will fail), and return to the connection profile page.
Connection URL: specify the JDBC URL from the JDBC/ODBC tab of the Databricks cluster's Advanced options (see Get connection details for a cluster). If the URL starts with jdbc:spark:// change that to jdbc:databricks://.
Once you have signed in using Entra ID and specified the connection URL, test the connection.
When you rotate the Entra ID token, applications using this connection profile will automatically switch to the new token. The ConnectionProfile_TokenIsExpiring Smart Alert will by default send you an alert 24 hours before the token expires (see Managing Smart Alerts).
Setting Databricks Entra ID (OAuth) properties manually
See Configuring Microsoft Entra ID (formerly Azure Active Directory) for Databricks Writer manually.
Setting Databricks Personal Access Token properties
Personal Access Token: See Generate a personal access token). The user associated with the token must have read and write access to DBFS (see Important information about DBFS permissions). If table access control has been enabled, the user must also have MODIFY and READ_METADATA (see Data object privileges - Data governance model). When you update this property with a new token, applications using this connection profile will automatically switch to the new token when the old one expires.
Connection URL: specify the JDBC URL from the JDBC/ODBC tab of the Databricks cluster's Advanced options (see Get connection details for a cluster). If the URL starts with
jdbc:spark://change that tojdbc:databricks://.