From the Databricks UI when I try to assign a single user to access the cluster it seems like I can only pick human users and no possibility to pick Service Principals:
How to assign a Service Principal to Single user access my Databricks Cluster?
Can’t be done using WebUI.
Use CLI.
You can get:
- the SP’s id (
single_user_namevalue) usingdatabricks service-principals list - spark versions:
databricks clusters spark-versions - node types:
databricks api get /api/2.0/clusters/list-node-types
databricks clusters create --json '
{
"cluster_name": "my-cluster",
"spark_version": "13.3.x-scala2.12",
"node_type_id": "i3.xlarge",
"driver_node_type_id": "i3.xlarge",
"single_user_name": "9999b04c-890c-0000-1111-be334c3406e8",
"data_security_mode": "SINGLE_USER",
"runtime_engine": "STANDARD",
"num_workers": 0
}
'
Based on this post:
https://community.databricks.com/t5/data-engineering/databricks-single-user-cluster-is-not-able-to-assign-service/td-p/4592
I found out that is possible to assign a Service Principal to Single user access via CLI:
databricks clusters edit <Cluster ID> <Spark Version>
--cluster-name "<Cluster Name>" --data-security-mode SINGLE_USER
--single-user-name <Service Principal Client ID> --num-workers 1
--node-type-id <Node Type> --no-wait
In order to get the right Spark Version:
/a/77102743/4725074
In order to assign my token locally: /a/63519211/4725074
In order to get the correct Node Type: https://docs.databricks.com/api/gcp/workspace/clusters/listnodetypes