Azure Databricks Workspace

AzDO Pipelines

Data Saturday Oslo 2024

In this session I'll show you how to 1) Provision your Workspace infrastructure with BICEP, 2) Configure SCIM and use Azure's Entra ID security groups, 3) deploy your Notebooks across environments with DevOps YAML Pipelines and 4) Orchestrate your Notebooks via Azure Data Factory.

AzDO Pipelines

Provision your Databricks Workspace infrastructure with BICEP

Discover the power of BICEP in provisioning a robust Databricks workspace infrastructure, including the Azure Data Factory, Key Vault and Storage account; I'll use some PowerShell to configure RBAC permissions between resources and I'll show you how use the logging command task.setvariable