Share via


April 2025

These features and Azure Databricks platform improvements were released in April 2025.

Note

Releases are staged. Your Azure Databricks account might not be updated until a week or more after the initial release date.

Automatic identity management Public Preview is ungated

April 18, 2025

The automatic identity management Public Preview is now open to all accounts. Automatic identity management allows you to add users, service principals, and groups from Microsoft Entra ID into Azure Databricks without configuring an application in Microsoft Entra ID. When automatic identity management is enabled, you can directly search in identity federated workspaces for Microsoft Entra ID users, service principals, and groups, and add them to your workspace. Any changes to group memberships, including to nested groups, are respected in Azure Databricks.

See Sync users and groups automatically from Microsoft Entra ID.

Run code in Databricks Assistant on serverless compute

April 18, 2025

Databricks Assistant can now run any code it generates in the right panel on serverless compute. See Run code in Assistant on serverless compute.

New compliance controls in Public Preview

April 15, 2025

Azure Databricks now supports additional compliance controls with the compliance security profile to help meet compliance requirements for your workspace. These enhancements provide improved security and governance capabilities.

The following compliance controls with the compliance security profile are now in Public Preview:

Python type error highlighting

April 14, 2025

Python code in notebooks and file editors can highlight type errors for non-existent attributes, missing arguments, and mismatched arguments. See Python type error highlighting.

Reference SQL output in downstream tasks of a job

April 14, 2025

You can now use dynamic values to reference the output of a SQL task in downstream tasks in the same job. For each tasks can iterate over the rows of data in the output.

See What is a dynamic value reference?.

Batch Unity Catalog Python UDFs (Public Preview)

April 14, 2025

Unity Catalog Batch Python UDFs extend the capabilities of Unity Catalog UDFs by allowing you to write Python code to operate on batches of data, significantly improving efficiency by reducing the overhead associated with row-by-row UDFs. Batch Python UDFs support service credentials to access external cloud services. See Batch Python User-defined functions (UDFs) in Unity Catalog.

Access UDF context information using TaskContext

April 14, 2025

The TaskContext PySpark API now allows you to retrieve context information—such as user identity and cluster tags—while running Batch Unity Catalog Python UDFs or PySpark UDFs. This feature lets you pass user-specific details, like identity, to authenticate external services within UDFs. See Get task context in a UDF.

Meta Llama 4 Maverick is available using Foundation Model APIs pay-per-token

April 5, 2025

Mosaic AI Model Serving now supports Meta Llama 4 Maverick. You can access and use Llama 4 Maverick on Foundation Model API pay-per-token endpoints.

Databricks Assistant provides doc citations and follow-up suggestions

April 3, 2025

In answer to prompts and queries, Assistant now provides suggestions for next steps and citations from documentation. See Get follow-up suggestions or answers from documentation.

Salesforce ingestion and Workday Reports connectors are GA

April 2, 2025

The managed Salesforce ingestion and Workday Reports connectors in Lakeflow Connect are now generally available.

The compute system tables are now generally available (GA)

April 1, 2025

The compute system tables clusters, node_types, and node_timeline are now generally available. These tables provide insights into the all-purpose compute, jobs compute, and DLT pipelines in your account.

For a reference of these tables, see Compute system tables reference.

The BROWSE privilege is GA

April 1, 2025

The BROWSE privilege is now generally available. The BROWSE privilege allows you to grant users, service principals, and account groups permission to view a Unity Catalog object’s metadata. This enables users to discover data without having read access to the data. A user can view an object’s metadata using Catalog Explorer, the schema browser, search results, the lineage graph, information_schema, and the REST API.

See BROWSE.