AI Functions on Azure Databricks

This article describes Azure Databricks AI Functions, built-in SQL functions that allow you to apply AI on your data directly from SQL.

SQL is crucial for data analysis due to its versatility, efficiency, and widespread use. Its simplicity enables swift retrieval, manipulation, and management of large datasets. Incorporating AI functions into SQL for data analysis enhances efficiency, which enables businesses to swiftly extract insights.

Integrating AI into analysis workflows provides access to information previously inaccessible to analysts, and empowers them to make more informed decisions, manage risks, and sustain a competitive advantage through data-driven innovation and efficiency.

AI functions using Databricks Foundation Model APIs

These functions invoke a state-of-the-art generative AI model from Databricks Foundation Model APIs to perform tasks such as sentiment analysis, classification, and translation. See Analyze customer reviews using AI Functions.

• ai_analyze_sentiment
• ai_classify
• ai_extract
• ai_fix_grammar
• ai_gen
• ai_mask
• ai_similarity
• ai_summarize
• ai_translate

ai_query

The ai_query() function allows you to query machine learning models and large language models served using Mosaic AI Model Serving. To do so, this function invokes an existing Mosaic AI Model Serving endpoint and parses and returns its response. You can use ai_query() to query endpoints that serve custom models, foundation models made available using Foundation Model APIs, and external models.

• ai_query function.
• Query a served model with ai_query.
• Query an external model with ai_query.
• Perform batch inference using ai_query.

vector_search

The vector_search() function allows you to search and query a Mosaic AI Vector Search index using SQL.

See vector_search function for more information.

ai_forecast

The ai_forecast() function is a table-valued function designed to extrapolate time series data into the future. In its most general form, ai_forecast() accepts grouped, multivariate, or mixed-granularity data, and forecasts that data up to some horizon in the future.

See ai_forecast function for more information.