What is Azure AI Document Intelligence?

Azure AI Document Intelligence is a cloud-based Azure AI service that enables you to build intelligent document processing solutions. Massive amounts of data, spanning a wide variety of data types, are stored in forms and documents. Document Intelligence enables you to effectively manage the velocity at which data is collected and processed and is key to improved operations, informed data-driven decisions, and enlightened innovation.

| ✔️ Document analysis models | ✔️ Prebuilt models | ✔️ Custom models |

General extraction models

General extraction models enable text extraction from forms and documents and return structured business-ready content ready for your organization's action, use, or development.

Prebuilt models

Prebuilt models enable you to add intelligent document processing to your apps and flows without having to train and build your own models.

Custom models

Custom models are trained using your labeled datasets to extract distinct data from forms and documents, specific to your use cases. Standalone custom models can be combined to create composed models.

Document field extraction models

✔️ Document field extraction models are trained to extract labeled fields from documents.

Custom generative | Build a custom extraction model using generative AI for documents with unstructured format and varying templates.

Custom neural | Extract data from mixed-type documents.

Custom template | Extract data from static layouts.

Custom composed | Extract data using a collection of models.

Custom classification models

✔️ Custom classifiers identify document types before invoking an extraction model.

Custom classifier | Identify designated document types (classes) before invoking an extraction model.

Add-on capabilities

Document Intelligence supports optional features that can be enabled and disabled depending on the document extraction scenario. The following add-on capabilities are available for 2023-07-31 (GA) and later releases:

• ocr.highResolution

• ocr.formula

• ocr.font

• ocr.barcode

The2024-07-31-preview release introduces read model support for searchable PDF output:

• `Searchable PDF

Document Intelligence supports optional features that can be enabled and disabled depending on the document extraction scenario. The following add-on capabilities are available for 2023-10-31-preview, and later releases:

• queryFields

• keyValuePairs

Analysis features

Model ID	Content Extraction	Query fields	Paragraphs	Paragraph Roles	Selection Marks	Tables	Key-Value Pairs	Languages	Barcodes	Document Analysis	Formulas*	Style Font*	High Resolution*	Searchable PDF
prebuilt-read	✓		✓					O	O		O	O	O	✓
prebuilt-layout	✓	✓	✓	✓	✓	✓		O	O		O	O	O
prebuilt-document	✓	✓	✓	✓	✓	✓	✓	O	O		O	O	O
prebuilt-businessCard	✓	✓								✓
prebuilt-contract	✓	✓	✓	✓			O	O	✓	✓	O	O
prebuilt-healthInsuranceCard.us	✓	✓						O	O	✓	O	O	O
prebuilt-idDocument	✓	✓						O	O	✓	O	O	O
prebuilt-invoice	✓	✓			✓	✓	O	O	O	✓	O	O	O
prebuilt-receipt	✓	✓						O	O	✓	O	O	O
prebuilt-marriageCertificate.us	✓	✓						O	O	✓	O	O	O
prebuilt-creditCard	✓	✓						O	O	✓	O	O	O
prebuilt-check.us	✓	✓						O	O	✓	O	O	O
prebuilt-payStub.us	✓	✓						O	O	✓	O	O	O
prebuilt-bankStatement	✓	✓						O	O	✓	O	O	O
prebuilt-mortgage.us.1003	✓	✓						O	O	✓	O	O	O
prebuilt-mortgage.us.1004	✓	✓						O	O	✓	O	O	O
prebuilt-mortgage.us.1005	✓	✓						O	O	✓	O	O	O
prebuilt-mortgage.us.1008	✓	✓						O	O	✓	O	O	O
prebuilt-mortgage.us.closingDisclosure	✓	✓						O	O	✓	O	O	O
prebuilt-tax.us	✓	✓			✓			O	O	✓	O	O	O
prebuilt-tax.us.w2	✓	✓			✓			O	O	✓	O	O	O
prebuilt-tax.us.1098	✓	✓			✓			O	O	✓	O	O	O
prebuilt-tax.us.1098E	✓	✓			✓			O	O	✓	O	O	O
prebuilt-tax.us.1098T	✓	✓			✓			O	O	✓	O	O	O
prebuilt-tax.us.1099(variations)	✓	✓			✓			O	O	✓	O	O	O
prebuilt-tax.us.1040(variations)	✓	✓						O	O	✓	O	O	O
{ customModelName }	✓	✓	✓	✓	✓	✓		O	O	✓	O	O	O

✓ - Enabled
O - Optional
* - Premium features incur extra costs

Models and development options

You can use Document Intelligence to automate document processing in applications and workflows, enhance data-driven strategies, and enrich document search capabilities. Use the links in the table to learn more about each model and browse development options.

Read

Model ID	Description	Automation use cases	Development options
prebuilt-read	● Extract text from documents. ● Data extraction	● Digitizing any document. ● Compliance and auditing. ● Processing handwritten notes before translation.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Layout

Model ID	Description	Automation use cases	Development options
prebuilt-layout	● Extract text and layout information from documents. ● Data extraction	● Document indexing and retrieval by structure. ● Financial and medical report analysis.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Invoice

Model ID	Description	Automation use cases	Development options
prebuilt-invoice	● Extract key information from invoices. ● Data and field extraction	● Accounts payable processing. ● Automated tax recording and reporting.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Receipt

Model ID	Description	Automation use cases	Development options
prebuilt-receipt	● Extract key information from receipts. ● Data and field extraction ● Receipt model v3.0 supports processing of single-page hotel receipts.	● Expense management. ● Consumer behavior data analysis. ● Customer loyalty program. ● Merchandise return processing. ● Automated tax recording and reporting.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Identity (ID)

Model ID	Description	Automation use cases	Development options
prebuilt-idDocument	● Extract key information from passports and ID cards. ● Document types ● Extract endorsements, restrictions, and vehicle classifications from US driver's licenses.	● Know your customer (KYC) financial services guidelines compliance. ● Medical account management. ● Identity checkpoints and gateways. ● Hotel registration.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Check

Model ID	Description	Automation use cases	Development options
prebuilt-check	● Extract key information from checks. ● Data and field extraction	● Credit management. ● Automated lender management.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Pay stub

Model ID	Description	Automation use cases	Development options
prebuilt-paystub	● Extract key information from pay stubs. ● Data and field extraction	● Employee payroll detail verification. ● Fraud detection for employment. ● Automated tax processing.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Bank statement

Model ID	Description	Automation use cases	Development options
prebuilt-bankStatement	● Extract key information from bank statements. ● Data and field extraction	● Tax Processing use cases. ● Automated accounting management. ● Credit-debit management. ● Loan documentation processing.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Health insurance card

Model ID	Description	Automation use cases	Development options
prebuilt-healthInsuranceCard.us	● Extract key information from US health insurance cards. ● Data and field extraction	● Coverage and eligibility verification. ● Predictive modeling. ● Value-based analytics.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Contract model

Model ID	Description	Development options
prebuilt-contract	Extract contract agreement and party details. ● Data and field extraction	● Document Intelligence Studio ● REST API ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Credit card model

Model ID	Description	Development options
prebuilt-creditCard	Extract contract agreement and party details. ● Data and field extraction	● Document Intelligence Studio ● REST API ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Marriage certificate model

Model ID	Description	Development options
prebuilt-marriageCertificate.us	Extract contract agreement and party details. ● Data and field extraction	● Document Intelligence Studio ● REST API ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US mortgage 1003 form

Model ID	Description	Automation use cases	Development options
prebuilt-mortgage.us.1003	● Extract key information from 1003 loan applications. ● Data and field extraction	● Fannie Mae and Freddie Mac documentation requirements.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US mortgage 1004 form

Model ID	Description	Automation use cases	Development options
prebuilt-mortgage.us.1004	● Extract key information from 1004 appraisals. ● Data and field extraction	● Fannie Mae and Freddie Mac documentation requirements. ● Uniform Residential Appraisal report to help lender/client with the market value of the subject property.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US mortgage 1005 form

Model ID	Description	Automation use cases	Development options
prebuilt-mortgage.us.1005	● Extract key information from 1005 validation of employment. ● Data and field extraction	● Fannie Mae and Freddie Mac documentation requirements. ● Verification of employment document to determine the qualification as a prospective mortgagor.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US mortgage 1008 form

Model ID	Description	Automation use cases	Development options
prebuilt-mortgage.us.1008	● Extract key information from Uniform Underwriting and Transmittal Summary. ● Data and field extraction	● Loan underwriting processing using summary data.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US mortgage disclosure form

Model ID	Description	Automation use cases	Development options
prebuilt-mortgage.us.closingDisclosure	● Extract key information from Uniform Underwriting and Transmittal Summary. ● Data and field extraction	● Mortgage loan final details requirements.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US Tax W-2 model

Model ID	Description	Automation use cases	Development options
prebuilt-tax.us.W-2	● Extract key information from IRS US W2 tax forms (year 2018-2021). ● Data and field extraction	● Automated tax document management. ● Mortgage loan application processing.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US tax 1098 (and variations) forms

Model ID	Description	Development options
prebuilt-tax.us.1098{variation}	● Extract key information from 1098-form variations. ● Data and field extraction	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US tax 1099 (and variations) forms

Model ID	Description	Development options
prebuilt-tax.us.1099{variation}	● Extract information from 1099-form variations. ● Data and field extraction	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

US tax 1040 (and variations) forms

Model ID	Description	Development options
prebuilt-tax.us.1040{variation}	● Extract information from 1040-form variations. ● Data and field extraction	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript

Custom model overview

About	Description	Automation use cases	Development options
Custom model	Extracts information from forms and documents into structured data based on a model created from a set of representative training document sets.	Extract distinct data from forms and documents specific to your business and use cases.	● Document Intelligence Studio ● REST API ● C# SDK ● Java SDK ● JavaScript SDK ● Python SDK

Custom generative (document field extraction)

About	Description	Automation use cases	Development options
Custom generative model	The custom generative model is used to extract fields from unstructured documents or structured forms with a wide variety of visual templates.	The model uses Generative AI to extract fields, improve quality with only a few labeled samples and can be integrated into your processes with grounding and confidence scores.​	Azure AI Foundry ● REST API ● C# SDK ● Java SDK ● JavaScript SDK ● Python SDK

Custom neural

About	Description	Automation use cases	Development options
Custom Neural model	The custom neural model is used to extract labeled data from structured (surveys, questionnaires), semi-structured (invoices, purchase orders), and unstructured documents (contracts, letters).	Extract text data, checkboxes, and tabular fields from structured and unstructured documents.	Document Intelligence Studio ● REST API ● C# SDK ● Java SDK ● JavaScript SDK ● Python SDK

Custom template

About	Description	Automation use cases	Development options
Custom Template model	The custom template model extracts labeled values and fields from structured and semi-structured documents.	Extract key data from highly structured documents with defined visual templates or common visual layouts, forms.	● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript SDK

Custom composed

About	Description	Automation use cases	Development options
Composed custom models	A composed model is created by taking a collection of custom models and assigning them to a single model built from your form types.	Useful when you train several models and want to group them to analyze similar form types like purchase orders.	● Document Intelligence Studio ● REST API ● C# SDK ● Java SDK ● JavaScript SDK ● Python SDK

Data privacy and security

As with all AI services, developers using the Document Intelligence service should be aware of Microsoft policies on customer data. See our Data, privacy, and security for Document Intelligence page.

Next steps