AI customization manager overview

The AI customization manager helps you validate and improve AI accuracy for your flowsheets before testing in a test environment or going live in production. It enables repeatable accuracy testing and provides actionable insights to help you optimize and improve your flowsheet build for more reliable and accurate AI output and simpler documentation.

The AI customization manager tools scan templates and evaluate all flowsheet rows against predefined rules, support specific workflows to help diagnose issues, validate configuration, and prepare for onboarding and go‑live. These tools are enabled by default.

The following tools are available:

• Flowsheet viewer: View details of flowsheet templates, including groups, rows, macros, and a hierarchical structure.
• LDA viewer: View details for LDA (lines, drains, airways) groups, including rows, macros, and a hierarchical structure.
• Flowsheet analyzer: Identify schema issues in flowsheet templates based on a predefined set of validation rules.
• Import history: Review import logs and version history for flowsheet template imports.
• Tune accuracy: Create and run test cases to validate the accuracy of flowsheet templates. This is the primary interface for testing and managing AI accuracy.

Open the AI customization manager

To access these tools in Dragon admin center:

1. In the Dragon Copilot section of the navigation pane, select Nurses.
2. In the Operations section, select AI customization manager.

The AI customization manager opens in a new tab or a new window, depending on your browser settings.

We recommended that access to Dragon admin center is role‑based and aligned with responsibilities, for example:

• Informatics lead: Experience with flowsheet builds. Owns test case management and template enablement.
• EHR analyst: Experience with and access to the EHR nursing export utility.
• M365 admin: Responsible for end‑user and admin account management.
• IT admin: Manages environments, EHR configuration, and billing settings in Dragon admin center.

Prerequisites

To ensure the flowsheet templates are properly enabled for ambient recording, configured, and tested before enabling them in production, make sure the prerequisites are completed before you do any work in the AI customization manager.

We reccomend performing these steps in a test environment and then promoting the changes to a production environment.

1. Check users who will manage ambient enabled flowsheet templates have the corresponding Dragon admin center access.
2. Licenses are available and assigned to users.
3. Environments are set up and provisioned.
4. Your EHR is configured for each environment.
5. User Entra accounts are associated with the corresponding EHR IDs.
6. Flowsheet template management is done.

Go-live workflow

1. Validate imported flowsheet templates and LDA content.
2. Test the AI customization manager.
3. Create test cases in the Tune accuracy tool.
4. Run Tune accuracy, resolve issues, and iterate.
5. Import tests to your production environment.
6. Complete end user testing.

Environment recommendations

• Tuning work is environment specific

  • AI customization manager test case creation together with the flowsheet template upload and tagging are environment-specific activities.
  • Users who are onboarding should start working in the Dragon admin center environment that's provisioned for testing.

• Example environment setup for nursing

  • Test: A Microsoft environment connected to your test EHR environment.
  • Production: A Microsoft environment connected to your production EHR environment.

• Other environments that might apply

  • Training: A Microsoft environment connected to your training EHR environment.
  • POC: A Microsoft environment for manual imports of your POC EHR environment to run The Flowsheet analyzer on out of scope templates.