az aimanager

Note

This reference is part of the aimanager extension for the Azure CLI (version 2.61.0 or higher). The extension will automatically install the first time you run an az aimanager command. Learn more about extensions.

Manage AI Manager resources for inference on AKS.

Commands

Name Description Type Status
az aimanager create

Create an AI Manager resource.

Extension GA
az aimanager delete

Delete an AI Manager resource.

Extension GA
az aimanager get-credentials

Get access credentials for an AI Manager.

Extension GA
az aimanager list

List AI Manager resources.

Extension GA
az aimanager model

Browse the AI model catalog and estimate deployment cost.

Extension GA
az aimanager model calculate-cost

Calculate the estimated cost of deploying an AI model in a region.

Extension GA
az aimanager model list

List the AI models available in a region.

Extension GA
az aimanager model show

Show the details of an AI model in the catalog.

Extension GA
az aimanager modelsource

Manage model sources within an AI Manager.

Extension GA
az aimanager modelsource add

Add a model source to an AI Manager.

Extension GA
az aimanager modelsource delete

Delete a model source from an AI Manager.

Extension GA
az aimanager modelsource list

List the model sources within an AI Manager.

Extension GA
az aimanager modelsource show

Show the details of a model source within an AI Manager.

Extension GA
az aimanager modelsource update

Update a model source within an AI Manager.

Extension GA
az aimanager modelsource wait

Wait for an AI Manager model source to reach a desired state.

Extension GA
az aimanager namespace

Manage namespaces within an AI Manager.

Extension GA
az aimanager namespace add

Add a namespace to an AI Manager.

Extension GA
az aimanager namespace delete

Delete a namespace within an AI Manager.

Extension GA
az aimanager namespace get-credentials

Get access credentials for an AI Manager namespace.

Extension GA
az aimanager namespace list

List the namespaces within an AI Manager.

Extension GA
az aimanager namespace list-accesskeys

List the LLM gateway endpoint and API keys of an AI Manager namespace.

Extension GA
az aimanager namespace modeldeployment

Manage model deployments within an AI Manager namespace.

Extension GA
az aimanager namespace modeldeployment add

Add a model deployment to an AI Manager namespace.

Extension GA
az aimanager namespace modeldeployment delete

Delete a model deployment from an AI Manager namespace.

Extension GA
az aimanager namespace modeldeployment list

List model deployments within an AI Manager namespace.

Extension GA
az aimanager namespace modeldeployment show

Show a model deployment within an AI Manager namespace.

Extension GA
az aimanager namespace modeldeployment update

Update a model deployment within an AI Manager namespace.

Extension GA
az aimanager namespace modeldeployment wait

Wait for an AI Manager model deployment to reach a desired state.

Extension GA
az aimanager namespace rotate-accesskeys

Rotate the LLM gateway API keys of an AI Manager namespace.

Extension GA
az aimanager namespace show

Show the details of a namespace within an AI Manager.

Extension GA
az aimanager namespace update

Update a namespace within an AI Manager.

Extension GA
az aimanager namespace wait

Wait for an AI Manager namespace to reach a desired state.

Extension GA
az aimanager show

Show the details of an AI Manager resource.

Extension GA
az aimanager update

Update an AI Manager resource.

Extension GA
az aimanager wait

Wait for an AI Manager resource to reach a desired state.

Extension GA

az aimanager create

Create an AI Manager resource.

az aimanager create --name
                    --resource-group
                    [--acquire-policy-token]
                    [--aks-custom-headers]
                    [--change-reference]
                    [--delete-policy {Delete, Keep}]
                    [--location]
                    [--no-wait]
                    [--tags]

Examples

Create an AI Manager

az aimanager create --name my-ai-manager -g myrg -l eastus2

Create an AI Manager with the Keep delete policy

az aimanager create --name my-ai-manager -g myrg -l eastus2 --delete-policy Keep

Required Parameters

--name -n

The name of the AI Manager resource.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--acquire-policy-token

Acquiring an Azure Policy token automatically for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--aks-custom-headers

Comma-separated key=value pairs to specify custom headers.

--change-reference

The related change reference ID for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--delete-policy

Delete options of the AI Manager. Defaults to Delete.

Property Value
Accepted values: Delete, Keep
--location -l

Location. Values from: az account list-locations. You can configure the default location using az configure --defaults location=<location>.

--no-wait

Do not wait for the long-running operation to finish.

Property Value
Default value: False
--tags

The tags to set to the AI Manager.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az aimanager delete

Delete an AI Manager resource.

az aimanager delete --name
                    --resource-group
                    [--acquire-policy-token]
                    [--change-reference]
                    [--no-wait]
                    [--yes]

Examples

Delete an AI Manager

az aimanager delete --name my-ai-manager -g myrg

Required Parameters

--name -n

The name of the AI Manager resource.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--acquire-policy-token

Acquiring an Azure Policy token automatically for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--change-reference

The related change reference ID for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--no-wait

Do not wait for the long-running operation to finish.

Property Value
Default value: False
--yes -y

Do not prompt for confirmation.

Property Value
Default value: False
Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az aimanager get-credentials

Get access credentials for an AI Manager.

Retrieves the Kubernetes configuration for an AI Manager and merges it into the local kubeconfig file (default ~/.kube/config), similar to 'az aks get-credentials'.

az aimanager get-credentials --name
                             --resource-group
                             [--acquire-policy-token]
                             [--aks-custom-headers]
                             [--change-reference]
                             [--context-name]
                             [--file]
                             [--overwrite-existing]

Examples

Get the credentials for an AI Manager and merge into the default kubeconfig

az aimanager get-credentials --name my-ai-manager -g myrg

Print the credentials to stdout

az aimanager get-credentials --name my-ai-manager -g myrg -f -

Required Parameters

--name -n

The name of the AI Manager resource.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--acquire-policy-token

Acquiring an Azure Policy token automatically for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--aks-custom-headers

Comma-separated key=value pairs to specify custom headers.

--change-reference

The related change reference ID for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--context-name

If specified, overwrite the default context name.

--file -f

Kubernetes configuration file to update. Use "-" to print YAML to stdout instead.

Property Value
Default value: ~\.kube\config
--overwrite-existing

Overwrite any existing cluster entry with the same name.

Property Value
Default value: False
Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az aimanager list

List AI Manager resources.

az aimanager list [--resource-group]

Examples

List AI Managers in a resource group

az aimanager list -g myrg

List all AI Managers in the subscription

az aimanager list

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az aimanager show

Show the details of an AI Manager resource.

az aimanager show --name
                  --resource-group

Examples

Show an AI Manager

az aimanager show --name my-ai-manager -g myrg

Required Parameters

--name -n

The name of the AI Manager resource.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az aimanager update

Update an AI Manager resource.

az aimanager update --name
                    --resource-group
                    [--acquire-policy-token]
                    [--aks-custom-headers]
                    [--change-reference]
                    [--delete-policy {Delete, Keep}]
                    [--no-wait]
                    [--tags]

Examples

Update the tags of an AI Manager

az aimanager update --name my-ai-manager -g myrg --tags env=prod team=alpha

Update the delete policy of an AI Manager

az aimanager update --name my-ai-manager -g myrg --delete-policy Keep

Required Parameters

--name -n

The name of the AI Manager resource.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--acquire-policy-token

Acquiring an Azure Policy token automatically for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--aks-custom-headers

Comma-separated key=value pairs to specify custom headers.

--change-reference

The related change reference ID for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--delete-policy

Delete options of the AI Manager. Defaults to Delete.

Property Value
Accepted values: Delete, Keep
--no-wait

Do not wait for the long-running operation to finish.

Property Value
Default value: False
--tags

The tags to set to the AI Manager.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az aimanager wait

Wait for an AI Manager resource to reach a desired state.

az aimanager wait --name
                  --resource-group
                  [--acquire-policy-token]
                  [--change-reference]
                  [--created]
                  [--custom]
                  [--deleted]
                  [--exists]
                  [--interval]
                  [--timeout]
                  [--updated]

Required Parameters

--name -n

The name of the AI Manager resource.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--acquire-policy-token

Acquiring an Azure Policy token automatically for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--change-reference

The related change reference ID for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--created

Wait until created with 'provisioningState' at 'Succeeded'.

Property Value
Parameter group: Wait Condition Arguments
Default value: False
--custom

Wait until the condition satisfies a custom JMESPath query. E.g. provisioningState!='InProgress', instanceView.statuses[?code=='PowerState/running'].

Property Value
Parameter group: Wait Condition Arguments
--deleted

Wait until deleted.

Property Value
Parameter group: Wait Condition Arguments
Default value: False
--exists

Wait until the resource exists.

Property Value
Parameter group: Wait Condition Arguments
Default value: False
--interval

Polling interval in seconds.

Property Value
Parameter group: Wait Condition Arguments
Default value: 30
--timeout

Maximum wait in seconds.

Property Value
Parameter group: Wait Condition Arguments
Default value: 3600
--updated

Wait until updated with provisioningState at 'Succeeded'.

Property Value
Parameter group: Wait Condition Arguments
Default value: False
Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False