az aimanager
Note
This reference is part of the aimanager extension for the Azure CLI (version 2.61.0 or higher). The extension will automatically install the first time you run an az aimanager command. Learn more about extensions.
Manage AI Manager resources for inference on AKS.
Commands
| Name | Description | Type | Status |
|---|---|---|---|
| az aimanager create |
Create an AI Manager resource. |
Extension | GA |
| az aimanager delete |
Delete an AI Manager resource. |
Extension | GA |
| az aimanager get-credentials |
Get access credentials for an AI Manager. |
Extension | GA |
| az aimanager list |
List AI Manager resources. |
Extension | GA |
| az aimanager model |
Browse the AI model catalog and estimate deployment cost. |
Extension | GA |
| az aimanager model calculate-cost |
Calculate the estimated cost of deploying an AI model in a region. |
Extension | GA |
| az aimanager model list |
List the AI models available in a region. |
Extension | GA |
| az aimanager model show |
Show the details of an AI model in the catalog. |
Extension | GA |
| az aimanager modelsource |
Manage model sources within an AI Manager. |
Extension | GA |
| az aimanager modelsource add |
Add a model source to an AI Manager. |
Extension | GA |
| az aimanager modelsource delete |
Delete a model source from an AI Manager. |
Extension | GA |
| az aimanager modelsource list |
List the model sources within an AI Manager. |
Extension | GA |
| az aimanager modelsource show |
Show the details of a model source within an AI Manager. |
Extension | GA |
| az aimanager modelsource update |
Update a model source within an AI Manager. |
Extension | GA |
| az aimanager modelsource wait |
Wait for an AI Manager model source to reach a desired state. |
Extension | GA |
| az aimanager namespace |
Manage namespaces within an AI Manager. |
Extension | GA |
| az aimanager namespace add |
Add a namespace to an AI Manager. |
Extension | GA |
| az aimanager namespace delete |
Delete a namespace within an AI Manager. |
Extension | GA |
| az aimanager namespace get-credentials |
Get access credentials for an AI Manager namespace. |
Extension | GA |
| az aimanager namespace list |
List the namespaces within an AI Manager. |
Extension | GA |
| az aimanager namespace list-accesskeys |
List the LLM gateway endpoint and API keys of an AI Manager namespace. |
Extension | GA |
| az aimanager namespace modeldeployment |
Manage model deployments within an AI Manager namespace. |
Extension | GA |
| az aimanager namespace modeldeployment add |
Add a model deployment to an AI Manager namespace. |
Extension | GA |
| az aimanager namespace modeldeployment delete |
Delete a model deployment from an AI Manager namespace. |
Extension | GA |
| az aimanager namespace modeldeployment list |
List model deployments within an AI Manager namespace. |
Extension | GA |
| az aimanager namespace modeldeployment show |
Show a model deployment within an AI Manager namespace. |
Extension | GA |
| az aimanager namespace modeldeployment update |
Update a model deployment within an AI Manager namespace. |
Extension | GA |
| az aimanager namespace modeldeployment wait |
Wait for an AI Manager model deployment to reach a desired state. |
Extension | GA |
| az aimanager namespace rotate-accesskeys |
Rotate the LLM gateway API keys of an AI Manager namespace. |
Extension | GA |
| az aimanager namespace show |
Show the details of a namespace within an AI Manager. |
Extension | GA |
| az aimanager namespace update |
Update a namespace within an AI Manager. |
Extension | GA |
| az aimanager namespace wait |
Wait for an AI Manager namespace to reach a desired state. |
Extension | GA |
| az aimanager show |
Show the details of an AI Manager resource. |
Extension | GA |
| az aimanager update |
Update an AI Manager resource. |
Extension | GA |
| az aimanager wait |
Wait for an AI Manager resource to reach a desired state. |
Extension | GA |
az aimanager create
Create an AI Manager resource.
az aimanager create --name
--resource-group
[--acquire-policy-token]
[--aks-custom-headers]
[--change-reference]
[--delete-policy {Delete, Keep}]
[--location]
[--no-wait]
[--tags]
Examples
Create an AI Manager
az aimanager create --name my-ai-manager -g myrg -l eastus2
Create an AI Manager with the Keep delete policy
az aimanager create --name my-ai-manager -g myrg -l eastus2 --delete-policy Keep
Required Parameters
The name of the AI Manager resource.
Name of resource group. You can configure the default group using az configure --defaults group=<name>.
Optional Parameters
The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.
Acquiring an Azure Policy token automatically for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
Comma-separated key=value pairs to specify custom headers.
The related change reference ID for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
Delete options of the AI Manager. Defaults to Delete.
| Property | Value |
|---|---|
| Accepted values: | Delete, Keep |
Location. Values from: az account list-locations. You can configure the default location using az configure --defaults location=<location>.
Do not wait for the long-running operation to finish.
| Property | Value |
|---|---|
| Default value: | False |
The tags to set to the AI Manager.
Global Parameters
Increase logging verbosity to show all debug logs.
| Property | Value |
|---|---|
| Default value: | False |
Show this help message and exit.
Only show errors, suppressing warnings.
| Property | Value |
|---|---|
| Default value: | False |
Output format.
| Property | Value |
|---|---|
| Default value: | json |
| Accepted values: | json, jsonc, none, table, tsv, yaml, yamlc |
JMESPath query string. See http://jmespath.org/ for more information and examples.
Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.
Increase logging verbosity. Use --debug for full debug logs.
| Property | Value |
|---|---|
| Default value: | False |
az aimanager delete
Delete an AI Manager resource.
az aimanager delete --name
--resource-group
[--acquire-policy-token]
[--change-reference]
[--no-wait]
[--yes]
Examples
Delete an AI Manager
az aimanager delete --name my-ai-manager -g myrg
Required Parameters
The name of the AI Manager resource.
Name of resource group. You can configure the default group using az configure --defaults group=<name>.
Optional Parameters
The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.
Acquiring an Azure Policy token automatically for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
The related change reference ID for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
Do not wait for the long-running operation to finish.
| Property | Value |
|---|---|
| Default value: | False |
Do not prompt for confirmation.
| Property | Value |
|---|---|
| Default value: | False |
Global Parameters
Increase logging verbosity to show all debug logs.
| Property | Value |
|---|---|
| Default value: | False |
Show this help message and exit.
Only show errors, suppressing warnings.
| Property | Value |
|---|---|
| Default value: | False |
Output format.
| Property | Value |
|---|---|
| Default value: | json |
| Accepted values: | json, jsonc, none, table, tsv, yaml, yamlc |
JMESPath query string. See http://jmespath.org/ for more information and examples.
Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.
Increase logging verbosity. Use --debug for full debug logs.
| Property | Value |
|---|---|
| Default value: | False |
az aimanager get-credentials
Get access credentials for an AI Manager.
Retrieves the Kubernetes configuration for an AI Manager and merges it into the local kubeconfig file (default ~/.kube/config), similar to 'az aks get-credentials'.
az aimanager get-credentials --name
--resource-group
[--acquire-policy-token]
[--aks-custom-headers]
[--change-reference]
[--context-name]
[--file]
[--overwrite-existing]
Examples
Get the credentials for an AI Manager and merge into the default kubeconfig
az aimanager get-credentials --name my-ai-manager -g myrg
Print the credentials to stdout
az aimanager get-credentials --name my-ai-manager -g myrg -f -
Required Parameters
The name of the AI Manager resource.
Name of resource group. You can configure the default group using az configure --defaults group=<name>.
Optional Parameters
The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.
Acquiring an Azure Policy token automatically for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
Comma-separated key=value pairs to specify custom headers.
The related change reference ID for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
If specified, overwrite the default context name.
Kubernetes configuration file to update. Use "-" to print YAML to stdout instead.
| Property | Value |
|---|---|
| Default value: | ~\.kube\config |
Overwrite any existing cluster entry with the same name.
| Property | Value |
|---|---|
| Default value: | False |
Global Parameters
Increase logging verbosity to show all debug logs.
| Property | Value |
|---|---|
| Default value: | False |
Show this help message and exit.
Only show errors, suppressing warnings.
| Property | Value |
|---|---|
| Default value: | False |
Output format.
| Property | Value |
|---|---|
| Default value: | json |
| Accepted values: | json, jsonc, none, table, tsv, yaml, yamlc |
JMESPath query string. See http://jmespath.org/ for more information and examples.
Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.
Increase logging verbosity. Use --debug for full debug logs.
| Property | Value |
|---|---|
| Default value: | False |
az aimanager list
List AI Manager resources.
az aimanager list [--resource-group]
Examples
List AI Managers in a resource group
az aimanager list -g myrg
List all AI Managers in the subscription
az aimanager list
Optional Parameters
The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.
Name of resource group. You can configure the default group using az configure --defaults group=<name>.
Global Parameters
Increase logging verbosity to show all debug logs.
| Property | Value |
|---|---|
| Default value: | False |
Show this help message and exit.
Only show errors, suppressing warnings.
| Property | Value |
|---|---|
| Default value: | False |
Output format.
| Property | Value |
|---|---|
| Default value: | json |
| Accepted values: | json, jsonc, none, table, tsv, yaml, yamlc |
JMESPath query string. See http://jmespath.org/ for more information and examples.
Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.
Increase logging verbosity. Use --debug for full debug logs.
| Property | Value |
|---|---|
| Default value: | False |
az aimanager show
Show the details of an AI Manager resource.
az aimanager show --name
--resource-group
Examples
Show an AI Manager
az aimanager show --name my-ai-manager -g myrg
Required Parameters
The name of the AI Manager resource.
Name of resource group. You can configure the default group using az configure --defaults group=<name>.
Global Parameters
Increase logging verbosity to show all debug logs.
| Property | Value |
|---|---|
| Default value: | False |
Show this help message and exit.
Only show errors, suppressing warnings.
| Property | Value |
|---|---|
| Default value: | False |
Output format.
| Property | Value |
|---|---|
| Default value: | json |
| Accepted values: | json, jsonc, none, table, tsv, yaml, yamlc |
JMESPath query string. See http://jmespath.org/ for more information and examples.
Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.
Increase logging verbosity. Use --debug for full debug logs.
| Property | Value |
|---|---|
| Default value: | False |
az aimanager update
Update an AI Manager resource.
az aimanager update --name
--resource-group
[--acquire-policy-token]
[--aks-custom-headers]
[--change-reference]
[--delete-policy {Delete, Keep}]
[--no-wait]
[--tags]
Examples
Update the tags of an AI Manager
az aimanager update --name my-ai-manager -g myrg --tags env=prod team=alpha
Update the delete policy of an AI Manager
az aimanager update --name my-ai-manager -g myrg --delete-policy Keep
Required Parameters
The name of the AI Manager resource.
Name of resource group. You can configure the default group using az configure --defaults group=<name>.
Optional Parameters
The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.
Acquiring an Azure Policy token automatically for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
Comma-separated key=value pairs to specify custom headers.
The related change reference ID for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
Delete options of the AI Manager. Defaults to Delete.
| Property | Value |
|---|---|
| Accepted values: | Delete, Keep |
Do not wait for the long-running operation to finish.
| Property | Value |
|---|---|
| Default value: | False |
The tags to set to the AI Manager.
Global Parameters
Increase logging verbosity to show all debug logs.
| Property | Value |
|---|---|
| Default value: | False |
Show this help message and exit.
Only show errors, suppressing warnings.
| Property | Value |
|---|---|
| Default value: | False |
Output format.
| Property | Value |
|---|---|
| Default value: | json |
| Accepted values: | json, jsonc, none, table, tsv, yaml, yamlc |
JMESPath query string. See http://jmespath.org/ for more information and examples.
Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.
Increase logging verbosity. Use --debug for full debug logs.
| Property | Value |
|---|---|
| Default value: | False |
az aimanager wait
Wait for an AI Manager resource to reach a desired state.
az aimanager wait --name
--resource-group
[--acquire-policy-token]
[--change-reference]
[--created]
[--custom]
[--deleted]
[--exists]
[--interval]
[--timeout]
[--updated]
Required Parameters
The name of the AI Manager resource.
Name of resource group. You can configure the default group using az configure --defaults group=<name>.
Optional Parameters
The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.
Acquiring an Azure Policy token automatically for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
The related change reference ID for this resource operation.
| Property | Value |
|---|---|
| Parameter group: | Global Policy Arguments |
Wait until created with 'provisioningState' at 'Succeeded'.
| Property | Value |
|---|---|
| Parameter group: | Wait Condition Arguments |
| Default value: | False |
Wait until the condition satisfies a custom JMESPath query. E.g. provisioningState!='InProgress', instanceView.statuses[?code=='PowerState/running'].
| Property | Value |
|---|---|
| Parameter group: | Wait Condition Arguments |
Wait until deleted.
| Property | Value |
|---|---|
| Parameter group: | Wait Condition Arguments |
| Default value: | False |
Wait until the resource exists.
| Property | Value |
|---|---|
| Parameter group: | Wait Condition Arguments |
| Default value: | False |
Polling interval in seconds.
| Property | Value |
|---|---|
| Parameter group: | Wait Condition Arguments |
| Default value: | 30 |
Maximum wait in seconds.
| Property | Value |
|---|---|
| Parameter group: | Wait Condition Arguments |
| Default value: | 3600 |
Wait until updated with provisioningState at 'Succeeded'.
| Property | Value |
|---|---|
| Parameter group: | Wait Condition Arguments |
| Default value: | False |
Global Parameters
Increase logging verbosity to show all debug logs.
| Property | Value |
|---|---|
| Default value: | False |
Show this help message and exit.
Only show errors, suppressing warnings.
| Property | Value |
|---|---|
| Default value: | False |
Output format.
| Property | Value |
|---|---|
| Default value: | json |
| Accepted values: | json, jsonc, none, table, tsv, yaml, yamlc |
JMESPath query string. See http://jmespath.org/ for more information and examples.
Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.
Increase logging verbosity. Use --debug for full debug logs.
| Property | Value |
|---|---|
| Default value: | False |