Manage GPUs via Discrete Device Assignment

Attach a GPU during Azure Local VM creation

Follow the steps outlined in Create Azure Local VMs enabled by Azure Arc and utilize the additional hardware profile details to add GPU to your create process.

az stack-hci-vm create --name $vmName --resource-group $resource_group --admin-username $userName --admin-password $password --computer-name $computerName --image $imageName --location $location --authentication-type all --nics $nicName --custom-location $customLocationID --hardware-profile memory-mb="8192" processors="4" --storage-path-id $storagePathId --gpus GpuDDA

Attach a GPU after VM creation

Use the following CLI command to attach the GPU:

az stack-hci-vm gpu attach --resource-group "test-rg" --custom-location "test-location" --vm-name "test-vm" --gpus GpuDDA

After attaching the GPU, the output shows the full VM details. You can confirm the GPUs were attached by reviewing the hardware profile virtualMachineGPUs section - the output looks like this:

"properties":{
    "hardwareProfile":{
        "virtualMachineGPUs":[
            {
                "assignmentType": "GpuDDA",
                "gpuName": "NVIDIA A2",
                "partitionSizeMb": null
            }
         ],

For details on the GPU attach command, see az stack-hci-vm gpu.

Detach a GPU

Use the following CLI command to detach the GPU:

az stack-hci-vm gpu detach --resource-group "test-rg" --custom-location "test-location" --vm-name "test-vm"

After detaching the GPU, the output shows the full VM details. You can confirm the GPUs were detached by reviewing the hardware profile virtualMachineGPUs section - the output looks like this:

"properties":{
    "hardwareProfile":{
        "virtualMachineGPUs":[],

For details on the GPU attach command, see az stack-hci-vm gpu.

Attach GPU during Azure Local VM creation

1. Follow the steps outlined in Create Azure Local VMs.

2. To attach a GPU to this VM, select Attach GPU.

   

3. Once Attach GPU is selected, GPU Setup options display. Select DDA.

   

4. Review the specified settings and then select Create. It should take a few minutes to provision the VM.

   

Attach GPU after Azure Local VM creation

To attach GPUs using Azure portal for existing Azure Local VMs, follow these steps in the Azure portal for your Azure Local instance:

1. For your Azure Local resource, go to Virtual machines.

2. In the list of VMs, select the VM that you want to attach a GPU partition to.

3. Under Settings, select Size. Modify the setting as needed, then for GPU Setup, select DDA.

   

4. When done, select Save. Afterwards, Azure Local will shut down the VM, attach the GPU, and restart the VM.

Detach GPU partitions

To detach a GPU partition for existing Azure Local VMs, follow these steps in the Azure portal for your Azure Local instance:

1. For your Azure Local resource, go to Virtual machines.

2. In the list of VMs, select the VM that you want to detach a GPU from.

3. Under Settings, select Size. Under GPU Assignment, select Delete assignment.

   

4. When done, select Save. Afterwards, Azure Local will shut down the VM, detach the GPU, and restart the VM.

Next steps

• Manage GPUs via partitioning