In short - yes. The extent to which it affects performance is bound to vary, depending on the number of VMs you intend to host on that system. Installing Hyper-V feature alone would not likely have any meaningful impact on performance.
More at https://learn.microsoft.com/en-us/windows/arm/faq#windows-on-arm-virtual-machine-faq
If the above response helps answer your question, remember to "Accept Answer" so that others in the community facing similar issues can easily find the solution. Your contribution is highly appreciated.
hth
Marcin