Hi @Krupal Bandari,
Thank you so much for following up and for the support extended earlier regarding the quota increase.
I did try again after the confirmation, but unfortunately still faced the same core quota limit errors, even when using the minimum configuration. I double-checked all regional quotas, and though usage was 0%, I was not able to proceed due to the combined vCPU + SKU quota behavior.
Since this was for learning purposes and I could not afford the projected monthly cost, I have decided to try out GCP Dataproc for now, which suits my needs and budget better at the moment.
I really appreciate your time and help; your responsiveness and clarity were truly valuable. I will surely explore Azure again in the future.
Best regards,
Vinay Marali