Integrate storage, database, webapp, and databricks into one VNET

P, John 200 Reputation points
2024-11-22T17:43:49.06+00:00

We are hardening our ML platform in Azure. Basically, we want to put all the Azure services ( ADLS, PostgreSQL DB, Web App, and Databricks cluster) in one virtural network so all the traffic will be inside the Azure network whenever possible (except the ingress collected data from on-premise network etc)

We plan to create different subnets for each services if needed:

  • two subnets for databrick cluster (VNET injection)
  • one subnet for the webapp service (VNET integration for outbound traffic)

The questions are:

Do we need to create dedicated subnet for ADLS storage and Database?

If not, how to route traffic between different Azure services? will the private endpoint be enough?

Thanks!

Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,024 questions
Azure Virtual Network
Azure Virtual Network
An Azure networking service that is used to provision private networks and optionally to connect to on-premises datacenters.
2,534 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,240 questions
Azure Web Application Firewall
Azure Database for PostgreSQL
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Delano Zuurman 0 Reputation points
    2024-11-22T18:11:13.83+00:00

    Hello,

    if you want all the resources to be in their own subnet but allow communication you can use private endpoints to specific resources.

    Another technique you may consider using is vnet peering as described here : https://learn.microsoft.com/en-us/azure/virtual-network/virtual-network-peering-overview

    so that all the traffic will still go over Microsoft’s private network only, but you can access the resources as if they where part of the same network.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.