Share via

Kusto Load Balancer

Shiva Lakshman Nallakatta 0 Reputation points Microsoft Employee
2024-08-09T18:40:58.83+00:00

Hi,

Is it possible to setup a load balancer in front of two Kusto clusters. Could you please let me know if this is feasible and what steps would be involved in implementing such a setup? Your guidance on this matter would be greatly appreciated.

Thanks

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
531 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Sander van de Velde | MVP 33,136 Reputation points MVP
    2024-08-09T19:54:27.1066667+00:00

    Hello @Shiva Lakshman Nallakatta ,

    welcome to this moderated Azure community forum.

    Azure Data Explorer has no standard default load balancer to route message to difference clusters.

    I checked the dynamic routing logic but this only route message within one cluster.

    There is this GitHub project offering an "Engine able to compute delta between ADX clusters (and/or Kusto scripts) and generate update scripts".

    You probably need to build some load balancing logic yourself on this repo.

    Perhaps this could work for you?

    So if you are able to distribute your messages over multiple event hubs, each eventhub could route messages to a specific cluster.

    If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. All community members with similar issues will benefit by doing so. Your contribution is highly appreciated.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.