third-party SFTP with ADF

RTG-1064 40 Reputation points
2025-11-20T13:23:48.72+00:00

We are trying to connect Azure Data Factory to a third-party SFTP endpoint provided by Bloomberg. The connection fails when using the Azure Integration Runtime (AutoResolve IR).

  1. Is it possible to connect to Bloomberg SFTP using Azure IR + IP whitelist?
  2. Is Self-Hosted Integration Runtime (SHIR) the recommended / required approach to access Bloomberg SFTP?
    Please share any recommended approach, official documentation or experience, greatly thanks.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Q&A Assist
    2025-11-20T13:24:06.03+00:00
    AI generated content. This question contains an answer created with AI from Q&A Assist. Learn more
    1. Yes, it is possible to connect to a third-party SFTP endpoint like Bloomberg using Azure Integration Runtime (AutoResolve IR) if the SFTP server allows connections from the Azure IP addresses. However, you will need to ensure that the IP addresses used by Azure IR are whitelisted on the Bloomberg SFTP server. You can find the list of Azure Integration Runtime IP addresses in the official documentation.
    2. While using Azure IR is possible, the Self-Hosted Integration Runtime (SHIR) is often recommended for connecting to third-party SFTP servers, especially when you need more control over the network configuration, such as IP whitelisting. SHIR runs on a customer-managed machine, which allows you to configure the environment according to your needs and ensure that it can connect to the SFTP server without restrictions.

    For more detailed guidance, you can refer to the official Azure documentation on integration runtimes and connecting to SFTP servers.


    References:

    0 comments No comments

  2. VRISHABHANATH PATIL 1,725 Reputation points Microsoft External Staff Moderator
    2025-12-02T09:05:27.3266667+00:00

    Hi @RTG-1064

    Thanks for contacting to Microsoft QA, here are step by step mitigation steps to resolve your query -

    It can work with Azure IR—but only if Bloomberg accepts the region’s shared ADF IP ranges. Bloomberg’s SFTP is strictly IP‑allowlisted; they prefer tight, account‑specific IPs. If they won’t allow broad service‑tag ranges (DataFactory.<region>), Azure IR will keep failing. [learn.microsoft.com]

    Recommended approach: use Self‑Hosted Integration Runtime (SHIR) behind a static egress IP. Put SHIR on an Azure VM/VNet, attach a NAT Gateway (or Azure Firewall) with a static Public IP, and give those IPs to Bloomberg for the allowlist. This is reliable and aligns with Bloomberg policy. [learn.microsoft.com], [learn.microsoft.com]

    Set up checklist (SHIR): Install and register SHIR → bind subnet to NAT Gateway (static IP) → submit the IP(s) via Bloomberg Enterprise Console → configure ADF SFTP linked service with host, port 22, and SSH key → test. [learn.microsoft.com], [learn.microsoft.com], [bloomberg.com], [learn.microsoft.com]

    • Common fixes:
      • If uploads fail on temp‑file rename, disable useTempFileRename. [learn.microsoft.com]
        • If key auth errors occur from Key Vault, ensure the Base64‑encoded private key content is correct (or upload the original key file to validate). [learn.microsoft.com]
          • Verify ciphers/KEX against Bloomberg’s standards if handshakes fail.

    KB / Official docs (direct links)

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.