Share via

Data Factory - Big Query Linked Service does not read from file storage

Bakar, Cem 281 Reputation points
2021-10-29T05:05:08.13+00:00

I am trying to create linked service between Data Factory & BigQuery using service authenticate type.
It requires Key file path and and Trusted cert path which are keep failing - I get unable to open or can't find error.

144750-screen-shot-2021-10-29-at-10146-am.png

I tested the access rights by creating another linked service to read the file via storage linked service, which worked. So I know DF has access to the file.

Any ideas how to get this to work?

Thank you

Azure Data Share
Azure Data Share
An Azure service that is used to share data from multiple sources with other organizations.
55 questions
Azure Files
Azure Files
An Azure service that offers file shares in the cloud.
1,312 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,924 questions
Accepted answer
  1. Bakar, Cem 281 Reputation points
    2021-11-03T02:53:15.953+00:00

    Thank you for your support Himanshu.

    So this turned out to be very complicated process for DF.

    • Even the related document states that it should the .p12 file - it has to be the json file.
    • Regarless of your user access on VM (admin or not)
      -- Required files must be publicly available on the same VM where the integration runtime module is
      and more complications on security and network.

    Anyways, I ended using client_id and refresh token which includes manual work but at least I do not have to drop security standards to complete my task

    0 comments

1 additional answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Jorge L Dominguez 51 Reputation points
    2024-01-31T03:48:59.9466667+00:00

    I faced a similar issue while using the Autoresolved integration runtime. However, I managed to resolve it by using a self-hosted integration runtime instead. To do this, I placed the file in the c:\temp folder of the server where the integration runtime was installed and used service authentication, email created from BigQuery and giving the Key File Path: "C:\Temp" Although I would prefer to use the Autoresolved integration runtime and Azure Key Vault, I haven't had any luck with it yet.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.