This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
I'm curious how to handle pagination with $skipToken in Azure Data Factory
According to the documentation (Pagination support) it seems quite simple in case when we have @odata.nextLink to use as next URL (Microsoft Graph API), but it's more complicated when it comes with $skipToken, that we need to insert in next POST body (Azure Resource Graph):
POST https://management.azure.com/providers/Microsoft.ResourceGraph/resources?api-version=2021-03-01
{
"query": "Resources",
"options": {
"$skipToken": "eyAibm8iOiAibHVjayIsICJidXQiOiAibmljZSIsICJ0cnkiOiAiISIgfQ=="
}
}
I thought about Copy activity with Until loop, but I couldn't find a way to grab $skipToken from previous activity.
Is there any simple solution for that or any workaround??
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Hello @Bartosz Pelikan ,
Thanks for the ask and using the Microsoft Q&A platform.\nAt this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.
Thanks
Himanshu
Hello @Bartosz Pelikan , Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to [email protected] with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter. Subscription ID:Subject : Attn Himanshu Please let me know once you have done the same.
Thanks
Himanshu
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 76%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECG%3C/text%3E%3C/svg%3E)
any news on this issue? the same thing is happening to me too.
unfortunately no
Hello @Bartosz Pelikan , As requested above if you have a support plan you may file a support ticket, else could you please send an email to [email protected] with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter. Subscription ID:Subject : Attn Himanshu Please let me know once you have done the same.
Thanks
Himanshu
One solution that come to my mind is to use function app as middleware between ADF and Azure Resource Graph API that will behave similar to Microsoft Graph API but I didn't tested this. I don't have environment with enough resources to reproduce this right now.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 80%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
any luck to get the answer?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 77%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERS%3C/text%3E%3C/svg%3E)
You can't reference one Until iteration from the next, but could you store the skip token in a pipeline variable at the end of each iteration? The variable would always hold the latest skip token, ready for use in the next iteration.