Hello Weronika Kacprzak,
Thank you for sharing your scenario.
To clarify based on the current behavior of Azure Synapse Link: you cannot use "Append Only" mode, table replication with partitioning, and "Incremental Update Folder Structure" all in the same profile because these are mutually exclusive configurations.
As documented, incremental update mode (which creates timestamped folders with change data) only works when:
- The option "Connect to your Azure Synapse workspace" is not selected
- And "Enable Incremental Update Folder Structure" is turned on
- And the profile is configured specifically for incremental updates, not full table replication
Additionally, incremental updates export data as CSV files and do not support Delta Parquet format or "Append Only" behavior. On the other hand, "Append Only" applies only when you're exporting full tables in Parquet format, typically used for analytics workloads but this disables the time-based folder creation pattern associated with CDC-like flows.
So, if your table was previously working like a CDC (change data capture) system using incremental timestamps, but now has "Append Only" enabled, it's likely that the underlying profile shifted to table replication mode which means it's no longer producing true incremental update folders, even if the setting appears enabled.
If I disable Append Only, will it still work the same way as before?
Not necessarily. Simply disabling "Append Only" won't restore incremental update behavior unless the entire profile is set up correctly for incremental updates (with Synapse workspace connection disabled). If the profile was created with "Connect to your Azure Synapse workspace", then incremental update folder structure is disabled by design, regardless of other settings.
It seems that disabling this option might not be possible, so I may need to create a new Synapse Link. Is that correct?
Yes, that’s correct. Since configuration modes (table replication vs. incremental updates) are locked at the profile level, you’ll need to create a new Synapse Link profile dedicated to incremental updates ensuring that:
- You do not select “Connect to your Azure Synapse workspace”
- You enable Incremental Update Folder Structure
- You set your desired time interval (e.g., hourly)
- You avoid enabling "Append Only", as it does not apply in this mode
This new profile will resume generating timestamped folders (yyyy-MM-dd'T'HH:mm:ss.SSSz) containing CSV files with changes, provided data modifications occur during each interval.
Because this is a distinct configuration question and involves a different setup goal than the original post, I kindly suggest starting a new thread on Microsoft Q&A with your specific details. That way, your issue can be tracked separately, receive focused attention from the community and engineering teams, and remain visible even if others aren’t monitoring this thread.
You can reference the official guide here for setup steps:
Configure Synapse Link for Incremental Updates
Please "Accept as Answer" or click 'Thumbs Up YES' if the answer provided is useful, so that you can help others in the community looking for remediation for similar issues.
Thanks
Pratyush