Job scheduler in Microsoft Fabric

Automate and streamline your data analytics workflows in Microsoft Fabric with the job scheduler. This article explains how to use the job scheduler to set up recurring jobs, manage multiple schedules, and integrate scheduling with your CI/CD processes. Learn how to keep your items up to date and ensure reliable task automation in your Fabric workspace.

What is the job scheduler?

The job scheduler is a built-in tool that lets you schedule jobs to run automatically at specified times. Use it to trigger data refreshes, pipeline runs, or other supported tasks for items in your Fabric workspace.

Access the job scheduler

To access the job scheduler:

1. Open your Fabric workspace and locate the item you want to schedule (for example, Notebook).
2. Select the item’s contextual menu.
3. Select Schedule from the menu to open the job scheduler interface.

You can also access the scheduler from within an item's settings by selecting the Schedule label.

Set up your schedule

After you open the scheduler for an item:

1. Toggle the scheduler On to enable scheduling.
2. Use the configuration panel to set when and how often the job runs.
3. Save your schedule to activate it.

Choose how often you want the job to run, and specify the start and end times. The scheduler supports various recurrence types, including minute-based, hourly, daily, weekly, monthly, and specific dates or weekdays of a month.

If your configuration doesn't match a valid time, the scheduler skips that run and waits for the next valid time.

To ensure your schedule is valid:

• Set a valid start and end time for your schedule.
• Make sure the end time is after the start time.
• The scheduler automatically handles special cases like daylight saving time and invalid dates (for example, February 30).

Job throttling limits

• The Scheduler limits each user to 50 job submissions and 50 Get Job requests per minute to maintain system stability. Requests beyond these limits are automatically rejected.

• Jobs can run for a maximum of 24 days. Any jobs exceeding this duration are automatically terminated.

Receive notifications for failed scheduled jobs

You can receive email notifications when a job triggered by a schedule fails to complete.

Configure failure notifications

While configuring a schedule, add users or groups under Failure notifications to receive emails when a scheduled run fails.

Important considerations

• Applies to all schedules: Notification settings apply across all schedules for the item.
• Scheduled runs only: Notifications are sent only for failures from scheduled runs. Notifications aren't sent for manually triggered runs.
• Recipients: Notifications can be sent to users or groups in your Microsoft Entra tenant, including internal users and B2B guest users. Direct external email addresses aren’t supported.
• Language: Notifications are sent in the display language of the recipient’s Fabric account. English is used as a fallback.

Notification content

When a scheduled run fails, the email includes:

• Item name and type
• Submitter
• Error details
• Run time (UTC)
• Link to view details in the monitoring hub
• Technical details for troubleshooting, including Activity ID, Request ID, and timestamps

Schedule failures in the monitoring hub.

Manage multiple schedules

Create and manage multiple schedules for a single item. Use different schedules to run jobs at different times or with different settings.

1. On the Schedule screen, view, add, and edit multiple schedule configurations for each item.
2. Select the schedule you want to manage, or create a new one for different job types or timing needs.

Scheduler auto-disable

If a scheduler repeatedly triggers jobs and encounters consecutive failures, the Fabric platform shuts down the scheduler and places it into an auto-disabled state to prevent further predictable job failures. To resume normal job scheduling, you must manually restart the scheduler through the UI, API, or CI/CD process.

Automate schedules with CI/CD

The job scheduler supports CI/CD integration, so you can deploy and manage schedules as part of your development workflow.

When you deploy an item, its schedules are automatically included, so you don't need to recreate them manually. For step-by-step instructions, see CI/CD workflow options in Fabric.

If you use variable library in the parameters, data sync might experience latency after CI/CD operations. This behavior is expected and will be improved in future releases.

Summary

The job scheduler in Microsoft Fabric lets you automate recurring jobs, manage multiple schedules for each item, and integrate scheduling into your CI/CD workflows. Use it to streamline your data analytics process, and make sure your jobs run reliably and efficiently.

Related content

• CI/CD workflow options in Fabric
• Monitor job activity and status in the monitoring hub