Skip to content

Scheduling Data Extraction

With Schedule, you can set up data extraction at specified time intervals for automatic data extraction. You can set up multiple schedules depending on how often you need to source data. Schedules can be set as recurring if they need to repeat at fixed intervals. Before setting up the schedule, consider the following parameters:

  • Start date

  • Time

  • Frequency (hourly, daily, weekly)

  • End date

Create a schedule for a report

Step 1: Go to Schedule under Report Settings.

Step 2: Fill in the necessary details:

 - Schedule Name

 - Start date and time

 - Frequency

 - Custom parameters

Step 3: Click on Schedule.

After a schedule is created, it will be displayed on the right side of the Schedule page. Once created, the schedule can be paused, edited or deleted. You can easily edit the schedules based on your requirements, pause them temporarily, unpause them, edit them or delete them when they are no longer needed.

Setting up Parameters

Parameters are configured based on customer requirements when the report is initially set up. However, the parameter values can be changed on the fly during execution. For example, if a crawler collects product data for a specific category from Amazon and the crawler is set up to take the category as an input, the customer can control which category of products is collected for each run. This can also be configured in the schedule.

Additional details

  • Changing the project or report status to cancelled will pause all the schedules in the report.
What frequencies are supported for schedule?
  • hourly
  • daily
  • weekly
  • monthly
How can I identify runs triggered by schedule?
  • Runs triggered by schedule have sch tag in datasets page.