Usage Limits

This page explains the limits you are subject to when using the API, including use of the Export Console.

Note that limits are dependent on the package you have purchased for the API. This page explains how limits are applied, but please check your contract for your account limits.

Historical access

Your package may limit you to how far in the past you can access data for export and analytics.

For example your package may include access to 6 months of historical data. If so you can export data and run analytics on data from up to 6 months back from the current date.

For packages that do not limit historical access the historical data you can export differs by content type:

  • News data is available from 2009 onwards
  • Social data is available for the last 15 months

Exports

Documents per month

If you have access to export content your package will limit you to a number of documents you can export per month.

If you approach or reach your limit you will be notified by email. Notifications are sent when you reach 80%, 90% and 100% of your limit.

You can see the number of documents you have exported by viewing your usage statistics.

This limit is reset on the 1st day of each month.

Note that a single export can contain a maximum of 2,000,000 documents. Before an export is created, we check the number of results the export will generate and return an error if it's forecast to return more than 2,000,000 documents. For recurring exports, if at some point in time the export goes above this limit, the export will be cancelled.

Exports per month

If you have access to export content your package may limit you to a number of exports you can run per month.

If you approach or reach your limit you will be notified by email. Notifications are sent when you reach 80%, 90% and 100% of your limit.

This limit is reset on the 1st day of each month.

You can see the number of documents you have exported by viewing your usage statistics.

Understanding exports
It is important to understand that when you create an export through the Export Console or using the API this can contain up to 5 saved searches or tags. Each of the searches or tags will consume one of your exports for the month. So for example, if you create a one-off export containing 3 saved searches, this will consume 3 of your exports allowance. If you create a recurring export which contains 2 tags this will consume 2 of your exports allowance each time it runs.

Maximum export window

If you have access to export content your package may limit the time window for which you can run an export.

For example if you are limited to 1 month that means the start date and the end date of an export can be a maximum of 1 month apart. For 1 month the API actually allows 31 days between start and end date, for example 2020/08/01 00:00:00 to 2020/09/01 00:00:00.

For packages that do not limit the export window, the maximum window is 2 years.

Analytics

Daily analytics calls

If you have access to analytics features your package will limit you to a number of analytics calls you can make per day.

You can see the number of analytics calls you've used of your allowance by inspecting headers returned by the API. These headers are returned for every analytics request:

Header Name Description
RateLimit-Day-Limit This is the number API credits you have per day as set by your API package. (For example 120 credits per day.)
RateLimit-Day-Remaining The remaining number of API calls before you are rate limited. If this falls to 0, you are rate limited. If you hit your API limit, all subsequent requests will fail with a suitable error message and HTTP response code of 403 or 429.
RateLimit-Day-Reset Unix timestamp when the next reset will occur.

Maximum analysis window

If you have access to analytics your package may limit the time window for which you can run an analysis query.

For example if you are limited to 1 month that means the start date and the end date of an analysis request can be a maximum of 1 month apart.

API Calls

Calls to analytics endpoints are limited to 5 calls / second and 100 calls / minute.

The following export endpoints are limited to 20 calls / minute:

  • POST /export/v1/exports/one-time
  • POST /export/v1/exports/recurring
  • POST /v3/exports/one-time
  • POST /v3/exports/recurring

Calls to all other endpoints are limited to 100 calls / minute.