Export Console Quickstart

In this tutorial we cover the basics of creating an export or earned media using the Export Console.

Note that you need access to the earned media exports feature in your API package to use this feature.

Using the Export Console you can create one-time and recurring exports of historical data based upon your Meltwater searches. You can download the results in CSV and JSON format, and can use the results in a BI Tool such as Tableau or Microsoft PowerBI.

Before you start

Take a look at the Platform Overview guide to understand the key concepts of the Meltwater platform.

To run through this tutorial, you will need:

  • Your Meltwater app login credentials
  • A Saved Search in your Meltwater App account

Types of exports

There are two types of exports:

  • One-time exports - these exports are run once, the data will not be refreshed. Use one-time exports when you just want to get an export of data for a specific time period.
  • Recurring exports - these exports give you the ability to setup an export once and get results updated regularly. Use recurring exports when you need to have the latest data for the predefined time span e.g. “last weeks data refreshed every week”.

Accessing the Export Console

You can access the Export Console from the left-hand navigation.

You will be asked to to sign in with your Meltwater application credentials.

Once you’ve logged in you’ll see a list of exports you’ve created in the past.

Creating a one-time export

Exports are generated using searches (or tags) you’ve created in the Meltwater application.

To create a new export click the Create Export button on the top right.

This will bring up a new dialog:

Note that you will only see the Companies option if you have access to multiple companies in your account. If this is the case, select the company which owns the searches / tags you’d like to use for your export.

Select the Search and/or Tag you’d like to export matches for.

Select ‘One-time’ as the export type.

For one-time exports you must give a Start date and an End date for the time window of your export. Only documents published within this time will be included in the results.

Select your desired output format for the export either JSON or CSV. Then select the start and end date for your export. You can also choose a different Timezone for these dates and times if needed.

Click Create to create the export.

Supported output formats

Two output formats are supported for exports: CSV and JSON. When you configure an export, you must specify which format you prefer.

The CSV format is ideal for importing into a spreadsheet or BI Tool. The JSON format can also be imported into a BI Tool which can process JSON data.

Note that the CSV format includes fewer fields than the JSON format as it isn’t possible to express all the available data in CSV format. Take a look at the Exports Formats & Fields page for full details.

Controlling data volumes using sampling

When creating an export, you can provide optional sampling parameters to set a maximum document count and/or percentage sample.

This feature allows you to control the amount of documents you export, and so stay within your export limits, plus also export representative data for high-volume topics. Sampling is supported for both one-time and recurring exports, and returns a random sample across the matching documents that would be in a full export.

There are two parameters that control sampling of results:

  • Max Count - the maximum number of documents you’d like to retrieve. Maximum value is 2 million.

  • Sample % - the percentage of results you’d like to retrieve.

Please note, that the sampling process is approximate in that the number of results will be within ±10% of your parameters.

The following examples show how you can make use of these parameters:

  • To return a 1% sample of matching documents - set Sample % to 1% and Max Count to 2 million.

  • To return up to 50,000 documents - set Sample % to 100% and Max Count to 50,000.

  • To return a 10% sample of documents, but limit the set to 1,000 documents maxmimum - set Sample % to 10% and Max Count to 1,000.

Viewing your exports

Once you’ve created your export, you will see it listed at the top of your exports list.

When your export is created, it will have an initial status of PENDING. Depending on the size of the export it could take from a minute to over half an hour to complete.

You can check the status of your exports by clicking the Refresh button at the top of the list.

Once the export is complete you’ll see it’s status will change to FINISHED.

Getting the Data URL for your export

Once an export has finished you can get the URL to access your export data by clicking the CSV or JSON link.

If you’d like to bring the data into a BI Tool take a look at our importing data guides.

Creating a recurring export

To create a recurring export, follow the same initial steps as when creating a one-time export, but select ‘Recurring’ as the export type.

For recurring exports you’ll need to provide a different set of parameters.

First, you need to specify the Frequency for the export. You can choose from Daily, Weekly and Monthly.

Next you specify the Window for your export, that is what period of data is included each time the export runs. This is a multiple of the Frequency you selected. For example, if you chose Daily and enter 2 for this field the export will run each day and include the last 2 days of data.

Finally you specify the end time of your export window. Your options depend on your selected frequency:

  • time of the day for Daily exports
  • time and day of the week for Weekly exports
  • time and day of the month for Monthly exports

The export will be run 30 minutes after the end of the export window.

For example, if you set up a Weekly export starting Sunday at 09:00, the export will run every Sunday at 09:30 and will contain data from that Sunday at 09:00, to the previous Sunday at 09:00.

When you configure your recurring export you’ll be shown a schedule of the upcoming exports which will help you check your settings.

Each time a recurring export runs the new data overwrites the data of the previous run. Therefore you download new data from the same URL each time the export completes.

You can see the recurring exports you have running by looking at the Exports Overview table. Recurring exports that are active have the status ACTIVE.