Backfilling data for a platform in Data Library

Overview

This tutorial walks through how to utilize the pre-built ADL 2.0 Marketplace apps to backfill data for a platform in Data Library 2.0.

This tutorial does not work for the following platforms: CM360, The Trade Desk, and Bidtellect.

If you need to backfill data for these platforms, follow the corresponding tutorials below:

CM360 - Onboarding CM360 to Data Library
The Trade Desk - Onboarding Trade Desk to Data Library
Bidtellect - Onboarding Bidtellect to Data Library

Backfilling your datasources using Alli Marketplace

1.) Go back to Alli Marketplace and search for the Alli Data Library 2.0 - Backfill Platform app under My Apps → Browse.

2.) Install the app, and fill out the required fields:

START_DATE - the start date of the intended backfill

END_DATE - the end date of the intended backfill

PLATFORM - the platform to be backfilled

e.g., Running a 7-day backfill for Facebook Ads

3.) Select Save & Run to initiate the backfill request

4.) When finished, check the output for backfill status for each datasource, e.g.:

BASH

------------------------------------------------------------------------------------------------------------------------
ADL COMMAND - SYNC PLATFORM DATASOURCES
------------------------------------------------------------------------------------------------------------------------
Event emitting to Alli....
Event Status: 202 | Event Details: {"id":"192c9882-daa1-2581-e463-448697c98a55","time":"2023-05-25T05:39:37+00:00","origin":"app.8661855e-137c-41b5-88b3-fccf894b920e","type":"datalibrary.clients.SyncPlatform","version":"1","detail":{"client_slug":"playground","client_id":"008db125-be82-49c0-b31a-880e4e7c5af4","platform":"FACEBOOK","start_date":"2023-05-24","end_date":"2023-05-24"}}
	Starting Source Sync for: facebookads_insights_ad in Alli Client playground
	Sync response for playground, facebookads_insights_ad, 646dc530f035f1d91e102e04, ['2023-05-24', '2023-05-24']: 
		{"success":true,"jobStartsAt":"Thu May 25 2023 00:44:37 GMT-0500 (Central Daylight Time)"}
	Starting Source Sync for: facebookads_insights_adconversion in Alli Client playground
	Sync response for playground, facebookads_insights_adconversion, 646dc530f035f1d91e102e05, ['2023-05-24', '2023-05-24']: 
		{"success":true,"jobStartsAt":"Thu May 25 2023 00:44:37 GMT-0500 (Central Daylight Time)"}

The execution of this app reflects the status of the backfill request, NOT the backfill itself. The process could take anywhere from a couple of minutes to several hours depending on the specified date range and the size of the account(s) in question.

To check the status of the backfill, search for your datasources and check the Last Run Date column to see when it was last loaded. When in doubt, you can validate the data using the datasource Audit page or by querying the table.

Overview

Backfilling your datasources using Alli Marketplace

Related articles