Backfilling data for a platform
Overview
This tutorial walks through how to utilize the pre-built Marketplace apps to backfill data for a platform in ADL.
This tutorial does not work for the following platforms: CM360, The Trade Desk, and Bidtellect.
If you need to backfill data for these platforms, follow the corresponding tutorials below:
CM360 - Onboarding CM360 to Data Library
The Trade Desk - Onboarding Trade Desk to Data Library
Bidtellect - Onboarding Bidtellect to Data Library
Backfilling your datasources using Alli Marketplace
1.) Go back to Alli Marketplace and search for the ADL 2.0 - Backfill Platform
app under My Apps → Browse.
2.) Install the app, and fill out the required fields:
START_DATE - the start date of the intended backfill
END_DATE - the end date of the intended backfill
PLATFORM - the platform to be backfilled
3.) Select Save & Run to initiate the backfill request
4.) When finished, check the output for backfill status for each datasource, e.g.:
------------------------------------------------------------------------------------------------------------------------
ADL COMMAND - SYNC PLATFORM DATASOURCES
------------------------------------------------------------------------------------------------------------------------
Event emitting to Alli....
Event Status: 202 | Event Details: {"id":"192c9882-daa1-2581-e463-448697c98a55","time":"2023-05-25T05:39:37+00:00","origin":"app.8661855e-137c-41b5-88b3-fccf894b920e","type":"datalibrary.clients.SyncPlatform","version":"1","detail":{"client_slug":"playground","client_id":"008db125-be82-49c0-b31a-880e4e7c5af4","platform":"FACEBOOK","start_date":"2023-05-24","end_date":"2023-05-24"}}
Starting Source Sync for: facebookads_insights_ad in Alli Client playground
Sync response for playground, facebookads_insights_ad, 646dc530f035f1d91e102e04, ['2023-05-24', '2023-05-24']:
{"success":true,"jobStartsAt":"Thu May 25 2023 00:44:37 GMT-0500 (Central Daylight Time)"}
Starting Source Sync for: facebookads_insights_adconversion in Alli Client playground
Sync response for playground, facebookads_insights_adconversion, 646dc530f035f1d91e102e05, ['2023-05-24', '2023-05-24']:
{"success":true,"jobStartsAt":"Thu May 25 2023 00:44:37 GMT-0500 (Central Daylight Time)"}
The execution of this app reflects the status of the backfill request, NOT the backfill itself. The process could take anywhere from a couple of minutes to several hours depending on the specified date range and the size of the account(s) in question.
To check the status of the backfill, search for your datasources and check the Last Run Date
column to see when it was last loaded. When in doubt, you can validate the data using the datasource Audit page or by querying the table.