Breadcrumbs

Google BigQuery - Execute Query

Overview

Execute any Standard SQL query against a Google BigQuery database. Perfect for creating multi-step SQL jobs, executing DML statements, or running scheduled queries.

Variables

Name

Reference

Type

Required

Default

Options

Description

Query

BIGQUERY_QUERY

Alphanumeric

None

-

Standard SQL query to be executed against BigQuery. Does not support Legacy SQL.

Service Account

GOOGLE_APPLICATION_CREDENTIALS

Password

None

-

Either JSON from a Google Cloud Service account key or fill in with ${ALLI_GOOGLE_CLOUD_CREDENTIALS}, a built in workflow environment variable that will populate this input with valid credentials.

Project ID

BIGQUERY_PROJECT

Alphanumeric

-

-

This is the project name used for big query connections, which can be found in the setting section of "Mange Client". If unsure of exact project name, fill in with ${ALLI_GOOGLE_CLOUD_PROJECT} and it will pull the value from client settings.

Location

BIGQUERY_LOCATION

Alphanumeric

-

-

This is the location/region where your project is stored, which can be found in the setting section of "Mange Client". If unsure of exact location/region, fill in with ${ALLI_GOOGLE_CLOUD_BIGQUERY_LOCATION} and it will pull the value from client settings.

YAML

Below is the YAML template

YAML

source:
  template: Google BigQuery - Execute Query
  inputs:
    BIGQUERY_QUERY:
    GOOGLE_APPLICATION_CREDENTIALS:
    BIGQUERY_PROJECT:
    BIGQUERY_LOCATION:
  type: TEMPLATE
guardrails:
  retry_count: 1
  retry_wait: 0h0m0s
  runtime_cutoff: 1h0m0s
  exclude_exit_code_ranges:
    - 102
    - 200
    - 203
    - 205