MotherDuck - Upload File to Table

Overview

Quickly upload a CSV or parquet file to a a database table in MotherDuck. **Recommended Setup** This blueprint should be used after downloading or fetching data from another source. ### File Types This blueprint can be used to upload either CSV or Parquet files. For larger datasets it is recommended to use Parquet files when possible. ### Insert Type This blueprint can be used to overwrite data (with the `Create or Replace` option) or append to existing rows (with the `Append` option). In either case, if the table does not exist it will be created. ### Match Type This blueprint supports uploading multiple files using a Glob pattern or a regular expression. For single file uploads, use the `Exact Match` option and provide the exact file name to upload.

Variables

Name	Reference	Type	Required	Default	Options	Description
Access Token	MOTHERDUCK_TOKEN	Password	✅	-	-	The API token for programmatic access to MotherDuck
Database	MOTHERDUCK_DATABASE	Alphanumeric	➖	-	-	The optional database to connect to. If omitted, the blueprint will resort to the default. Additionally the database will be created if provided and it doesn't exist
Table Name	MOTHERDUCK_TABLE	Alphanumeric	✅	-	-	The name of the target table in MotherDuck to upload to
Source File Name	MOTHERDUCK_FILE_NAME	Alphanumeric	✅	-	-	The name of the file to upload to MotherDuck
Source Folder Name	MOTHERDUCK_FOLDER	Alphanumeric	➖	-	-	The optional folder location of where the source file is located
Insert Method	MOTHERDUCK_INSERT_METHOD	Select	✅	append	Append: append Create or Replace: replace	The insert method to use upon upload
Source File Match Type	MOTHERDUCK_MATCH_TYPE	Select	✅	exact_match	Exact Match: exact_match Glob Match: glob_match Regex Match: regex_match	The match type dictates whether a single file will be uploaded, or multiple that either match a glob or regex pattern

YAML

Below is the YAML template

YAML


source:
  template: MotherDuck - Upload File to Table
  inputs:
    MOTHERDUCK_TOKEN:
    MOTHERDUCK_DATABASE:
    MOTHERDUCK_TABLE:
    MOTHERDUCK_FILE_NAME:
    MOTHERDUCK_FOLDER:
    MOTHERDUCK_INSERT_METHOD: append
    MOTHERDUCK_MATCH_TYPE: exact_match
  type: TEMPLATE
guardrails:
  retry_count: 1
  retry_wait: 0h0m0s
  runtime_cutoff: 1h0m0s
  exclude_exit_code_ranges:
    - 101
    - 102
    - 103
    - 200
    - 210
    - 220
    - 249