Breadcrumbs

Databricks - Move or Rename Files on DBFS

Overview

Easily import one or more files from Workflows to your Databricks File System (DBFS). The match type selected greatly affects how this Blueprint works.

Variables

Name

Reference

Type

Required

Default

Options

Description

Original Databricks Folder Name

DATABRICKS_SOURCE_FOLDER_NAME

Alphanumeric

None

-

Name of the Databricks File System folder where the file you want to move lives. If left blank, selects from /FileStore/.

Original Databricks File Name Match Type

DATABRICKS_SOURCE_FILE_NAME_MATCH_TYPE

Select

exact_match

Exact Match: exact_match

Regex Match: regex_match

Determines if the text in "Original Databricks File Name" will look for one file with exact match, or multiple files using regex.

Original Databricks File Name

DATABRICKS_SOURCE_FILE_NAME

Alphanumeric

None

-

Name of the target file on the Databricks File System (DBFS). Can be regex if "Match Type" is set accordingly.

New Databricks Folder Name

DATABRICKS_DESTINATION_FOLDER_NAME

Alphanumeric

None

-

Name of the folder where you want to move the Databricks files to in the Databricks File System (DBFS). If left blank, selects from /FileStore/.

New Databricks File Name

DATABRICKS_DESTINATION_FILE_NAME

Alphanumeric

None

-

What to name the file(s) being moved or renamed. If left blank, defaults to the original file name(s).

Workspace Instance URL

DATABRICKS_INSTANCE_URL

Alphanumeric

None

-

The subdomain, domain, and top-level domain (TLD) of your Databricks Workspace URL.

Access Token

DATABRICKS_ACCESS_TOKEN

Password

None

-

The personal access token associated with the provided Workspace Instance.

YAML

Below is the YAML template

YAML

source:
  template: Databricks - Move or Rename Files on DBFS
  inputs:
    DATABRICKS_SOURCE_FOLDER_NAME:
    DATABRICKS_SOURCE_FILE_NAME_MATCH_TYPE: exact_match
    DATABRICKS_SOURCE_FILE_NAME:
    DATABRICKS_DESTINATION_FOLDER_NAME:
    DATABRICKS_DESTINATION_FILE_NAME:
    DATABRICKS_INSTANCE_URL:
    DATABRICKS_ACCESS_TOKEN:
  type: TEMPLATE
guardrails:
  retry_count: 1
  retry_wait: 0h0m0s
  runtime_cutoff: 1h0m0s
  exclude_exit_code_ranges:
    - 200
    - 201
    - 202
    - 203
    - 212
    - 214