Skip to main content
Databricks is a unified cloud-based analytics platform that streamlines data engineering, data science, and machine learning on large datasets at scale. You can use Refuel to read and write data back into Databricks.

​
Setup guide

For Refuel to read and write data back into Databricks, we need these pieces of information:
1

SQL Warehouse Details

  • Open your databricks workspace console
  • Navigate to your SQL Warehouse
    Databricks SQL Warehouse
  • Open the connection details tab, get the Server hostname and HTTP path
    Databricks Warehouse Connection
  • Get the Unity Catalog name. This is often the same as the workspace name
    Databricks Catalog
2

Authentication

  • Open your databricks workspace console
  • Click on your user profile icon in the top-right corner, and head to settings, then developer, then manage under access tokens
    Databricks Access Token
  • Enter a token description and the token validity (leave blank for a permanent token)
    Databricks Token Generation
3

Setup Integration in Refuel

In order to setup the databricks integration, navigate to Integrations within Refuel Cloud Settings, select Databricks, and fill in the following fields:
  • Server Hostname
  • Http Path
  • Access Token (Generated in Step 2)
  • Unity Catalog Name
  • Output Schema (Where Refuel will create output tables)
    Databricks Integration
⌘I