> ## Documentation Index
> Fetch the complete documentation index at: https://docs.refuel.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Databricks

[Databricks](https://www.databricks.com/) is a unified cloud-based analytics platform that streamlines data engineering,
data science, and machine learning on large datasets at scale.

You can use Refuel to read and write data back into Databricks.

## Setup guide

For Refuel to read and write data back into Databricks, we need these pieces of information:

<Steps>
  <Step title="SQL Warehouse Details">
    * Open your databricks workspace console
    * Navigate to your SQL Warehouse
          <img src="https://mintcdn.com/refuelai/Ro4ZLj7W42QNS-H_/images/datasets/databricks/databricks-sql-warehouse.png?fit=max&auto=format&n=Ro4ZLj7W42QNS-H_&q=85&s=cea6535ae0cfb4c52f0b2f65a26cc449" alt="Databricks SQL Warehouse" width="5106" height="1718" data-path="images/datasets/databricks/databricks-sql-warehouse.png" />
    * Open the connection details tab, get the **Server hostname** and **HTTP path**
          <img src="https://mintcdn.com/refuelai/Ro4ZLj7W42QNS-H_/images/datasets/databricks/databricks-warehouse-connection.png?fit=max&auto=format&n=Ro4ZLj7W42QNS-H_&q=85&s=9c7f0a669fccea30b3810d62d18588d5" alt="Databricks Warehouse Connection" width="5096" height="1686" data-path="images/datasets/databricks/databricks-warehouse-connection.png" />
    * Get the Unity Catalog name. This is often the same as the workspace name
          <img src="https://mintcdn.com/refuelai/Ro4ZLj7W42QNS-H_/images/datasets/databricks/databricks-catalog.png?fit=max&auto=format&n=Ro4ZLj7W42QNS-H_&q=85&s=1462c44d9b5df01dd55e8d013d7b3e5c" alt="Databricks Catalog" width="5106" height="1726" data-path="images/datasets/databricks/databricks-catalog.png" />
  </Step>

  <Step title="Authentication">
    * Open your databricks workspace console
    * Click on your user profile icon in the top-right corner, and head to **settings**, then **developer**, then **manage** under **access tokens**
          <img src="https://mintcdn.com/refuelai/Ro4ZLj7W42QNS-H_/images/datasets/databricks/databricks-access-token.png?fit=max&auto=format&n=Ro4ZLj7W42QNS-H_&q=85&s=93290caf881a87af43e0dad2e3f2fb5a" alt="Databricks Access Token" width="5112" height="1688" data-path="images/datasets/databricks/databricks-access-token.png" />
    * Enter a token description and the token validity (leave blank for a permanent token)
          <img src="https://mintcdn.com/refuelai/Ro4ZLj7W42QNS-H_/images/datasets/databricks/databricks-token-generation.png?fit=max&auto=format&n=Ro4ZLj7W42QNS-H_&q=85&s=74a0c12162f57f311327df265f7c774e" alt="Databricks Token Generation" width="1008" height="562" data-path="images/datasets/databricks/databricks-token-generation.png" />
  </Step>

  <Step title="Setup Integration in Refuel">
    In order to setup the databricks integration, navigate to [Integrations](https://app.refuel.ai/settings/integrations) within Refuel Cloud Settings, select Databricks, and fill in the following fields:

    * Server Hostname
    * Http Path
    * Access Token (Generated in Step 2)
    * Unity Catalog Name
    * Output Schema (Where Refuel will create output tables)
          <img src="https://mintcdn.com/refuelai/Ro4ZLj7W42QNS-H_/images/datasets/databricks/databricks-integration.png?fit=max&auto=format&n=Ro4ZLj7W42QNS-H_&q=85&s=74f9c91d51290d85e0954a0f91abc309" alt="Databricks Integration" width="1346" height="994" data-path="images/datasets/databricks/databricks-integration.png" />
  </Step>
</Steps>