> ## Documentation Index
> Fetch the complete documentation index at: https://docs.hymalaia.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Databricks Connector

> Index Databricks Unity Catalog (or Hive) table metadata in Hymalaia

## How it works

The Databricks connector indexes **table metadata** for a given Unity Catalog (or Hive) **database** and **schema**: it reads column types from `information_schema` and builds a synthetic **DDL** document per table (including primary/foreign key metadata when available). It does **not** index row-level table data.

Tables whose metadata has changed (based on `last_altered` in `information_schema.tables`) are picked up on incremental runs. Like other connectors, indexing typically runs on a **daily** schedule.

## Setting up

### Authorization

Databricks uses a **SQL warehouse** connection over HTTP, with a **personal access token** (PAT). Create a credential with:

* **Server hostname** — the hostname from your warehouse’s JDBC/ODBC connection details (e.g. `adb-1234567890.4.azuredatabricks.net`), without `https://`
* **HTTP path** — the warehouse **HTTP Path** from the same connection dialog (starts with `/sql/1.0/warehouses/...`)
* **Access token** — a Databricks PAT for a user that can run metadata queries on the target catalog/database/schema

Create or rotate tokens under **User settings → Developer → Access tokens** in the Databricks workspace. The SQL warehouse must be running or auto-resume when the connector runs.

### Indexing

<Steps>
  <Step title="Open Databricks connector">
    In the Hymalaia Admin Panel, open the **Databricks** connector.
  </Step>

  <Step title="Configure authorization">
    In **Step 1**, set up credentials:

    * Select an existing Databricks credential, or click **Create New**
    * Enter **Server hostname**, **HTTP path**, and **Access token**
  </Step>

  <Step title="Save configuration">
    Click **Create** (or equivalent) to save the credential configuration.
  </Step>

  <Step title="Continue with selected credential">
    Ensure the correct credential is selected, then click **Continue**.
  </Step>

  <Step title="Specify database and schema">
    In **Step 2**, specify:

    * **Connector Name** — a display name for this connector (e.g. `Lakehouse prod`)
    * **Database** — the Databricks **catalog.database** name as used in SQL (the first level is often your catalog; use the value that matches `information_schema` for your environment)
    * **Schema** — the schema name within that database
    * **Access Type** — whether indexed content is **Public** or **Private** in Hymalaia
  </Step>

  <Step title="Create connector">
    Click **Create Connector** to start indexing.
  </Step>
</Steps>

The connector will index table DDL for the configured database and schema. Repeat for other databases/schemas if needed.

For connection details and tokens, see [Databricks SQL warehouses](https://docs.databricks.com/sql/admin/sql-endpoints.html) and [personal access tokens](https://docs.databricks.com/dev-tools/auth.html#personal-access-tokens-for-workspace-users).