Databricks

Name: databricks
Rating: 87
Author: databricks

Core skill for Databricks CLI, authentication, and data exploration.

Product Skills

For specific products, use dedicated skills:

•databricks-apps - Full-stack TypeScript app development and deployment

Prerequisites

•
CLI installed: databricks --version
- •If not: see CLI Installation
•
Authenticated: databricks auth profiles
- •If not: see CLI Authentication

Profile Selection - CRITICAL

NEVER auto-select a profile.

•List profiles: databricks auth profiles
•Present ALL profiles to user with workspace URLs
•Let user choose (even if only one exists)
•Offer to create new profile if needed

Claude Code - IMPORTANT

Each Bash command runs in a separate shell session.

bash

# WORKS: --profile flag
databricks apps list --profile my-workspace

# WORKS: chained with &&
export DATABRICKS_CONFIG_PROFILE=my-workspace && databricks apps list

# DOES NOT WORK: separate commands
export DATABRICKS_CONFIG_PROFILE=my-workspace
databricks apps list  # profile not set!

Data Exploration — Use AI Tools

Use these instead of manually navigating catalogs/schemas/tables:

bash

# discover table structure (columns, types, sample data, stats)
databricks experimental aitools tools discover-schema catalog.schema.table --profile <profile>

# run ad-hoc SQL queries
databricks experimental aitools tools query "SELECT * FROM table LIMIT 10" --profile <profile>

# find the default warehouse
databricks experimental aitools tools get-default-warehouse --profile <profile>

See Data Exploration for details.

Quick Reference

⚠️ CRITICAL: Some commands use positional arguments, not flags

bash

# current user
databricks current-user me --profile <profile>

# list resources
databricks apps list --profile <profile>
databricks jobs list --profile <profile>
databricks clusters list --profile <profile>
databricks warehouses list --profile <profile>
databricks pipelines list --profile <profile>
databricks serving-endpoints list --profile <profile>

# ⚠️ Unity Catalog — POSITIONAL arguments (NOT flags!)
databricks catalogs list --profile <profile>

# ✅ CORRECT: positional args
databricks schemas list <catalog> --profile <profile>
databricks tables list <catalog> <schema> --profile <profile>
databricks tables get <catalog>.<schema>.<table> --profile <profile>

# ❌ WRONG: these flags/commands DON'T EXIST
# databricks schemas list --catalog-name <catalog>    ← WILL FAIL
# databricks tables list --catalog <catalog>           ← WILL FAIL
# databricks sql-warehouses list                       ← doesn't exist, use `warehouses list`
# databricks execute-statement                         ← doesn't exist, use `experimental aitools tools query`
# databricks sql execute                               ← doesn't exist, use `experimental aitools tools query`

# When in doubt, check help:
# databricks schemas list --help

# get details
databricks apps get <name> --profile <profile>
databricks jobs get --job-id <id> --profile <profile>
databricks clusters get --cluster-id <id> --profile <profile>

# bundles
databricks bundle init --profile <profile>
databricks bundle validate --profile <profile>
databricks bundle deploy -t <target> --profile <profile>
databricks bundle run <resource> -t <target> --profile <profile>

Troubleshooting

Error	Solution
`cannot configure default credentials`	Use `--profile` flag or authenticate first
`PERMISSION_DENIED`	Check workspace/UC permissions
`RESOURCE_DOES_NOT_EXIST`	Verify resource name/id and profile

Required Reading by Task

Task	READ BEFORE proceeding
First time setup	CLI Installation
Auth issues / new workspace	CLI Authentication
Exploring tables/schemas	Data Exploration
UC permissions/volumes	Unity Catalog
Deploying jobs/pipelines	Asset Bundles

Databricks

Product Skills

Prerequisites

Profile Selection - CRITICAL

Claude Code - IMPORTANT

Data Exploration — Use AI Tools

Quick Reference

Troubleshooting

Required Reading by Task

Reference Guides