Prototype · Preview: every server in the official registry, synced every 30 minutes. Sign in with Google to write reviews.Prototype · updated every 30 min
PopNx MCPMCP servers for people who use AI · explained in plain words

Spark SQL

by aidancorrellversion 0.1.2i★ 1iRuns on your computer
Registry nameio.github.aidancorrell/spark-sql-mcp-server

How to install

What it does

Query Spark SQL clusters via Thrift/HiveServer2. Works with Spark, EMR, Hive, Impala.

  • Connects Runs on your computer
  • Account or key Needs SPARK_AUTH, SPARK_PASSWORD · 1 setting to fill in (SPARK_HOST)
  • Category Databases & datasets

Install

Pick the AI app you use, then copy the settings.

Passed 2/3 checks · Runs on your computer · ✓ Commands checked Nov 14, 2026

First: which AI do you use?

Pick your app and the steps appear below.

Works with Claude, with some setup first

You need a Spark SQL key (create it on the maker’s site) · 1 setting(s) to fill in (SPARK_HOST) · Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone

Let AI install it

Copy this message into a Claude chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Spark SQL for Claude on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "spark-sql": { "command": "uvx", "args": [ "spark-sql-mcp-server" ], "env": { "SPARK_HOST": "your-value", "SPARK_AUTH": "your-value", "SPARK_PASSWORD": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For SPARK_AUTH, SPARK_PASSWORD, SPARK_HOST, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Spark SQL tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Sign up and create a Spark SQL key

    Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.

    How to get a key is in the maker’s README below

  3. Fill in 1 setting(s)

    These are program settings, not keys. No sign-up needed; fill them in as the maker describes.

    • SPARK_HOST Hostname of the Spark Thrift Server

    Descriptions are as written by the maker.

  4. Open the Claude desktop app’s settings file

    SettingsDeveloperEdit Config

  5. Paste these settings and save the file

    {
      "mcpServers": {
        "spark-sql": {
          "command": "uvx",
          "args": [
            "spark-sql-mcp-server"
          ],
          "env": {
            "SPARK_HOST": "your-value",
            "SPARK_AUTH": "your-value",
            "SPARK_PASSWORD": "your-value"
          }
        }
      }
    }

    Paste the key only into the app’s field, never into a chat or to anyone

  6. Quit Claude and open it again

  7. Try it

    Use Spark SQL and tell me what you can do for me, then show me one thing

    ✓ If Claude says it is using Spark SQL or shows a Spark SQL tool in the answer, you are connected

4 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • SPARK_PORT Port of the Spark Thrift Server (default: 10000)
  • SPARK_DATABASE Default database to use
  • SPARK_USERNAME Username for LDAP authentication
  • SPARK_KERBEROS_SERVICE_NAME Kerberos service name (default: hive)

Descriptions are as written by the maker.

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

ChatGPT cannot connect Spark SQL yet

Spark SQL runs on your computer, but ChatGPT can only connect servers that run on the web

What you can do instead

A · Use an app that can connect Spark SQL

  • You need a Spark SQL key (create it on the maker’s site) · 1 setting(s) to fill in (SPARK_HOST) · Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
  • You need a Spark SQL key (create it on the maker’s site) · 1 setting(s) to fill in (SPARK_HOST) · Install Python (uv) on your computer first (one time)
  • You need a Spark SQL key (create it on the maker’s site) · 1 setting(s) to fill in (SPARK_HOST) · Install Python (uv) on your computer first (one time)
  • You need a Spark SQL key (create it on the maker’s site) · 1 setting(s) to fill in (SPARK_HOST) · Install Python (uv) on your computer first (one time)

B · Others in Databases & datasets that work with ChatGPT

Picked from the most used in the same category, only ones that connect by address with no key

Works with Claude Code, with some setup first

You need a Spark SQL key (create it on the maker’s site) · 1 setting(s) to fill in (SPARK_HOST) · Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a Claude Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Spark SQL for Claude Code on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): claude mcp add --scope user spark-sql --env SPARK_HOST=your-value --env SPARK_AUTH=your-value --env SPARK_PASSWORD=your-value -- uvx spark-sql-mcp-server 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For SPARK_AUTH, SPARK_PASSWORD, SPARK_HOST, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Spark SQL tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Sign up and create a Spark SQL key

    Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.

    How to get a key is in the maker’s README below

  3. Fill in 1 setting(s)

    These are program settings, not keys. No sign-up needed; fill them in as the maker describes.

    • SPARK_HOST Hostname of the Spark Thrift Server

    Descriptions are as written by the maker.

  4. Open Terminal

    Mac: press Command+Space and type Terminal · Windows: open PowerShell

  5. Paste this command and press Enter

    claude mcp add --scope user spark-sql --env SPARK_HOST=your-value --env SPARK_AUTH=your-value --env SPARK_PASSWORD=your-value -- uvx spark-sql-mcp-server

    Replace “your-value” with your key before pressing Enter

    Paste the key only into the app’s field, never into a chat or to anyone

  6. Type /mcp in Claude Code

    You should see Spark SQL listed as connected

  7. Try it

    Use Spark SQL and tell me what you can do for me, then show me one thing

    ✓ If Claude Code says it is using Spark SQL or shows a Spark SQL tool in the answer, you are connected

4 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • SPARK_PORT Port of the Spark Thrift Server (default: 10000)
  • SPARK_DATABASE Default database to use
  • SPARK_USERNAME Username for LDAP authentication
  • SPARK_KERBEROS_SERVICE_NAME Kerberos service name (default: hive)

Descriptions are as written by the maker.

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor, with some setup first

You need a Spark SQL key (create it on the maker’s site) · 1 setting(s) to fill in (SPARK_HOST) · Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a Cursor chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Spark SQL for Cursor on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "spark-sql": { "command": "uvx", "args": [ "spark-sql-mcp-server" ], "env": { "SPARK_HOST": "your-value", "SPARK_AUTH": "your-value", "SPARK_PASSWORD": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For SPARK_AUTH, SPARK_PASSWORD, SPARK_HOST, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Spark SQL tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Sign up and create a Spark SQL key

    Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.

    How to get a key is in the maker’s README below

  3. Fill in 1 setting(s)

    These are program settings, not keys. No sign-up needed; fill them in as the maker describes.

    • SPARK_HOST Hostname of the Spark Thrift Server

    Descriptions are as written by the maker.

  4. Click this button to open Cursor

    Open in Cursor

    Cursor asks you to confirm; click Install

  5. Fill in your key

    In the Spark SQL settings, SPARK_AUTH, SPARK_PASSWORD, SPARK_HOST is empty; add your key and save

    Paste the key only into the app’s field, never into a chat or to anyone

  6. Open the AI chat in Cursor in Agent mode

  7. Try it

    Use Spark SQL and tell me what you can do for me, then show me one thing

    ✓ If Cursor says it is using Spark SQL or shows a Spark SQL tool in the answer, you are connected

4 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • SPARK_PORT Port of the Spark Thrift Server (default: 10000)
  • SPARK_DATABASE Default database to use
  • SPARK_USERNAME Username for LDAP authentication
  • SPARK_KERBEROS_SERVICE_NAME Kerberos service name (default: hive)

Descriptions are as written by the maker.

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code, with some setup first

You need a Spark SQL key (create it on the maker’s site) · 1 setting(s) to fill in (SPARK_HOST) · Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a VS Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Spark SQL for VS Code on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "servers": { "spark-sql": { "type": "stdio", "command": "uvx", "args": [ "spark-sql-mcp-server" ], "env": { "SPARK_HOST": "your-value", "SPARK_AUTH": "your-value", "SPARK_PASSWORD": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For SPARK_AUTH, SPARK_PASSWORD, SPARK_HOST, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Spark SQL tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Sign up and create a Spark SQL key

    Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.

    How to get a key is in the maker’s README below

  3. Fill in 1 setting(s)

    These are program settings, not keys. No sign-up needed; fill them in as the maker describes.

    • SPARK_HOST Hostname of the Spark Thrift Server

    Descriptions are as written by the maker.

  4. Click this button to open VS Code

    Open in VS Code

    VS Code asks you to confirm; click Install

  5. Fill in your key

    In the Spark SQL settings, SPARK_AUTH, SPARK_PASSWORD, SPARK_HOST is empty; add your key and save

    Paste the key only into the app’s field, never into a chat or to anyone

  6. Open the AI chat in VS Code in Agent mode

  7. Try it

    Use Spark SQL and tell me what you can do for me, then show me one thing

    ✓ If VS Code says it is using Spark SQL or shows a Spark SQL tool in the answer, you are connected

4 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • SPARK_PORT Port of the Spark Thrift Server (default: 10000)
  • SPARK_DATABASE Default database to use
  • SPARK_USERNAME Username for LDAP authentication
  • SPARK_KERBEROS_SERVICE_NAME Kerberos service name (default: hive)

Descriptions are as written by the maker.

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

JSON settings are under “For developers” below

Stuck? Ask people who use Spark SQL💬 Discussion →
For developers: Terminal commands and JSON settings

Installed on your computer

Claude Code

claude mcp add --scope user spark-sql --env SPARK_HOST=your-value --env SPARK_AUTH=your-value --env SPARK_PASSWORD=your-value -- uvx spark-sql-mcp-server

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "spark-sql": {
      "command": "uvx",
      "args": [
        "spark-sql-mcp-server"
      ],
      "env": {
        "SPARK_HOST": "your-value",
        "SPARK_AUTH": "your-value",
        "SPARK_PASSWORD": "your-value"
      }
    }
  }
}

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "spark-sql": {
      "command": "uvx",
      "args": [
        "spark-sql-mcp-server"
      ],
      "env": {
        "SPARK_HOST": "your-value",
        "SPARK_AUTH": "your-value",
        "SPARK_PASSWORD": "your-value"
      }
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "spark-sql": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "spark-sql-mcp-server"
      ],
      "env": {
        "SPARK_HOST": "your-value",
        "SPARK_AUTH": "your-value",
        "SPARK_PASSWORD": "your-value"
      }
    }
  }
}

Values you fill in

  • SPARK_HOST required env
    Hostname of the Spark Thrift Server
  • SPARK_PORT env
    Port of the Spark Thrift Server (default: 10000)
  • SPARK_DATABASE env
    Default database to use
  • SPARK_AUTH secret required env
    Authentication method: NONE, LDAP, KERBEROS, CUSTOM, or NOSASL
  • SPARK_USERNAME env
    Username for LDAP authentication
  • SPARK_PASSWORD secret required env
    Password for LDAP authentication
  • SPARK_KERBEROS_SERVICE_NAME env
    Kerberos service name (default: hive)

Descriptions are as written by the maker.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

Downloads per weeki
22/wk
Connection
Runs on your computer
Latest versioni
0.1.2
Published to registryi
Feb 9, 2026
Code last changedi
Mar 26, 2026
Maker
aidancorrell
Packages
pypi: spark-sql-mcp-server
Registry status
Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Run on your computer in

ClaudeGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatRaycast

All apps, with pros and cons →

Related guides

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 15, 2026

  • ✓ Pass

    Maker matches the repo

    The registry name was verified with the GitHub account aidancorrell, which owns the repo

  • ! Caution

    Still maintained

    Code last changed 8 months ago, more than 6 months ago

  • ✓ Pass

    Has a licence

    Uses MIT

  • – Not applicable

    Endpoint responds

    This one runs on your computer; there is no internet endpoint

  • – Not applicable

    Sign-in with OAuth

    Runs on your computer and uses local settings instead

  • … Not checked yet

    No hidden instructions in tool descriptions

    Runs on your computer; we can only read tool lists from internet endpoints

Published vulnerabilities (OSV.dev)

Not checked yet

What we check → · JSON

Makers: ask for a re-check or report wrong info

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

Sign in to post

User reviews

No reviews yet

Sign in to write a review

Compared with others in Databases & datasetsi

  • More stars than 79% of the other 1197 servers in this category
  • Published to the registry more recently than 3% of the other 1197 servers in this category
  • Basic checks equal to or better than 51% of the other 1197 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Spark SQL safe?

It passed 2 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

You need to fill in: SPARK_AUTH, SPARK_PASSWORD

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed 8 months ago, and the latest version (0.1.2) reached the registry 9 months ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Python (uv) on your computer.

What can I use instead?

In the same category: QueryWeaver, Supabase, Neon, DBCode, Keboola MCP

Similar alternatives

Same category, other makers, commands already checked. Official ones first, then by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

QueryWeaver

An MCP server for Text2SQL: transforms natural language into SQL using graph schema understanding.

by FalkorDBGrowing★ 1.1KUpdated 14 months ago

Runs on your computer✓ falkordb.com

Supabase

Supabase’s official server lets AI create tables, query data and review project settings in your Supabase database.

by supabaseWidely used↓ 245.5K/wk★ 3K Stars for the whole repoUpdated 2 days ago

Computer or cloud✓ service owner · supabase.com

Neon

Official Neon MCP server for managing Neon projects and Lakebase Postgres databases.

by neondatabaseGrowing★ 663Updated 9 days ago

Runs in the cloud✓ service owner · neon.com

DBCode

Query and explore 100+ databases through your DBCode connections.

by dbcodeioEarly↓ 80/wk★ 366 Stars for the whole repoUpdated 43 days ago

Runs on your computer✓ service owner · dbcode.io

Keboola MCP

Connect your AI assistants to Keboola and expose your data, transformations, SQL queries, ...

by keboolaGrowing↓ 1.4K/wk★ 85Updated 4 days ago

Computer or cloud✓ service owner · keboola.com
  • QueryWeaver — Installs on your computer · No key needed
  • Supabase — Cloud or install on your computer · Needs a key · In Claude’s directory
  • Neon — Runs in the cloud, nothing to install · No key needed
  • DBCode — Installs on your computer · No key needed
  • Keboola MCP — Cloud or install on your computer · No key needed

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

Spark SQL MCP Server

An MCP server that enables AI assistants to query Spark SQL clusters via the Thrift/HiveServer2 protocol.

Works with any HiveServer2-compatible system: Apache Spark, AWS EMR, Hive, Impala, Presto.

Features

  • Query Spark SQL — Execute read-only SQL queries against your Spark cluster
  • Schema Discovery — List databases, tables, and describe table structures
  • Multiple Auth Methods — NONE, LDAP, NOSASL, CUSTOM, and Kerberos authentication
  • EMR Compatible — Works with AWS EMR clusters out of the box
  • Read-Only Enforcement — Only SELECT, SHOW, DESCRIBE, EXPLAIN, and WITH statements are allowed
  • Safety Defaults — Automatic LIMIT clause on unbounded queries, sanitized error messages

Installation

pip install spark-sql-mcp-server

Or run directly with uvx:

uvx spark-sql-mcp-server

Quick Start

1. Set Environment Variables
export SPARK_HOST="your-emr-master-node.amazonaws.com"

export SPARK_PORT="10000" # default export SPARK_DATABASE="default" # default export SPARK_AUTH="NONE" # NONE | LDAP | KERBEROS | CUSTOM | NOSASL

2. Add to Claude Code

Global (all projects) — add to ~/.claude.json under your project's mcpServers:

{

"mcpServers": { "spark-sql": { "command": "uvx", "args": ["spark-sql-mcp-server"], "env": { "SPARK_HOST": "your-emr-master-node.amazonaws.com", "SPARK_PORT": "10000", "SPARK_AUTH": "NONE" } } } }

Project-level — add to .claude/mcp.json in your repo:

{

"mcpServers": { "spark-sql": { "command": "uvx", "args": ["spark-sql-mcp-server"], "env": { "SPARK_HOST": "your-emr-master-node.amazonaws.com", "SPARK_PORT": "10000", "SPARK_AUTH": "NONE" } } } }

3. Add to Claude Desktop

Add to your claude_desktop_config.json:

{

"mcpServers": { "spark-sql": { "command": "uvx", "args": ["spark-sql-mcp-server"], "env": { "SPARK_HOST": "your-emr-master-node.amazonaws.com", "SPARK_PORT": "10000" } } } }

4. Query

Ask Claude things like:

  • "What databases are available in our Spark cluster?"
  • "Show me the schema of the sales.transactions table"
  • "Query the top 10 customers by revenue from the analytics database"

Available Tools

ToolDescription
list_databasesList all available databases
list_tablesList tables in a database
describe_tableGet table schema (columns, types)
execute_queryRun read-only SQL queries with formatted results

Authentication

No Auth (default)
export SPARK_AUTH="NONE"
LDAP
export SPARK_AUTH="LDAP"

export SPARK_USERNAME="your-username" export SPARK_PASSWORD="your-password"

Kerberos
export SPARK_AUTH="KERBEROS"

export SPARK_KERBEROS_SERVICE_NAME="hive" # default

Ensure you have a valid Kerberos ticket (kinit)

AWS EMR Setup

  1. Security Group — Allow inbound traffic on port 10000 from your IP
  2. SSH Tunnel (recommended):
   ssh -i your-key.pem -L 10000:localhost:10000 hadoop@your-emr-master
  1. Set SPARK_HOST=localhost

Development

git clone https://github.com/aidancorrell/spark-sql-mcp-server.git

cd spark-sql-mcp-server pip install -e ".[dev]" pytest ruff check .

Local Testing with Docker

A Docker Compose setup provides a local Spark Thrift Server with sample data for integration testing.

# Start the Spark Thrift Server

cd docker && docker compose up -d

Wait for it to be ready (takes ~30s on first start)

docker logs -f spark-thrift-server # look for "Sample data loaded."

Run integration tests

pytest -m integration -v

Tear down

cd docker && docker compose down -v

The local server comes with sample tables: default.employees, default.orders, and test_db.metrics.

Unit tests run by default with pytest (integration tests are skipped unless -m integration is specified).

Using the local server with Claude Code

With the Docker Spark server running, add it to your MCP config to test the server interactively.

Global — add to ~/.claude.json under your project's mcpServers:

{

"spark-sql": { "command": "uvx", "args": ["spark-sql-mcp-server"], "env": { "SPARK_HOST": "localhost", "SPARK_PORT": "10000", "SPARK_AUTH": "NONE" } } }

Project-level — add to .claude/mcp.json:

{

"mcpServers": { "spark-sql": { "command": "uvx", "args": ["spark-sql-mcp-server"], "env": { "SPARK_HOST": "localhost", "SPARK_PORT": "10000", "SPARK_AUTH": "NONE" } } } }

Then start a new Claude Code session and ask it to query the sample data.

Security

Read-Only Enforcement

The execute_query tool only allows read-only SQL statements. Queries must start with one of: SELECT, SHOW, DESCRIBE, DESC, EXPLAIN, or WITH. All other statement types (DROP, INSERT, DELETE, CREATE, ALTER, SET, ADD JAR, etc.) are rejected before reaching the Spark cluster.

Error Sanitization

Database errors are sanitized before being returned to the MCP client. Internal details such as server hostnames, file paths, and stack traces are not exposed. Connection failures report only the target host/port and error type.

Credential Handling
  • Passwords are never included in log output or error messages
  • The SparkConfig object masks passwords in its string representation
  • SPARK_PASSWORD is marked as a secret in the MCP registry schema
Known Limitations
  • No TLS/SSL support — Thrift connections are unencrypted. For production use with LDAP auth, use an SSH tunnel to protect credentials in transit.
  • No query timeout — Long-running queries are not automatically cancelled. Rely on Spark cluster-level timeout configuration.
  • No per-user access control — All queries execute with the privileges of the configured Spark user. Use HiveServer2 authorization (Ranger, Sentry) to restrict access at the database level.
  • Auth mode defaults to NONE — Appropriate for local development but not for production. Set SPARK_AUTH to LDAP or KERBEROS for authenticated environments.

License

MIT