Olostep MCP Server

Olostep MCP Server

Docker Hub npm version License: ISC

Live web search, scraping and crawling API for AI. Get structured, LLM-ready data from any site. Scale to 1M requests with 10 parallel batches at low cost.

Olostep is web data infrastructure for AI agents and enterprise AI workflows. Its APIs provide live web search, scraping and crawling to extract, clean and structure data from the web. This is the official Olostep Model Context Protocol (MCP) server, which gives any MCP-compatible AI agent those capabilities.

Use the hosted server at https://mcp.olostep.com/mcp (sign in with OAuth, or use an API key), or run it locally with an API key from the Olostep website.

Why Olostep

• Web data infrastructure for developers and enterprises
• Scales to hundreds of millions to billions of requests per customer per month
• The most performant, reliable and cost-effective API on the market
• Used by the fastest-growing AI companies

From extracting data from a handful of URLs to crawling hundreds of millions of pages, Olostep gives developers and AI companies reliable, scalable and highly cost-effective access to clean, structured web data.

Features

• Scrape website content in HTML, Markdown, JSON or Plain Text (with optional parsers)
• Parser-based web search with structured results
• AI Answers with citations and optional JSON-shaped outputs
• Batch scraping of up to 100k URLs
• Autonomous site crawling from a start URL
• Website URL discovery and mapping (with include/exclude filters)
• Country-specific request routing for geo-targeted content
• Configurable wait times for JavaScript-heavy websites
• Comprehensive error handling and reporting
• Simple API key configuration

Installation

There are multiple ways to connect to the Olostep MCP Server. Choose the one that best fits your workflow.

One-click install

Connect to the hosted server and sign in with your Olostep account (OAuth). No API key or local setup needed.

Or from the terminal:

# Claude Code

claude mcp add --transport http olostep https://mcp.olostep.com/mcp

Gemini CLI (prompts for your API key)

gemini extensions install https://github.com/olostep/olostep-mcp-server

For other clients, see Client Setup.

☁️ Remote Endpoint (Recommended)

The simplest way — no local installation required. Connect directly to our hosted MCP server:

https://mcp.olostep.com/mcp

Authentication is done via a Bearer token in the Authorization header using your Olostep API key. See the Client Setup section below for configuration examples.

🐳 Docker Hub

Pull and run the official Docker image:

docker pull olostep/mcp-server

docker run -i --rm \ -e OLOSTEP_API_KEY="your-api-key" \ olostep/mcp-server

🔧 Local Docker Build

If you prefer to build the image yourself from source:

git clone https://github.com/olostep/olostep-mcp-server.git

cd olostep-mcp-server npm install npm run build docker build -t olostep/mcp-server:local .

docker run -i --rm -e OLOSTEP_API_KEY="your-api-key" olostep/mcp-server:local

📦 npx

Run without any installation using npx:

env OLOSTEP_API_KEY=your-api-key npx -y olostep-mcp

On Windows (PowerShell):

$env:OLOSTEP_API_KEY = "your-api-key"; npx -y olostep-mcp

On Windows (CMD):

set OLOSTEP_API_KEY=your-api-key && npx -y olostep-mcp

Or install globally:

npm install -g olostep-mcp

Client Setup

Gemini CLI

Install the Olostep extension in Gemini CLI (requires an Olostep API key):

gemini extensions install https://github.com/olostep/olostep-mcp-server

Configure your API key through Gemini CLI's sensitive extension settings:

gemini extensions config olostep OLOSTEP_API_KEY

Gemini CLI stores this value in your system keychain. Restart Gemini CLI, then verify the extension and MCP server:

gemini extensions list

gemini mcp list

For authentication errors, configure the key again. For connection errors, restart Gemini CLI and run gemini mcp list. See the official Gemini CLI extensions documentation for details.

Cursor

The easiest way is to use the remote endpoint. Create or edit .cursor/mcp.json in your project root:

{

"mcpServers": { "olostep": { "url": "https://mcp.olostep.com/mcp", "headers": { "Authorization": "Bearer YOUR_API_KEY_HERE" } } } }

Alternative (local): Go to Cursor Settings > Features > MCP Servers, click "+ Add New MCP Server":

• Name: olostep
• Type: command
• Command: env OLOSTEP_API_KEY=your-api-key npx -y olostep-mcp

Claude Desktop

Add this to your claude_desktop_config.json:

{

"mcpServers": { "mcp-server-olostep": { "command": "npx", "args": ["-y", "olostep-mcp"], "env": { "OLOSTEP_API_KEY": "YOUR_API_KEY_HERE" } } } }

Alternative (Docker):

{

"mcpServers": { "olostep": { "command": "docker", "args": [ "run", "-i", "--rm", "-e", "OLOSTEP_API_KEY=YOUR_API_KEY_HERE", "olostep/mcp-server" ] } } }

Or install via the Smithery CLI in your device terminal:

npx -y @smithery/cli install @olostep/olostep-mcp-server --client claude

Claude Code

Add the remote endpoint to your Claude Code MCP configuration:

{

"mcpServers": { "olostep": { "url": "https://mcp.olostep.com/mcp", "headers": { "Authorization": "Bearer YOUR_API_KEY_HERE" } } } }

Alternative (local):

{

"mcpServers": { "olostep": { "command": "npx", "args": ["-y", "olostep-mcp"], "env": { "OLOSTEP_API_KEY": "YOUR_API_KEY_HERE" } } } }

Windsurf

Add this to your ./codeium/windsurf/model_config.json:

{

"mcpServers": { "olostep": { "serverUrl": "https://mcp.olostep.com/mcp", "headers": { "Authorization": "Bearer YOUR_API_KEY_HERE" } } } }

Alternative (local):

{

"mcpServers": { "mcp-server-olostep": { "command": "npx", "args": ["-y", "olostep-mcp"], "env": { "OLOSTEP_API_KEY": "YOUR_API_KEY_HERE" } } } }

Cline

Add this to your cline_mcp_settings.json (Cline → MCP Servers → Configure):

{

"mcpServers": { "olostep": { "command": "npx", "args": ["-y", "olostep-mcp"], "env": { "OLOSTEP_API_KEY": "YOUR_API_KEY_HERE" }, "disabled": false, "autoApprove": [] } } }

Cline can also set this up for you: ask it to install the MCP server from this repository, and it follows llms-install.md.

VS Code

Add this to your .vscode/mcp.json:

{

"servers": { "olostep": { "type": "http", "url": "https://mcp.olostep.com/mcp", "headers": { "Authorization": "Bearer YOUR_API_KEY_HERE" } } } }

Alternative (local):

{

"servers": { "olostep": { "type": "stdio", "command": "npx", "args": ["-y", "olostep-mcp"], "env": { "OLOSTEP_API_KEY": "YOUR_API_KEY_HERE" } } } }

GitHub Copilot CLI

Inside Copilot CLI, run /mcp add and enter:

• Name: olostep
• Type: HTTP
• URL: https://mcp.olostep.com/mcp
• Headers: leave empty

Save with Ctrl+S, then sign in with your Olostep account when prompted (OAuth). Check the connection with /mcp show olostep.

This writes the following to ~/.copilot/mcp-config.json:

{

"mcpServers": { "olostep": { "type": "http", "url": "https://mcp.olostep.com/mcp", "tools": ["*"] } } }

Zed

Add this to your Zed settings.json:

{

"context_servers": { "olostep": { "url": "https://mcp.olostep.com/mcp", "headers": { "Authorization": "Bearer YOUR_API_KEY_HERE" } } } }

Alternative (extension): the Olostep Zed extension runs the local server and asks for your API key in Zed's setup screen.

Metorial

Option 1: One-Click Installation (Recommended)

1. Open Metorial dashboard
2. Navigate to MCP Servers directory
3. Search for "Olostep"
4. Click "Install" and enter your API key

Option 2: Manual Configuration

Add this to your Metorial MCP server configuration:

{

"olostep": { "command": "npx", "args": ["-y", "olostep-mcp"], "env": { "OLOSTEP_API_KEY": "YOUR_API_KEY_HERE" } } }

The Olostep tools will then be available in your Metorial AI chats.

Configuration

Environment Variables

• OLOSTEP_API_KEY: Your Olostep API key (required)
• ORBIT_KEY: An optional key for using Orbit to route requests.

Available Tools

1. Scrape Website (scrape_website)

Use this when you have a URL and need what is on the page. Returns markdown (default), html or text with the page's url and title, after rendering JavaScript. Long pages are cut at max_characters (default 20,000) and link to their full text.

{

"name": "scrape_website", "arguments": { "url_to_scrape": "https://example.com", "output_format": "markdown", "country": "US", "wait_before_scraping": 1000, "parser": "@olostep/amazon-it-product" } }

Parameters:

• url_to_scrape: The URL of the website you want to scrape (required)
• output_format: Choose format (html, markdown, json, or text) - default: markdown
• country: Optional country code (e.g., US, GB, CA) for location-specific scraping
• wait_before_scraping: Wait time in milliseconds before scraping (0-10000)
• parser: Optional parser ID for specialized extraction
• max_characters: Max characters of page content to return (default: 20000). Raise it to read more of a long page.

Response (example):

The page's url and title come first. When the content is longer than max_characters, it is cut and truncated gives the full length and a full_text_url. JSON output is never cut: it is returned whole up to 100,000 characters. Above that, json_content is left out and json_content_omitted gives its size and a json_url to fetch the full JSON.

{

"url": "https://en.wikipedia.org/wiki/Web_scraping", "title": "Web scraping - Wikipedia", "markdown_content": "Web scraping - Wikipedia ...", "markdown_hosted_url": "https://ol