Cloudscraper
БесплатноНе проверенEnables AI agents to bypass Cloudflare protection and scrape web content, returning clean Markdown with smart chunking and file export.
Описание
Enables AI agents to bypass Cloudflare protection and scrape web content, returning clean Markdown with smart chunking and file export.
README
CloudScraper MCP Server
A Model Context Protocol server that enables AI agents to bypass Cloudflare protection and scrape web content
Quick Start
Clone the repository and install dependencies:
git clone https://github.com/yourusername/cloudscraper-mcp-server.git
cd cloudscraper-mcp-server
uv sync
Add to Claude Code:
claude mcp add cloudscraper-mcp \
--type stdio \
--command "uv" \
--args "run" "server.py" \
--directory "/path/to/cloudscraper-mcp-server"
Add to VSCode / any MCP-compatible IDE:
{
"mcpServers": {
"cloudscraper-mcp": {
"type": "stdio",
"command": "uv",
"args": ["run", "server.py"],
"cwd": "/path/to/cloudscraper-mcp-server"
}
}
}
Features
- Cloudflare Bypass — Automatically handles Cloudflare protection so AI agents can reach pages that block standard requests
- Content Cleaning — Converts HTML to clean, LLM-friendly Markdown
- Smart Chunking — Automatically splits large responses into 10k-token chunks with continuation tokens
- Binary Handling — Base64-encodes non-text content so agents can handle images and downloads
- File Export — Save scraped content directly to disk via
scrape_url_to_file - Docker Support — Containerized deployment via DOCKER.md
Three tools are available: scrape_url (returns content as a string), scrape_url_raw (returns content plus response metadata), and scrape_url_to_file (saves content to disk).
Configuration
Transport Protocols
| Transport | Best For | Configuration |
|---|---|---|
| stdio | Claude Code, VSCode, Direct AI integration | Default mode, no environment variables needed |
| http | n8n, Web apps, API integrations, Remote access | Requires MCP_TRANSPORT=http |
Run with HTTP transport:
MCP_TRANSPORT=http MCP_HOST=0.0.0.0 MCP_PORT=8000 uv run server.py
Environment Variables
| Variable | Default | Options | Description |
|---|---|---|---|
MCP_TRANSPORT |
stdio | stdio, http | Transport protocol selection |
MCP_HOST |
0.0.0.0 | Any valid IP | Host binding for HTTP mode |
MCP_PORT |
8000 | Any valid port | Port for HTTP mode |
Установка Cloudscraper
У этого сервера нет опубликованного пакета — он собирается из исходников. Открой репозиторий и следуй инструкции в README.
▸ github.com/LLMTooling/cloudscraper-mcp-serverFAQ
Cloudscraper MCP бесплатный?
Да, Cloudscraper MCP бесплатный — установка в пару кликов через Unyly без оплаты.
Нужен ли API-ключ для Cloudscraper?
Нет, Cloudscraper работает без API-ключей и переменных окружения.
Cloudscraper — hosted или self-hosted?
Self-hosted: сервер запускается локально на твоей машине командой из раздела установки.
Как установить Cloudscraper в Claude Desktop, Claude Code или Cursor?
Открой Cloudscraper на unyly.org, выбери вкладку своего клиента (Claude Desktop, Claude Code, Cursor) и нажми Install — конфиг сгенерируется автоматически, без правки JSON.
Похожие MCP
Playwright
Browser automation, scraping, screenshots
автор: MicrosoftPuppeteer
Browser automation and web scraping.
автор: modelcontextprotocolopentabs-dev/opentabs
Plugin-based MCP server + Chrome extension that gives AI agents access to web applications through the user's authenticated browser session. 100+ plugins with a
автор: opentabs-devrobhunter/agentdeals
1,500+ developer infrastructure deals, free tiers, and startup programs across 54 categories. Search deals, compare vendors, plan stacks, and track pricing chan
автор: robhunterCompare Cloudscraper with
Не уверен что выбрать?
Найди свой стек за 60 секунд
Автор?
Embed-бейдж для README
Похожее
Все в категории browse
