Web Crawler
FreeNot checkedA minimal MCP server that crawls web pages using crawl4ai and returns content as markdown, deployable to Cloud Run.
About
A minimal MCP server that crawls web pages using crawl4ai and returns content as markdown, deployable to Cloud Run.
Installing Web Crawler
This server has no published package — it is built from source. Open the repository and follow its README.
▸ github.com/SMB-Team-Technology/web-crawler-mcpFAQ
Is Web Crawler MCP free?
Yes, Web Crawler MCP is free — one-click install via Unyly at no cost.
Does Web Crawler need an API key?
No, Web Crawler runs without API keys or environment variables.
Is Web Crawler hosted or self-hosted?
Self-hosted: the server runs locally on your machine via the install command above.
How do I install Web Crawler in Claude Desktop, Claude Code or Cursor?
Open Web Crawler on unyly.org, pick your client tab (Claude Desktop, Claude Code, Cursor) and press Install — the config is generated automatically, no JSON editing.
Related MCPs
GitHub
PRs, issues, code search, CI status
by GitHubFilesystem
Secure file operations with configurable access controls.
Memory
Knowledge graph-based persistent memory system.
Template MCP Server
A CLI tool to create a new Model Context Protocol server project with TypeScript support, dual transport options, and an extensible structure
by mcpdotdirectCompare Web Crawler with
Not sure what to pick?
Find your stack in 60 seconds
Author?
Embed badge for your README
Browse similar
All development MCPs