Command Palette

Search for a command to run...

UnylyUnyly
Browse all

Fetch Ya

FreeNot checked

Fetches web content and converts HTML to markdown with robots.txt compliance and proxy support.

GitHubEmbed

About

Fetches web content and converts HTML to markdown with robots.txt compliance and proxy support.

README

A Model Context Protocol (MCP) server for fetching web content and converting HTML to markdown.

Features

  • HTML to Markdown - Automatically extracts main content using Readability and converts to clean markdown
  • robots.txt Compliance - Respects robots.txt by default (configurable)
  • Custom User-Agent - Configurable User-Agent string
  • Proxy Support - Optional HTTP/HTTPS proxy configuration

Installation

npm install -g mcp-fetch-ya@latest

Or use directly with npx:

npx mcp-fetch-ya@latest

Usage with Claude Desktop

Add to your Claude Desktop configuration (~/Library/Application Support/Claude/claude_desktop_config.json on macOS):

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": ["mcp-fetch-ya@latest"]
    }
  }
}

With options

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": [
        "mcp-fetch-ya@latest",
        "--ignore-robots-txt",
        "--user-agent", "MyBot/1.0"
      ]
    }
  }
}

With proxy

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": [
        "mcp-fetch-ya@latest",
        "--proxy-url", "http://proxy.example.com:8080"
      ]
    }
  }
}

Tool: fetch_ya

If the built-in web fetch tool fails, you can retry with this MCP tool as a fallback. Fetches a URL and returns the content. HTML pages are converted to markdown for easier reading.

Parameters

Parameter Type Required Default Description
url string Yes - The URL to fetch
raw boolean No false Return raw content without markdown conversion

CLI Options

Option Description
--user-agent <agent> Custom User-Agent string
--proxy-url <url> Proxy URL for requests
--ignore-robots-txt Ignore robots.txt restrictions

License

MIT

from github.com/xiaocang/mcp-fetch-ya

Install Fetch Ya in Claude Desktop, Claude Code & Cursor

Recommended · one command, every IDE
unyly install mcp-fetch-ya

Installs into Claude Desktop, Claude Code, Cursor & VS Code — handles npx, uvx and build-from-source repos for you.

First time? Get the CLI: curl -fsSL https://unyly.org/install | sh

Or configure manually

Run in your terminal:

claude mcp add mcp-fetch-ya -- npx -y @xiaocangpt/mcp-fetch-ya

FAQ

Is Fetch Ya MCP free?

Yes, Fetch Ya MCP is free — one-click install via Unyly at no cost.

Does Fetch Ya need an API key?

No, Fetch Ya runs without API keys or environment variables.

Is Fetch Ya hosted or self-hosted?

A hosted option is available: Unyly runs the server in the cloud, no local setup required.

How do I install Fetch Ya in Claude Desktop, Claude Code or Cursor?

Open Fetch Ya on unyly.org, pick your client tab (Claude Desktop, Claude Code, Cursor) and press Install — the config is generated automatically, no JSON editing.

Related MCPs

Compare Fetch Ya with

Not sure what to pick?

Find your stack in 60 seconds

Author?

Embed badge for your README

Browse similar

All development MCPs