Command Palette

Search for a command to run...

UnylyUnyly

Robotstxt Ai vs mkinf

Side-by-side comparison of two Model Context Protocol servers. Pick the right one for Claude Desktop, Claude Code, or Cursor.

Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Ext

Details

An Open Source registry of hosted MCP Servers to accelerate AI agent workflows.

Details

Comparison

FeatureRobotstxt Aimkinf
PricingFreeFree
Installs
Rating
Verified
HostedHosted
Tools
Categoryaiai
AuthorsharozdawaCommunity
Reposharozdawa/robotstxt-ai

When to pick Robotstxt Ai

Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.

When to pick mkinf

An Open Source registry of hosted MCP Servers to accelerate AI agent workflows.

Looking for something else? Browse all MCPs or check trending this week.