loading…
Search for a command to run...
loading…
Side-by-side comparison of two Model Context Protocol servers. Pick the right one for Claude Desktop, Claude Code, or Cursor.
Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Ext
A very streamlined mcp client that supports calling and monitoring stdio/sse/streamableHttp, and can also view request responses through the /logs page. It also
| Feature | Robotstxt Ai | llm-analysis-assistant |
|---|---|---|
| Pricing | Free | Free |
| Installs | — | — |
| Rating | — | — |
| Verified | — | |
| Hosted | Hosted | — |
| Tools | — | — |
| Category | ai | ai |
| Author | sharozdawa | xuzexin-hz |
| Repo | sharozdawa/robotstxt-ai | xuzexin-hz/llm-analysis-assistant |
Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.
A very streamlined mcp client that supports calling and monitoring stdio/sse/streamableHttp, and can also view request responses through the /logs page. It also supports monitoring and simulation of ollama/openai interface.
Looking for something else? Browse all MCPs or check trending this week.