Rapid URL Indexer Server

An MCP (Model Context Protocol) server for submitting URLs to the Rapid URL Indexer API. Track submissions across multiple projects, monitor indexing progress, and auto-detect new pages from sitemaps.

Target: 50,000 pages/year across 10+ apps

Features

• Submit individual URLs or entire sitemaps for Google indexing
• Track all submissions across multiple projects/apps
• Automatic deduplication of already-submitted URLs
• Monitor indexing progress and credit usage
• View statistics and projections toward goals

Installation

# Clone the repository
git clone https://github.com/jphyqr/rapid-indexer-mcp.git
cd rapid-indexer-mcp

# Install dependencies
npm install

# Build
npm run build

Configuration

API Key

Set your Rapid URL Indexer API key via environment variable:

export RAPID_INDEXER_API_KEY=your-api-key

Or create a config file at ~/.rapid-indexer/config.json:

{
  "apiKey": "your-api-key",
  "defaultApexMode": false,
  "defaultNotify": false,
  "apps": {}
}

Claude Code MCP Config

Add to your Claude Code MCP configuration (~/.claude/mcp.json or VS Code settings):

{
  "mcpServers": {
    "rapid-indexer": {
      "command": "node",
      "args": ["/path/to/rapid-indexer-mcp/dist/index.js"],
      "env": {
        "RAPID_INDEXER_API_KEY": "your-api-key"
      }
    }
  }
}

Tools

submit_urls

Submit URLs for indexing.

Submit these URLs to the indexer for vancouversublets:
https://vancouversublets.com/listing/123
https://vancouversublets.com/listing/456

Parameters:

Name	Type	Required	Description
urls	string[]	Yes	Array of URLs to index
app_name	string	Yes	Project/app identifier
project_name	string	No	Optional batch name
apex_mode	boolean	No	3 credits/URL, faster indexing
notify	boolean	No	Email notifications

submit_sitemap

Parse and submit URLs from a sitemap.xml file.

Submit new pages from vancouversublets.com sitemap, only listing pages

Parameters:

Name	Type	Required	Description
sitemap_url	string	Yes	URL to sitemap.xml
app_name	string	Yes	Project/app identifier
filter_pattern	string	No	Regex to include URLs
exclude_pattern	string	No	Regex to exclude URLs
skip_already_submitted	boolean	No	Skip duplicates (default: true)
limit	number	No	Max URLs to submit
apex_mode	boolean	No	Enable Apex Mode

check_balance

Get current credit balance.

What's my indexing credit balance?

list_projects

List all indexing projects.

Show me all my indexing projects for vancouversublets

get_project_status

Get detailed status for a project.

What's the status of project 123?

get_report

Download indexing report showing which URLs were indexed.

Get the indexing report for project 123

get_history

Get local submission history.

Show my indexing history for the last 7 days

get_stats

Get statistics and usage tracking.

How's my indexing going this month?

Resources

The server exposes two MCP resources:

• indexer://history - Full submission history
• indexer://apps - List of tracked apps with summary stats

Local Storage

Data is stored in ~/.rapid-indexer/:

• history.json - All submissions, app tracking, monthly usage
• config.json - API key and app configurations

Example Workflows

Daily New Page Indexing

User: "Submit new pages from vancouversublets sitemap"

Claude: Uses submit_sitemap with skip_already_submitted=true
- Fetches sitemap
- Compares against history
- Submits only new URLs

Bulk Initial Indexing

User: "Index all listing pages from vancouversublets, use apex mode"

Claude: Uses submit_sitemap with filter_pattern="/listing/", apex_mode=true
- Submits all matching URLs
- Uses 3 credits per URL for faster indexing

Check Progress

User: "How's my indexing going this month?"

Claude: Uses get_stats with period="month"
- Shows submitted vs indexed
- Shows by-app breakdown
- Shows if on track for 50k goal

Development

# Watch mode
npm run dev

# Build
npm run build

# Run directly
npm start

License

MIT

Author

John Hashem [email protected]