Autoglm Server

A Model Context Protocol (MCP) server for the AutoGLM-Phone API, enabling automated GUI interaction on mobile devices.

Overview

This MCP server provides tools for interacting with the AutoGLM-Phone API, which allows AI models to control mobile devices through a series of actions. The server supports Android (ADB).

Quick Start

Using npx (Recommended)

# Run directly without installation
npx -y autoglm-mcp-server

# With options
npx -y autoglm-mcp-server --transport http --port 3000

Global Installation

npm install -g autoglm-mcp-server
autoglm-mcp-server

Local Installation

npm install autoglm-mcp-server

MCP Client Configuration

Claude Desktop / Cursor (stdio mode)

{
  "mcpServers": {
    "autoglm": {
      "command": "npx",
      "args": ["-y", "autoglm-mcp-server"],
      "env": {
        "AUTOGLM_API_KEY": "<YOUR_API_KEY>"
      }
    }
  }
}

StreamableHTTP Mode

First start the server:

npx -y autoglm-mcp-server --transport http --port 3000

Then configure your MCP client:

{
  "mcpServers": {
    "autoglm": {
      "url": "http://127.0.0.1:3000/mcp",
      "headers": {
        "Authorization": "<YOUR_API_KEY>"
      }
    }
  }
}

Configuration

Set the following environment variables:

export AUTOGLM_API_KEY="your-api-key-here"
export AUTOGLM_API_URL="https://open.bigmodel.cn/api/paas/v4"  # optional
export AUTOGLM_MODEL="autoglm-phone"  # optional

Or create a .env file based on .env.example.

Usage

Development

npm run dev

Build

npm run build

Production

# stdio mode (default)
npm start

# HTTP mode
node dist/index.js --transport http --port 3000

# SSE mode
node dist/index.js --transport sse --port 3000

# HTTP mode on all interfaces
node dist/index.js --transport http --host 0.0.0.0 --port 3000

Command Line Options

Option	Alias	Description	Default
--transport	-t	Transport type: stdio, http, or sse	stdio
--port	-p	Port for HTTP/SSE transport	3000
--host	-h	Host for HTTP/SSE transport	127.0.0.1
--help		Show help message

Available Tools

autoglm_list_adb_devices

List all Android devices connected via ADB (Android Debug Bridge).

Parameters:

• response_format ('markdown' | 'json', optional): Output format

Returns:

• Device ID, status, connection type, model, Android version, screen dimensions

Example:

{}

autoglm_task

Execute a task on a connected device using AutoGLM online model. The model will iteratively capture screenshots, analyze the screen, and execute actions until the task is complete.

Parameters:

• prompt (string, required): Natural language task description (1-5000 characters)
• device_id (string, optional): Target ADB device ID
• max_steps (number, optional): Maximum steps to execute (default: 100, range: 1-200)
• lang ('cn' | 'en', optional): Language for responses (default: 'cn')

How it works:

1. Captures the current screen via ADB
2. Sends the screen image and task prompt to AutoGLM online model
3. The model analyzes the screen and decides on the next action
4. Executes the action via ADB
5. Repeats until the task is complete or max_steps is reached

Example:

{
  "prompt": "Open WeChat and send a message to Mom saying hello",
  "max_steps": 50,
  "lang": "cn"
}

Supported Actions

The AutoGLM model can execute the following actions:

Action	Description	Parameters
Launch	Launch an application	app_name
Tap	Tap at coordinates	x, y (0-1000 scale)
Type	Type text	text
Type_Name	Type text by name	text
Swipe	Swipe between coordinates	x1, y1, x2, y2, duration
Back	Go back	-
Home	Go to home screen	-
Double Tap	Double tap at coordinates	x, y
Long Press	Long press at coordinates	x, y, duration
Wait	Wait for duration	duration (ms)
Take_over	Request human takeover	reason
Note	Add a note	text
Call_API	Call an API endpoint	endpoint, params
Interact	Interact with UI element	element, action

Coordinate System

All coordinates use a 0-1000 scale relative to screen size:

• (0, 0) is top-left corner
• (1000, 1000) is bottom-right corner

Project Structure

autoglm-mcp-server/
├── src/
│   ├── index.ts                    # Main server entry point
│   ├── constants.ts                # Configuration constants
│   ├── types.ts                    # TypeScript type definitions
│   ├── tools/
│   │   └── autoglm-tools.ts        # MCP tool implementations
│   ├── services/
│   │   ├── autoglm-api-client.ts   # AutoGLM API client
│   │   ├── autoglm-client.ts       # AutoGLM client wrapper
│   │   └── adb-service.ts          # ADB device service
│   └── schemas/
│       └── index.ts                # Zod validation schemas
├── dist/                           # Compiled output
├── package.json
├── tsconfig.json
├── .env.example
└── README.md

HTTP/SSE Authentication

When using HTTP or SSE transport, you can pass the API key via the Authorization header:

# Bearer token format
curl -X POST http://localhost:3000/mcp \
  -H "Authorization: Bearer your-api-key" \
  -H "Content-Type: application/json" \
  -d '{"jsonrpc":"2.0","method":"initialize",...}'

References

• AutoGLM-Phone Documentation
• Open-AutoGLM Repository
• MCP TypeScript SDK

License

MIT