MiMo Multimodal Understanding Server
FreeNot checkedIntegrates Xiaomi MiMo's multimodal API to enable understanding of images, audio, and video through natural language prompts.
About
Integrates Xiaomi MiMo's multimodal API to enable understanding of images, audio, and video through natural language prompts.
README
MCP server for Xiaomi MiMo multimodal understanding API (image, audio, video).
Features
- Image Understanding: Single/multiple images, URL and local file support
- Audio Understanding: Single/multiple audio, URL and local file support
- Video Understanding: Single/multiple video, URL and local file support, configurable fps and resolution
Setup
1. Install dependencies
uv sync
2. Configure API Key
Copy .env.example to .env and fill in your API key:
cp .env.example .env
Or set environment variable directly:
export MIMO_API_KEY=your_api_key_here
Get your API key from: https://platform.xiaomimimo.com
3. (Optional) Configure API Base URL
The default API endpoint is determined by your API key prefix:
| Key Prefix | Default Endpoint |
|---|---|
tp-* |
https://token-plan-cn.xiaomimimo.com/v1 |
sk-* or others |
https://api.xiaomimimo.com/v1 |
To use a different API endpoint:
export MIMO_API_BASE=https://your-custom-endpoint/v1
Or add it to your .env file:
MIMO_API_BASE=https://your-custom-endpoint/v1
Usage
Quick Start (with uvx)
export MIMO_API_KEY=your_api_key_here
uvx mimo-multimodal-mcp
Development mode (with MCP Inspector)
uv run mcp dev src/mimo_multimodal_mcp/server.py
Install to Claude Desktop
uv run mcp install src/mimo_multimodal_mcp/server.py
Direct execution
uv run python src/mimo_multimodal_mcp/server.py
Claude Desktop Configuration
Add to ~/.config/claude/claude_desktop_config.json:
{
"mcpServers": {
"mimo-multimodal": {
"command": "uvx",
"args": ["mimo-multimodal-mcp"],
"env": {
"MIMO_API_KEY": "your_api_key_here"
}
}
}
}
Tools
understand_image
Analyze images using Xiaomi MiMo multimodal model.
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string | Yes | Image understanding task description |
image_url |
string | No | Single image URL or data:image base64 |
image_path |
string | No | Single local image file path |
image_urls |
list[string] | No | Multiple image URLs |
image_paths |
list[string] | No | Multiple local image file paths |
system_prompt |
string | No | Custom system prompt |
max_tokens |
integer | No | Max output length (default: 8192, max: 32768) |
Supported formats: JPEG, PNG, GIF, WebP Size limit: 10MB
understand_audio
Analyze audio using Xiaomi MiMo multimodal model.
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string | Yes | Audio understanding task description |
audio_url |
string | No | Single audio URL |
audio_path |
string | No | Single local audio file path |
audio_urls |
list[string] | No | Multiple audio URLs |
audio_paths |
list[string] | No | Multiple local audio file paths |
system_prompt |
string | No | Custom system prompt |
max_tokens |
integer | No | Max output length (default: 8192, max: 32768) |
Supported formats: MP3, WAV, FLAC, M4A, OGG Size limit: URL 100MB, Base64 50MB
understand_video
Analyze video using Xiaomi MiMo multimodal model.
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string | Yes | Video understanding task description |
video_url |
string | No | Single video URL |
video_path |
string | No | Single local video file path |
video_urls |
list[string] | No | Multiple video URLs |
video_paths |
list[string] | No | Multiple local video file paths |
fps |
float | No | Frames per second, range [0.1, 10], default: 2 |
media_resolution |
string | No | Resolution: "default" or "max" |
system_prompt |
string | No | Custom system prompt |
max_tokens |
integer | No | Max output length (default: 8192, max: 32768) |
Supported formats: MP4, MOV, AVI, WMV Size limit: URL 300MB, Base64 50MB
Examples
Image Understanding
# URL
await understand_image(prompt="Describe this image", image_url="https://example.com/image.jpg")
# Local file
await understand_image(prompt="What text is in this?", image_path="/path/to/screenshot.png")
# Multiple images
await understand_image(prompt="Compare these", image_urls=["url1", "url2"])
Audio Understanding
# URL
await understand_audio(prompt="Transcribe this audio", audio_url="https://example.com/audio.wav")
# Local file
await understand_audio(prompt="What is being said?", audio_path="/path/to/audio.mp3")
Video Understanding
# URL with default settings
await understand_video(prompt="Describe this video", video_url="https://example.com/video.mp4")
# URL with custom fps and resolution
await understand_video(
prompt="Describe the action",
video_url="https://example.com/video.mp4",
fps=5.0,
media_resolution="max"
)
from github.com/ChanthMiao/MiMo-Multimodal-Understanding-MCP
Install MiMo Multimodal Understanding Server in Claude Desktop, Claude Code & Cursor
unyly install mimo-multimodal-understanding-mcp-serverInstalls into Claude Desktop, Claude Code, Cursor & VS Code — handles npx, uvx and build-from-source repos for you.
First time? Get the CLI: curl -fsSL https://unyly.org/install | sh
Or configure manually
Run in your terminal:
claude mcp add mimo-multimodal-understanding-mcp-server -- uvx mimo-multimodal-mcpFAQ
Is MiMo Multimodal Understanding Server MCP free?
Yes, MiMo Multimodal Understanding Server MCP is free — one-click install via Unyly at no cost.
Does MiMo Multimodal Understanding Server need an API key?
No, MiMo Multimodal Understanding Server runs without API keys or environment variables.
Is MiMo Multimodal Understanding Server hosted or self-hosted?
A hosted option is available: Unyly runs the server in the cloud, no local setup required.
How do I install MiMo Multimodal Understanding Server in Claude Desktop, Claude Code or Cursor?
Open MiMo Multimodal Understanding Server on unyly.org, pick your client tab (Claude Desktop, Claude Code, Cursor) and press Install — the config is generated automatically, no JSON editing.
Related MCPs
Omni Video
An MCP server that transforms LLM-enabled IDEs into professional video editors by pre-processing footage into text proxies, generating motion graphics via HTML/
by buildwithtazaARA
Generate images, video and audio from any AI agent — one connector.
by ARAYouTube
Transcripts, channel stats, search
by YouTubeEverArt
AI image generation using various models.
by modelcontextprotocolCompare MiMo Multimodal Understanding Server with
Not sure what to pick?
Find your stack in 60 seconds
Author?
Embed badge for your README
Browse similar
All media MCPs
