ZOYKUHot Board

abnste/mewu_aiDokumentacja

abnste/mewu_ai open-source repository on GitHub

Uwaga dotycząca języka:Brak zlokalizowanej dokumentacji. Wyświetlana jest oficjalna wersja oryginalna w języku angielskim.
Szybka instalacja
git clone https://github.com/abnste/mewu_ai.git
MewuAI

MewuAI — Personal Agent & AI Creative Canvas

An open-source, LLM-powered desktop app for conversation, visual annotation, creative tools, and desktop actions.

Latest release Windows x64 macOS ARM64 Linux x64 MPL-2.0

Windows installer  ·  Windows portable  ·  macOS ARM64  ·  Linux x64

简体中文 · English · Website · Release notes · Report an issue

MewuAI is an open-source desktop Agent app for Windows, macOS, and Linux. Select screen content and express what you need through annotations, freehand drawings, and files. Chat, organize references, generate interactive tools, and use plugins to act in the same space. Mewu with you — working alongside you.

At a glance Details
Platforms Windows x64, macOS ARM64, Linux x64; Simplified Chinese and English UI
Core capabilities Personal Agent, AI creative canvas, visual annotation, interactive HTML, CLI, and plugins
Workflow Select to reference → describe the task → use, annotate, or refine the result
Local tools Capture, manual drawing, pinning, local OCR, and recording need no AI account
AI connections Choose model services, external Agents, MCP tools, and independent memory providers
Official sources Latest release · Plugin marketplace

MewuAI cover: capture an image, ask a question, and annotate in place.
Capture, ask, and annotate in place.

Features

  • Personal Agent: choose a role, model, tools, and memory, and reference images, videos, and files in conversation. Read Markdown, formulas, and model-provided reasoning. Long conversations can compact context while preserving the original history for retrieval. Use the official Agent's persistent local memory or connect an independent memory service.
  • Local tools and skills: the built-in Agent can read, write, edit, and search files, run commands and scripts through Shell / PowerShell, and stop execution when you cancel a task. Portable SKILL.md skills can include scripts and references. Bundled skills cover image annotation, video annotation, interactive objects, and task verification; ordinary local tasks need no custom plugin.
  • AI creative canvas: arrange, resize, pin, or save images, videos, text, and generated objects. Describe interactive HTML / SVG / Canvas content, use the resulting calculator, experiment, or game in the workspace, and ask for further changes.
  • Capture and multiple selections: capture a region, multiple areas, scrolling content, or supported windows. Selections automatically become references while the surrounding screen dims, with no separate “Reference” click.
  • Quick interaction: open with a configurable hold shortcut, select and copy recognized text, capture a region, or pin an image. The interface closes after a successful image/video copy or pin. With a voice plugin enabled, you can also start tasks by voice. See Hooks for setup and shortcuts.
  • Drawing and AI annotation: pens, arrows, shapes, text, numbering, highlights, and mosaic, with undo, redo, and object editing. Annotate manually or ask AI to add construction lines, formulas, tables, and explanations to worksheet images, code, and other references. Generated annotations remain editable.
  • Text and tables: local OCR, capture translation, chart understanding, and table extraction. Windows/macOS also offer actionable recognition of links, emails, phone numbers, QR codes, and barcodes.
  • Recording and video annotation: capture system audio and microphone input; pause, resume, trim, and export MP4 / MP3 / GIF. Annotate manually or ask AI to use video frames to add rectangles and text over specific time ranges. Edit or undo annotations, and click conversation timestamps to revisit frames. Audio support varies by system.
  • Blackboard: draw and explain on a full-screen board, combining questions, formulas, and AI analysis. Dock the toolbar to any of the four edges. A setting lets screen-sharing apps see selections and annotations.
  • CLI and region AI operations: local Agents can inspect scenes, capture, add selections, draw, and export. The region plugin lets a model observe a selected target, act, and check a fresh screenshot before continuing.
  • Plugins and event triggers: extend Agents, memory, tools, and UI independently. Official Hooks supports schedules, prompts, completed replies, press or hold shortcuts, and app/plugin events, connecting Mewu operations, MCP, commands, and keyboard/mouse actions. Theme plugins contribute shared colors and backgrounds, with cross-window updates and restoration when disabled or removed.
  • Self-made plugins: describe a need to the built-in Agent to create, validate, and package a plugin project. Review permissions before installation under Plugins → Installed → Self-made. Plugins can reorder the original screenshot toolbar through the generic layout service. See skills and authoring.

Capture, drawing, and recording work without AI setup. AI conversations, translation, and generated content require a configured service.

In development / TODO

  • Reference-guided generation and dedicated image/video model connections.
  • Circle-to-search, a desktop companion plugin, and more desktop collaboration workflows.
  • Android x86 support for classroom interactive displays and TV systems.
  • Messaging channel integrations.
  • Exporting and sharing interactive workspaces.
  • One-click sharing.
  • Broader platform coverage, language support, and performance improvements.

Feature demos

Exam annotation

Explain a worksheet and add construction lines, reasoning, and annotations to the original.

Exam annotation: Explain a worksheet and add construction lines, reasoning, and annotations to the original.

Generate HTML tools

Describe a tool, generate interactive content, and keep using and refining it.

Generate HTML tools: Describe a tool, generate interactive content, and keep using and refining it.

AI creative canvas

Arrange storyboards, images, and conversations to develop a creative project.

AI creative canvas: Arrange storyboards, images, and conversations to develop a creative project.

Blackboard

Draw axes, curves, and notes by hand to explain your reasoning.

Blackboard: Draw axes, curves, and notes by hand to explain your reasoning.

Video annotations

Annotate time ranges, play the result, and click timestamps to revisit the relevant frames.

Video annotations: Annotate time ranges, play the result, and click timestamps to revisit the relevant frames.

CLI capture and drawing

Call capture, selection, and drawing operations from a terminal and see the results in Mewu.

CLI capture and drawing: Call capture, selection, and drawing operations from a terminal and see the results in Mewu.

Text recognition

Extract the text you need from a capture using local OCR.

Text recognition: Extract the text you need from a capture using local OCR.

Code explanation

Select code, explain its logic, mark the failing line, and show a correction beside the original.

Code explanation: Select code, explain its logic, mark the failing line, and show a correction beside the original.

Table extraction

Turn a captured table into structured data you can copy, compare, and use for further analysis.

Table extraction: Turn a captured table into structured data you can copy, compare, and use for further analysis.

External Agents

Connect Codex, MiniMax Code, WorkBuddy / CodeBuddy, or Hermes to the existing conversation bar.

External Agents: Connect Codex, MiniMax Code, WorkBuddy / CodeBuddy, or Hermes to the existing conversation bar.
About the demos

Animations use Mewu interface components with prepared example content; generated results vary by model and prompt. Video annotations appear over assigned time ranges and do not imply automatic object tracking. Exam annotation retains the original README screenshot; code explanation is newly recorded with the current Mewu UI. The External Agents image is a published native screenshot from that plugin. Assets and credits.

Get started

  1. Install and launch. Choose your platform above. Windows uses WebView2; on macOS, move the app into Applications; on Linux, make the AppImage executable. Downloads follow the latest stable release.
  2. Enter the workspace. Open Mewu from the tray or a capture shortcut to select, draw, save, or open a blackboard. Configure capture shortcuts in Settings → Capture & recording, and quick interaction and automation rules in Settings → Hooks. Grant system capture/recording permissions when requested.
  3. Connect AI. Add a model in Settings → Agents & Connections, choose a role and memory, or connect a client through External Agents. Selections become references automatically; send your task from the conversation bar.

For Linux dependencies and permissions, see the AppImage guide and recording guide. Region AI operations support Windows, macOS, and compatible GNOME 50 Wayland x64 setups; Linux also requires Desktop Witness and Portal authorization.

Supported AI

Connection How to use it
Model APIs Configure Chat Completions, OpenAI Responses, or Anthropic Messages services, save independent connections, and choose a model. Advanced settings include context window size and thinking effort.
External Agents Use the independent plugin to connect Codex, MiniMax Code, WorkBuddy / CodeBuddy, or Hermes with the client's own login and configuration.
Memory Choose the Agent and memory separately: use official persistent local memory or connect Hindsight and other providers through plugins.
MCP and tools Add services in Agents & Connections → MCP, or enable plugin tools for the current Agent to call.

Image, video, tool calling, and thinking effort support, as well as usage limits and fees, depend on the selected service. Leave thinking effort unset to use the provider's default. External Agents require the corresponding client to be installed and signed in; consult each plugin's documentation for platform support.

Plugin marketplace

Browse, install, and manage extensions in Settings → Plugins, or import a release ZIP. Browse the full marketplace.

You can also describe what you need to the built-in Agent and ask it to create a plugin. For example, send:

Generate a Mewu plugin that adds OpenClaw channel support.

The Agent can load the plugin-authoring skill to create, validate, and package the plugin. Once it is ready, review its permissions and install it under Plugins → Installed → Self-made. See skills and plugin authoring.

Plugin What it adds
Hooks · event triggers Included and enabled by default. Configure capture and quick interaction shortcuts, and combine triggers such as schedules and messages with actions. Enable, edit, and review the history of each rule independently.
External Agents Connect an existing client to Mewu's roles and conversations.
Region AI operations Select a target and describe a task; the model acts based on successive observations.
Hindsight memory Connect your Hindsight service and memory banks.
Journal memory Choose an independent journal-based memory provider for an Agent.
Mewu toolbox Save images, videos, HTML, and drawings; organize folders and drag out copies for reuse.
Research notes Write notes, drag in reference objects, and save them in the workspace.
Interactive ruler Use a movable, adjustable HTML / SVG measuring tool on the canvas.

Command line

Start the desktop app, then open a terminal. The CLI shares the same Mewu workspace with you:

mewu                         # Start an Agent conversation
mewu status                  # Inspect the app and current scene
mewu schema                  # Discover operations and parameters
mewu call capture.open --json '{}' --wait
mewu call capture.quick --json '{}' --wait

Plain mewu chat sends text by default; screenshots and files require explicit references. See the CLI guide and operation catalog for setup, platform requirements, and parameters.

FAQ

Do I need an AI account? Is it paid?

Capture, manual drawing, recording, and local OCR need no AI account. AI conversations and generation use your chosen service or external Agent, which determines usage limits and charges. MewuAI itself is open source.

Will AI keep working when I minimize Mewu?

The built-in Agent continues its current task and saves the result to the original conversation. Restore the window to read the reply and use generated objects. Minimizing does not quit the app. Temporary region-control authorization expires on actions such as minimizing, so screen control requires renewed authorization.

Can I import skills from other Agents?

Copy the complete folder containing SKILL.md into skills/ in Mewu's data directory, keeping its scripts, references, and assets. The default location is ~/.mewu/skills. The Agent reads skills on demand, and bundled skill updates preserve files you have modified. Importing a skill does not provide another Agent's private tools; tasks using those tools still need the corresponding capabilities. See the skills guide.

Why are selections and annotations missing from a screen share?

Enable Settings → General → Allow screen sharing to see selections and annotations. Visibility also depends on the operating system and screen-sharing app.

Where do my captures and conversations go?

Capture and manual drawing happen locally. When you use AI, referenced content, relevant context, and tool results are sent to your selected service. Local file tools and commands access files and run programs with your OS account permissions. Plugins use granted permissions, and external Agents retain their own runtime configuration.

How do I update or report a problem?

Check Settings → About, or download the latest release. The Windows portable build's built-in updater switches to the installed edition; download a new portable ZIP to keep using it portably.

Report an Issue with your system, app version, reproduction steps, and relevant screenshots.

Contributing

Bug reports, use cases, code, plugins, and documentation contributions are welcome. The desktop app uses Rust + Tauri 2 + SolidJS / TypeScript + SQLite and renders through the system WebView.

Desktop development · Extension SDK · Extension interfaces · Plugin packaging · Release guide

Agent runtime · Skills and plugin authoring · Interactive object runtime · Agent evaluation

Browser previews support interface development; native capture, recording, and system input require the desktop runtime.

Project members

Abner Stephen Yandi 数字与星星 Cobb tljsj

License

MewuAI's own source uses MPL-2.0, which permits commercial use subject to its terms. Distributions must provide covered source and preserve copyright and license notices as required. Third-party notices ship with the app.

Acknowledgments

Thanks to Lin Wenjie (林文杰) for subject-matter guidance, Zhang Wenbiao (张文彪) for feature-development suggestions, and blueling0 for testing.

Kopia dokumentacji z oficjalnego repozytorium GitHub · Zobacz na GitHubie
Data migawki: 2026-11-09