Multimodal Memory for Openclaw

A persistent visual memory system for AI agents to store, analyze, and recall images, charts, and website screenshots.

horisky
v1.0.0
Mar 6, 2026
1
787
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install minds-eye

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install minds-eye using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is Multimodal Memory?

Multimodal Memory is a sophisticated skill designed to bridge the gap between text-based interactions and visual context. It allows AI agents to maintain a long-term visual archive, ensuring that diagrams, screenshots, and UI mockups shared in past sessions remain accessible and searchable. By leveraging this tool within the Openclaw Skills ecosystem, developers can build agents that truly see and remember history across multiple sessions.

This skill uses a dedicated analysis pipeline to process images via GPT-4o, bypassing the vision limitations of primary models. Whether you are tracking UI changes over time or recalling a specific chart from last week, this skill provides the persistent storage and retrieval layer necessary for advanced multimodal workflows.

Multimodal Memory Use Cases

  • Saving and tagging user-uploaded images, photos, or technical diagrams for future reference.
  • Capturing and remembering website UIs or specific web page layouts via URL screenshots.
  • Recalling past visual context during a conversation by searching through stored descriptions.
  • Finding similar past content by analyzing a new query image and matching it against the visual database.

How Multimodal Memory Works

  1. The agent detects an image path or a URL request in the conversation context.
  2. It executes a capture or analysis script which processes the visual data using GPT-4o.
  3. Metadata, including descriptions and tags, is automatically extracted and stored in a local SQLite database.
  4. A human-readable Markdown summary is updated to provide a quick overview of recent visual memories.
  5. The agent performs semantic or keyword searches against this database to retrieve relevant visual history when prompted.

Multimodal Memory Setup

Ensure you have Python 3 installed. If you plan to capture website screenshots, install the Playwright dependencies within the Openclaw Skills environment:

pip install playwright && python -m playwright install chromium

The skill automatically creates its storage directory at ~/.multimodal-memory/ upon the first execution.

Multimodal Memory Data Schema & Taxonomy

The skill organizes information within ~/.multimodal-memory/ using the following structure:

Component Description
images/ A directory containing local copies of all captured and analyzed images.
metadata.db An SQLite database storing image paths, GPT-4o descriptions, source URLs, and tags.
memory.md A human-readable Markdown file that provides a summarized log of stored visual content.
scripts/ Python utilities for analysis (analyze.py), capture (capture_url.py), and search (search.py).

Multimodal Memory Advanced Features

  • Automated website UI tracking with the integrated Playwright screenshot engine.
  • Cross-session visual persistence allowing agents to reference images from weeks ago using Openclaw Skills.
  • Multi-source support, distinguishing between charts, diagrams, website captures, and general images.
  • Flexible tagging system using the --extra-tags argument for customized metadata organization.
  • Seamless integration with the Openclaw Skills framework to provide vision-less models with robust visual memory capabilities.

SKILL.md


Loading

Related Openclaw Skills

METADATA

Github Stars: 0
forks: 0

Featured*