
Turn long videos into a memory your agent can question: who was there, who said what, how they said it and what happened when.
by Alibaba· MediaUnclaimed · Yours? Claim it
About
Omni Memory is one of the Qwen team's Qwen-MM-Plugins. It turns a long video into an audio-visual memory your agent can question. A Qwen Omni model reads each 30-second window together with its audio, so every spoken line is tied to the person saying it, how they said it and the sounds around it. What you can do with it - Ask about a short clip (under about 10 minutes) and get an answer from one watch, with no memory built - Build a memory of a long video, or of several files from one recording session, then ask follow-up questions without re-watching it - Find everything one person said, or who said something, with timestamps and tone - Look up who appears, the facts and relationships the video establishes, and what happens at a given time - Re-watch a few stored clips with their audio when the memory is missing a detail How it connects It's a Claude Code plugin with a skill and a local MCP server that runs with uvx. In Claude Code, run claude plugin marketplace add https://github.com/QwenLM/Qwen-MM-Plugins.git, then claude plugin install qwen-mm-plugins-omni-memory@qwen-mm-plugins. Qwen's guided installer also sets it up in Codex, OpenClaw, Qwen Code, Gemini CLI and other agents. Good to know - It needs a DashScope API key (DASHSCOPE_API_KEY), set in your environment or in ~/.qwen-mm-plugins/config through Qwen's installer, plus ffmpeg to build a memory. Use the config file when your agent is launched from a desktop app rather than a shell. - Building a memory makes one Omni model call per 30 seconds of video. It's paid for once, and the memory then answers later questions. - Video goes to DashScope for the Omni model to read; on the official endpoint, oversized files are uploaded to temporary storage there. - Memories are saved next to the video, in a .memory folder.
Plugins people install alongside Qwen Omni Memory.
4 images
Once it’s added
“Who interrupts whom in this stand-up clip, and how does the other person react?”
“What did each person commit to in this review meeting, and who pushed back?”
“Don't build a memory, I just need one quick answer: does the interviewer ever raise their voice?”
“What did David say about the budget?”
“Who offered to book a restaurant?”
“Build a memory of this episode, then make a viewing companion with the plot, the characters and scenes worth rewatching.”
Before you add it
Reads only
Watches local videos together with their audio · Searches a saved memory by person, dialogue, fact or time · Re-watches stored clips to check a detail
Makes changes · your agent can ask first
Builds a memory of a video and saves it next to the file · Sends video to DashScope for the Qwen Omni model to read
Runs on your machine.
Runs on your machine.
/plugin marketplace add QwenLM/Qwen-MM-Plugins /plugin install qwen-mm-plugins-omni-memory@qwen-mm-plugins
Scanned and passed · checked 4 h ago
From people who use it
No reviews yet. Used Qwen Omni Memory? Say how it went.
Write a reviewPlugins people install alongside Qwen Omni Memory.
Step by step
Nothing new reaches your agent until a person has looked at it.
Scanned on every change, and again when our rules improve.
Ask for a video and your agent writes it as HTML, then HyperFrames renders it to MP4: promos, explainers, captions and motion graphics.
Turns screenshots or a description into a narrated product demo video, with a story arc, designed scenes and an FFmpeg build script.
Lets your agent search screenpipe's local recordings of everything on your screen and microphone, from meetings to what you typed.
Nobody has shared how they use Qwen Omni Memory yet.
Security scan
Passed
Safe to install in every agent it supports. Claude plugins.