《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码
#multimodal
MCP servers, skills and plugins tagged “multimodal” on GitHub.
23 entries · real GitHub data
The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra
YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context
- #5Modlens
The first vision plugin for DeepSeek Harness, and the vision bridge for every text-only coding agent. Paste an image, get structured JSON evidence (OCR, layout, semantics). |…
[ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.
NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.
Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.
Give Claude the ability to watch and understand videos — Claude Code plugin with frame extraction and multimodal audio analysis
为纯文本模型"看图“设计更好的视觉工具箱和技能,支持多图理解,图片问答,前端UI还原、GUI 自动化等,并可选无缝接入多个主流agent,直接识别粘贴图片| A vision toolkit and skill designed for text-only llms — image Q&A, long-screenshot OCR, frontend…
An MCP Multimodal AI Agent with eyes and ears!
全息闪卡通用 Agent Skill,不挑宿主、多模态模型都能用:一句话生成可拖转、会流光、带层次景深的 3D 闪卡网页,附可编辑 Blender 工程 · A host-agnostic Agent Skill: turn one sentence into an interactive 3D holographic card page with…
- #15Telemem
TeleMem is a high-performance drop-in replacement for Mem0, featuring semantic deduplication, long-term dialogue memory, and multimodal video reasoning.
- #16Watch Skill
Give AI agents eyes, ears, and verifiable results. Watch Skill turns video, audio and screen activity into searchable, timestamped evidence and proves work with deterministic…
为 Claude Code 赋能多模态视觉能力,适配 纯文本 LLM 底座,用于截图 / UI / 图表分析;搭配 browser-harness 可做前端布局自动化检查。
Declarative AI pipelines in one YAML file. Tokens, audio chunks, and video frames flow between isolated components. Compose 100+ components for models, agents, speech, vision,…
MCP server for OpenRouter — chat with 300+ LLMs (Claude, Gemini, GPT), analyze images / audio / video, generate images / speech / music / video (Veo 3.1, Sora, Seedance, Wan)…
Local NotebookLM for Claude Code via Google Antigravity (agy / Gemini 3.x): /agy:notebook turns a folder of documents into per-doc summaries + a relevance index + a cited…
- #23Holmes Skill
An agent skill that reads a photo the way Sherlock Holmes reads a stranger (福尔摩斯): observe first, deduce second, every conclusion cites its evidence and you grade it. Works…