Multimodal AI

News, repos, and tools about Multimodal AI. Auto-updated every 6 hours.

Latest News
ChatGPT Sketch turns your bad drawings into detailed AI images
The Verge · Sep 8, 2026
Roland launches Melody Flip AI plugin for generative music creation with 250 genre palettes
The Verge · Sep 4, 2026
Stability AI, creator of Stable Diffusion image generator, secures $76 million in new funding
TechCrunch · Aug 25, 2026
MindTopo benchmark reveals gaps in VLM spatial and topological reasoning
Microsoft Research · Aug 12, 2026
Major YouTube creators are facing backlash for accepting AI money
The Verge · Aug 21, 2026
Robin Williams’ Instagram account brought back to fight ‘AI abuse’
The Verge · Aug 18, 2026
Firefox Smart Window adds real-time web search and natural language browsing history features
The Verge · Aug 18, 2026
Why people aren’t buying Mark Zuckerberg’s AI future
TechCrunch · Aug 16, 2026
Woman joins lawsuit alleging stepfather used Grok to create explicit images from childhood photo
TechCrunch · Aug 15, 2026
Google now lets you disable Gemini's visible watermarks
The Verge · Aug 14, 2026
Google to let users remove visible watermarks from AI-generated images, videos, songs
TechCrunch · Aug 14, 2026
Meta releases Muse Glimmer: open-source 30B multimodal model for local agentic use
Hugging Face · Aug 10, 2026
Suno plans watermarks for AI-generated music to meet industry standards
Ars Technica · Aug 6, 2026
How we built a realtime system for responsive voice AI in six months
OpenAI Blog · Aug 3, 2026
Google Earth AI image generator sparked deepfake concerns before rollback
The Verge · Jul 31, 2026
Google Earth’s AI deepfake tool only lasted one day
The Verge · Jul 31, 2026
Canadian legislator reads out apparent LLM prompt instruction in floor speech
Ars Technica · Jul 24, 2026
Meta's Content Seal AI watermarking criticized for duplicating Google's SynthID
The Verge · Jul 22, 2026
Meta removes AI image feature from Instagram following backlash
TechCrunch · Jul 10, 2026
Google's deepfake detector system debunks McConnell hoax image
TechCrunch · Jul 8, 2026
Trending Repos
debpalash/VoiceStudio
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictati
Python · 85.7k stars
heygen-com/hyperframes
Write HTML. Render video. Built for agents.
TypeScript · 71.8k stars
remotion-dev/remotion
🎥 Make videos programmatically with React
TypeScript · 67.3k stars
browser-use/video-use
Edit videos with coding agents
Python · 29.8k stars
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and
Python · 168.1k stars
nexu-io/open-design
The 1st Collaborative AI Design Agent Workspace. Local-first and open source. Create motion, prototypes, websites, apps,
TypeScript · 103.9k stars
Leonxlnx/taste-skill
Agent skills that give coding agents taste: art direction, reference images and a browser check instead of generic AI pa
JavaScript · 102.2k stars
calesthio/OpenMontage
World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and pr
Python · 71.8k stars
mudler/LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU requir
Go · 49.9k stars
oobabooga/textgen
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
Python · 47.7k stars
ToolJet/ToolJet
Open-source foundation of ToolJet AI - the enterprise app generation platform for internal tools, dashboards, business a
HTML · 41.1k stars
bytedance/UI-TARS-desktop
The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra
TypeScript · 39.4k stars
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Python · 38.1k stars
deepset-ai/haystack
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modula
Python · 26.8k stars
Evil0ctal/Douyin_TikTok_Download_API
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API,支持 AI agent 通过 MCP 调用与离线语音转文字,Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili s
Python · 20.9k stars
budtmo/docker-android
Android in docker solution with noVNC supported, video recording, mcp server and AI-agent
Python · 16.0k stars
FlowiseAI/Flowise
Build AI Agents, Visually
TypeScript · 55.5k stars
modelcontextprotocol/inspector
Visual testing tool for MCP servers
TypeScript · 11.1k stars
gorse-io/gorse
AI powered open source recommender system engine supports classical/LLM rankers and multimodal content via embedding
Go · 9.9k stars
xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal mode
Python · 9.6k stars
Related Tools
Midjourney
Leading AI art generator known for highly aesthetic, photorealistic, and artistic image outputs. Web app and Discord.
DALL-E
OpenAI image generator integrated into ChatGPT, creating and editing images from natural language prompts.
Stable Diffusion
Open-source AI image model by Stability AI that can run locally or via API for unrestricted generation.
Leonardo
AI image and video generation platform with fine-tuned models for game assets, design, and art.
Ideogram
AI image generator known for exceptional text rendering accuracy within generated images.
Flux
State-of-the-art open-source image generation model by Black Forest Labs with excellent prompt adherence.
Runway
Leading AI video generation platform with Gen-4 Turbo model for creating and editing cinematic video from text and images.
Pika
AI video creation platform that generates and edits video clips from text prompts with cinematic quality.
Kling
Advanced AI video generation model producing high-quality, physics-aware video from text and image inputs.
Sora
OpenAI text-to-video model capable of generating realistic scenes with complex motion and camera movements.
Other Topics