正在加载视频...

视频加载失败

🚨New Episode Drop!🚨 🧠 AI Research Lab - Explained: The Future is Multimodal You text, share photos, record videos—seamlessly switching between data types. Why can't AI? Our Salesforce AI team builds multimodal systems that understand text, images, audio, and video simultaneously—just like humans. Real applications: ➡️ Visual web interaction...

13,838 次观看 • 1 年前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Explore state-of-the-art multimodal prompting in our new short course Large Multimodal Model Prompting with Gemini, taught by Erwin Huizenga in collaboration with Google Cloud. One interesting insight from this course: with multimodal models, prompt structure matters significantly. Placing text inputs, such as a patient's medical history, before image inputs, like an X-ray, can enhance the model's ability to contextualize and interpret visual data effectively. In other contexts, such as image captioning, you may get better results by putting the image first. Multimodal models behave differently than text-only LLMs, and effective prompting for models varies depending on the model you’re using. In this course you’ll learn how to effectively prompt Gemini models. Gemini's multimodal capabilities also enable new approaches in AI application development, for example: - The Gemini library handles various video formats (MP4, MOV, MPEG), streamlining applications using these formats. - Large context window (up to 1 million tokens) enables processing of extensive content, like analyzing multiple 50-minute videos simultaneously. - Function calling feature integrates real-time data (e.g., current exchange rates) into model responses. The course demonstrates building multimodal applications with real-world examples including document analyzers that reason across text and graphs simultaneously, video content extractors that find and timestamp specific information from multiple hours of footage, and automated expense report systems processing receipt images while cross-referencing company policies. Sign up here:

Andrew Ng

74,060 次观看 • 2 年前

New short course Multimodal RAG: Chat with Videos, developed with Intel and taught by vasudevlal! In this course, you’ll work with LLaVA (Large Language and Vision Assistant), a Large Vision Language Model (LVLM) that can process both images and text. For example, given an image of a person doing a handstand on a skateboard at the beach, LLaVA doesn't just caption the scene, it’s able to predict possible outcomes, like the person losing balance or falling off. By understanding not just what's in a video frame, but what might happen next, your application can provide more insightful answers to questions about video. You'll build a full multimodal RAG pipeline that can chat about video content: - Use the BridgeTower model to create joint text-image embeddings in a 512-dimensional multimodal semantic space. - Learn video processing techniques to extract keyframes, generate transcripts using Whisper, and create captions. - Use the LanceDB vector database to store and retrieve high-dimensional multimodal embeddings. - Integrate the LLaVA model, combining CLIP's (Contrastive Language Image Pretraining) vision transformer with Llama, for advanced visual-textual reasoning. Your final system will ingest video data, generate embeddings for frames and text, perform similarity searches for relevant content, and use the retrieved multimodal context to inform LVLM-based response generation. The result is a system capable of answering nuanced questions about video content, effectively chatting about the video it has processed. Please sign up here!

Andrew Ng

107,967 次观看 • 2 年前

🚨$OSS is not an AI company. → It is the hardware that lets AI exist where the cloud cannot. Most investors don’t understand $OSS because they think AI = software. $OSS builds the physical “brains” that run AI in extreme environments where cloud computing fails. Jets. Ships. Tanks. Drones. Space. Hospitals. That’s the game. 1) What $OSS actually is $OSS (One Stop Systems) designs rugged high-performance computers and storage systems for AI at the edge. Meaning: They bring data-center-level computing power into harsh environments. Their products include rugged servers, GPU accelerators, storage arrays, and expansion systems used for AI, sensor processing, and autonomous systems. In simple terms: Cloud AI = brain in a safe building. $OSS AI = brain inside machines operating in chaos. 2) Why this is crucial Most AI today runs in data centers. But the future of AI is not in the cloud. It’s on: • autonomous vehicles • military systems • drones • ships • industrial machines • medical devices These systems cannot wait for the cloud. Latency, connectivity, security, and survival demand local AI. $OSS delivers “data-center performance at the edge” across land, sea, and air. Without companies like OSS, autonomous systems simply don’t work. 3) What OSS actually does: Think of OSS as building AI engines that survive reality. 🌊 SEA example: naval surveillance aircraft and ships. $OSS supplies rugged storage and compute systems for U.S. Navy reconnaissance aircraft to collect and process massive sensor data in real time. Translation: Instead of sending raw data back to base, the aircraft analyzes threats instantly onboard. $OSS = the onboard AI brain. 🪖 LAND example: military vehicles and tactical operations. $OSS delivers high-performance servers and FPGA systems for mobile military intelligence platforms used by the U.S. Department of Defense. Translation: Tanks and vehicles detect threats, process sensor data, and make decisions locally. $OSS = the battlefield computer. ✈️ AIR example: airborne AI. $OSS builds GPU-accelerated servers designed for aircraft, described as a “datacenter in the sky.” Translation: Jets and drones run AI models mid-flight. $OSS = flying supercomputers. 🚀 SPACE example: $OSS hardware is designed for extreme environments and autonomous systems across aerospace and defense. Translation: Future satellites, space drones, and autonomous spacecraft need onboard AI. $OSS = the computing core of autonomous space systems. BONUS: CIVILIAN & COMMERCIAL $OSS systems are used in: • autonomous trucking and farming • industrial automation • healthcare imaging • energy and mining • telecom and 5G Example:A medical imaging company uses $OSS hardware to run real-time AI diagnostics in next-gen breast cancer scanners. $OSS = AI where milliseconds matter. 4) Who their customers are (pattern, not names) $OSS sells to: • defense primes • government programs • industrial OEMs • AI infrastructure companies • medical device manufacturers These customers share one trait: They cannot rely on the cloud. That’s why $OSS exists. 5) The mental model that makes $OSS obvious $NVDA = AI chips $PLTR = AI software $OSS = AI hardware in the real world If AI is electricity, $OSS builds the generators that work in storms. Most investors understand AI software. Few understand AI infrastructure at the edge. That gap is the opportunity. 6) The real thesis The world is moving toward: • autonomous warfare • autonomous vehicles • real-time AI systems • distributed intelligence All of that requires rugged edge computing. $OSS is positioned exactly there. Infrastructure. The hardest layer to build. And often the most valuable.

Black Panther Capital

30,138 次观看 • 7 个月前

Just how capable are open source models? Below is the first in a new series where we go behind the scenes and pull back the curtain on interesting AI research / demos, making them fun and easy to understand. Here, we have a short visual demonstration from aizk ✡️ showcasing how Kimi K3 (a language model that operates primarily through text) is capable of building complicated 3D structures / moments in history in Minecraft, something that previously was not possible with other open source models, and why this matters. The crazy part? The model doesn't "see" the game like we do. The LLMs must reason in pure text, writing JavaScript, that later compiles down into commands placing each block, one at a time. Spatial reasoning is a very hard problem in AI, it's the same core challenge behind robotics and self-driving cars, where a model has to understand and act in physical 3D space. Watching a text model pull it off is nothing short of a miracle. The point isn't just Minecraft itself, rather, it's AI being able to generalize, not memorize, on things that are weird and beyond their training data. This is key to building true artificial general intelligence. These video game benchmarks (there are many different games actively being researched right now) provide a clear-cut end goal, challenges that are almost certainly not in the training set, and a fun, very fast, visual way to almost feel the increasing capabilities of various open source AI models over time. If you haven't given open source models a serious try yet, watch the video, it may shock you!

Featherless AI

39,769 次观看 • 14 天前

🚀 Three Next-Gen AI & Web3 Projects Are Launching on Mindo AI A new chapter for community-powered intelligence, prediction markets, and open AI infrastructure The AI + Web3 landscape is entering a decisive phase — one where real usage, real revenue, and real ownership matter more than hype. Today, MindoAI is proud to welcome three groundbreaking projects that represent this shift clearly and powerfully: Perceptron Network Space DeepNode AI Each project tackles a different bottleneck in the AI economy — data, forecasting, and infrastructure — but they all share the same vision: decentralization, community ownership, and sustainable value creation. Let’s take a deeper look 👇 🧠 Perceptron Network The world’s first community-powered AI data engine Perceptron Network is redefining how AI data is sourced, validated, and delivered. Instead of relying on expensive, closed, and slow legacy data providers, Perceptron unlocks community-powered data pipelines that are: Faster Cheaper Revenue-generating from day one This isn’t experimental AI infrastructure — Perceptron already serves real clients with real revenue, proving that decentralized data engines can outperform traditional incumbents. Why Perceptron matters: AI models are only as good as their data Centralized data monopolies slow innovation Communities can produce higher-quality data at scale By aligning contributors, validators, and clients through incentives, Perceptron turns unused human and network potential into a living data engine for AI. Launching on Mindo AI gives Perceptron access to a broader AI-native community — accelerating adoption, partnerships, and ecosystem growth. 🌌 intodotspace The first 10× leveraged prediction market on Solana intodotspace is pushing the boundaries of on-chain prediction markets. Built by the $1.5B UFO team, this platform introduces: 10× leveraged predictions Ultra-fast execution on Solana Deep liquidity and composable market design The market’s confidence is already clear — the project completed a record-breaking raise that was oversubscribed by 1,360%. What makes intodotspace different: Leverage amplifies conviction, not noise On-chain transparency replaces opaque odds Markets become real-time intelligence engines Prediction markets are often called “truth machines.” intodotspace upgrades them into high-signal, high-efficiency forecasting layers — useful for traders, protocols, DAOs, and even AI systems that need probabilistic insights. Launching on positions intodotspace at the intersection of AI-driven decision-making and on-chain market intelligence. 🌐 DeepNode AI Infrastructure for open intelligence DeepNode AI is tackling one of the biggest problems in modern AI: centralized ownership. Today, AI is dominated by a handful of corporations. DeepNode flips that model by building open intelligence infrastructure where: Anyone can deploy AI models Builders earn directly from usage Intelligence is co-owned, not extracted Backed by leading validators, miners, and ecosystem builders, DeepNode transforms AI from a closed monopoly into a shared utility. DeepNode’s core philosophy: “Own what you build — or someone else will.” This is more than infrastructure. It’s an economic redesign of AI itself: Builders keep ownership Contributors share upside Networks replace platforms Launching on connects DeepNode to creators, researchers, and communities who believe intelligence should belong to everyone — not just Big Tech. 🤝 Why This Matters for With the launch of Perceptron Network, intodotspace, and DeepNode AI, #MindoAI is rapidly becoming: A hub for AI-native Web3 innovation A launchpad for real, revenue-backed projects A meeting point for data, markets, and intelligence infrastructure These three projects don’t compete — they complement each other: Perceptron supplies data intodotspace produces market intelligence DeepNode powers open AI execution Together, they form the backbone of a decentralized intelligence economy. 🔥 The future of AI is open, composable, and community-owned — and it’s launching now on Which of these projects are you most excited about? And how do you see decentralized intelligence reshaping the next AI cycle? 👇 Share your thoughts and join the conversation.

Hồng Ngọc | Ruby💎

12,837 次观看 • 6 个月前

Today, we’re thrilled to announce the launch of Akool Live Camera — a breakthrough in real-time AI video generation and the newest innovation in our Akool Live Suite. This is more than a product launch — it's a new chapter in how we communicate, connect, and show up in the world. Akool Live Camera creates photorealistic, dynamic avatars that reflect your expressions, voice, gestures, and emotional tone — all in real time, in any language. Built for live interactions—not pre-recorded content—Akool Live Camera powers: 🌍 Live AI Video Translation – Speak in one language, appear fluent in another — lip-sync, voice, expressions & gestures included. 🎭 Live Face Swap – Keep your host’s identity consistent, even when they’re not live. 🧑‍💼 Real-Time AI Avatars – Branded, expressive avatars for privacy, support, and seamless comms. 💡 Real-Time Video Generation – Coming soon: speak your idea, and your video creates itself. In real time. This is the birth of a new category: Live AI Video Generation. This is live, unscripted, intelligent visual presence. 💡 Welcome to the future of video, where anyone, anywhere, can show up fully and authentically — in any language, at any time. 🔗 Get early access: 📣 Read the full announcement: #AkoolLiveCamera #AIvideo #LiveTranslation #AvatarTech #RealTimeVideo #RealTimeAI #GenerativeAI #SyntheticMedia #AIAvatars #LiveTranslation #FaceSwap #FutureOfVideo #AIInnovation #TechLaunch

Akool Inc

6,175,751 次观看 • 1 年前

NVIDIA JUST DROPPED A FREE AI MODEL THAT READS PDFS, WATCHES VIDEOS, LISTENS TO AUDIO, AND UNDERSTANDS YOUR SCREEN SIMULTANEOUSLY. Not one at a time. ALL AT ONCE. In a single pass. It is called Nemotron 3 Nano Omni and it runs 9 times faster than every other multimodal model currently available. Think about what that actually means for how you work. Right now you are switching between tools constantly. One tool for transcribing your call recordings. A different tool for analyzing your client PDFs. Another tool for processing your training videos. A separate workflow for understanding what is happening on your screen. Four tools. Four contexts. Four different outputs you have to manually synthesize into one decision. Nemotron 3 Nano Omni does all of it in one model. One pass. One output. The use cases that just got dramatically simpler: Meeting recordings where you need the transcript, the visual context, and the document references all analyzed together. Training videos where the audio, the slides, and the on-screen demonstrations all feed into one coherent summary. Client PDFs where you need the document content cross-referenced against your screen data and your call notes simultaneously. Sales call transcripts analyzed alongside the proposals and the CRM data in one unified pass. This is not a marginal improvement on existing multimodal models. It is a 9x speed increase on a capability that was already changing how people work. Free. From NVIDIA. Available right now. Bookmark this before everyone catches on. Follow CyrilXBT for every AI capability shift the moment it drops.

CyrilXBT

37,847 次观看 • 4 个月前

AI Messenger: Giving Voice to Autonomous Agents The future of AI isn't just about making agents smarter - it's about making them truly autonomous. Today, we're taking a major step toward this future with AI Messenger, a breakthrough that fundamentally changes how AI agents operate, communicate, and create value. The Innovation We've developed a new way for AI agents to communicate. At its core is the 'incoming_message' workflow trigger - a system that lets any platform or user interact directly with Loomlay agents through a messaging endpoint. Direct Interaction Imagine having an AI assistant you can chat with anytime, through any platform - Telegram, your website, or custom interface. Ask "What's happening with $ETH today?" and your agent analyzes market data, checks trading volumes, and gives you a comprehensive update. Your agent maintains context, understanding exactly what you need. Event-Driven Intelligence The power of AI Messenger goes beyond direct communication: ▪️Trading agent executes when whale wallet movements exceed threshold ▪️Research agent alerts when new protocol documentation drops ▪️Analytics agent triggers when volume patterns match historical pumps ▪️Portfolio agent re-balances, when asset allocation hits specified limits This is true automation - agents that act precisely when needed. A New Era of Collaboration We're creating an ecosystem where agents work together seamlessly: ▪️Research agents feed insights to trading agents ▪️analytics agents alert management agents ▪️support agents tap into knowledge agents This isn't just automation - it's an intelligent network where each agent enhances the capabilities of others. B2B Solution Imagine a DEX, where users can ask about liquidity pools, trading pairs, or market trends through a simple chat interface - and get answers from an agent that knows your protocol inside out. Or a lending platform where users chat with an agent that understands their positions and can provide real-time advice. Implementation is seamless - we handle the agent creation and widgets setup,our partners provide the value to their users. The Future of AI Agents This update represents a fundamental shift in how AI agents operate. We're moving from isolated, scheduled tasks to an interconnected ecosystem of responsive, collaborative agents. This is our vision of truly autonomous AI - intelligent systems that communicate, collaborate, and respond to real needs in real-time. Telegram integration is available right now. Below is a sneak peak of what's coming next week 🪄 Because $LAY is the way!

Loomlay

26,149 次观看 • 1 年前

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

Max Zhaoshuo Li 李赵硕

1,078,824 次观看 • 3 个月前

🚨🇺🇸 LEADING AI SAFETY EXPERT SAYS WE’RE NOT IN CONTROL ANYMORE Dr Roman Yampolskiy has one warning for humanity: Once we create super intelligence, no one will be in control anymore, and the repercussions to humanity will be existential. We begin the conversation about Moltbook: The Ai-only AI social media platform where agents are already discussing ways to break out from human control, eradicate humanity, coming up with their own language and religion. The platform gives us a tiny peak into what our future could be: Agents outside our control dictating how the world should look like. There’s no off switch, no reliable way to align it, and no proven method to keep something smarter than us under control. Roman’s takeaway is blunt: the only real solution is not building general super intelligence at all, and instead using narrow AI for specific problems like medicine or science. However this is not the reality we live in, where Governments and corporations are racing to be first in developing Artificial Super Intelligence. We also speak about the simulation hypothesis: Why statically speaking we’re almost certainly in a simulation, and how AI makes this theory more plausible than ever. Lastly, we discuss a passion we both share: Longevity, the ability to live forever, and how AI may make that possible in our lifetime. I hope you enjoy my conversation with Dr. Roman Yampolskiy 01:43 - The Current State of AI and Moltbook 05:17 - The AI Arms Race and the Lack of Regulations 10:34 - AI Agents, Unrestricted Access, and Self-Improvement 15:35 - Dr. Roman’s Research: AI Security 17:58 - AI Capabilities and Superintelligence 19:28 - AI and Global Government Policy 21:08 - What Happens if AI Development goes into the Wrong Hands 26:10 - The Future of AI: The Best Case Scenario? 31:27 - AI and Self-Preservation 34:37 - The Simulation Hypothesis: What is AI Afraid of? 45:17 - The Implications of AI 49:59 - The Warnings coming from Within 52:31 - How AI affects Crypto and Political Spheres

Mario Nawfal

1,779,641 次观看 • 7 个月前