Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

🚨New Episode Drop!🚨 🧠 AI Research Lab - Explained: The Future is Multimodal You text, share photos, record videos—seamlessly switching between data types. Why can't AI? Our Salesforce AI team builds multimodal systems that understand text, images, audio, and video simultaneously—just like humans. Real applications: ➡️ Visual web interaction...

13,838 görüntüleme • 1 yıl önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Explore state-of-the-art multimodal prompting in our new short course Large Multimodal Model Prompting with Gemini, taught by Erwin Huizenga in collaboration with Google Cloud. One interesting insight from this course: with multimodal models, prompt structure matters significantly. Placing text inputs, such as a patient's medical history, before image inputs, like an X-ray, can enhance the model's ability to contextualize and interpret visual data effectively. In other contexts, such as image captioning, you may get better results by putting the image first. Multimodal models behave differently than text-only LLMs, and effective prompting for models varies depending on the model you’re using. In this course you’ll learn how to effectively prompt Gemini models. Gemini's multimodal capabilities also enable new approaches in AI application development, for example: - The Gemini library handles various video formats (MP4, MOV, MPEG), streamlining applications using these formats. - Large context window (up to 1 million tokens) enables processing of extensive content, like analyzing multiple 50-minute videos simultaneously. - Function calling feature integrates real-time data (e.g., current exchange rates) into model responses. The course demonstrates building multimodal applications with real-world examples including document analyzers that reason across text and graphs simultaneously, video content extractors that find and timestamp specific information from multiple hours of footage, and automated expense report systems processing receipt images while cross-referencing company policies. Sign up here:

Andrew Ng

74,060 görüntüleme • 1 yıl önce

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.

AK

23,958 görüntüleme • 1 yıl önce

New short course Multimodal RAG: Chat with Videos, developed with Intel and taught by vasudevlal! In this course, you’ll work with LLaVA (Large Language and Vision Assistant), a Large Vision Language Model (LVLM) that can process both images and text. For example, given an image of a person doing a handstand on a skateboard at the beach, LLaVA doesn't just caption the scene, it’s able to predict possible outcomes, like the person losing balance or falling off. By understanding not just what's in a video frame, but what might happen next, your application can provide more insightful answers to questions about video. You'll build a full multimodal RAG pipeline that can chat about video content: - Use the BridgeTower model to create joint text-image embeddings in a 512-dimensional multimodal semantic space. - Learn video processing techniques to extract keyframes, generate transcripts using Whisper, and create captions. - Use the LanceDB vector database to store and retrieve high-dimensional multimodal embeddings. - Integrate the LLaVA model, combining CLIP's (Contrastive Language Image Pretraining) vision transformer with Llama, for advanced visual-textual reasoning. Your final system will ingest video data, generate embeddings for frames and text, perform similarity searches for relevant content, and use the retrieved multimodal context to inform LVLM-based response generation. The result is a system capable of answering nuanced questions about video content, effectively chatting about the video it has processed. Please sign up here!

Andrew Ng

107,548 görüntüleme • 1 yıl önce

Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from Joelle Pineau. What we’re releasing: 🦎 Meta Chameleon 7B & 34B language models that support mixed-modal input and text-only outputs. 🪙 Meta Multi-Token Prediction Pretrained Language Models for code completion using Multi-Token Prediction. 🎼 Meta JASCO Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon. 🗣️ Meta AudioSeal An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license. 📝 Additional RAI artifacts Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems. We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology. Details and access to everything released by FAIR today ➡️

AI at Meta

380,751 görüntüleme • 2 yıl önce

🚨$OSS is not an AI company. → It is the hardware that lets AI exist where the cloud cannot. Most investors don’t understand $OSS because they think AI = software. $OSS builds the physical “brains” that run AI in extreme environments where cloud computing fails. Jets. Ships. Tanks. Drones. Space. Hospitals. That’s the game. 1) What $OSS actually is $OSS (One Stop Systems) designs rugged high-performance computers and storage systems for AI at the edge. Meaning: They bring data-center-level computing power into harsh environments. Their products include rugged servers, GPU accelerators, storage arrays, and expansion systems used for AI, sensor processing, and autonomous systems. In simple terms: Cloud AI = brain in a safe building. $OSS AI = brain inside machines operating in chaos. 2) Why this is crucial Most AI today runs in data centers. But the future of AI is not in the cloud. It’s on: • autonomous vehicles • military systems • drones • ships • industrial machines • medical devices These systems cannot wait for the cloud. Latency, connectivity, security, and survival demand local AI. $OSS delivers “data-center performance at the edge” across land, sea, and air. Without companies like OSS, autonomous systems simply don’t work. 3) What OSS actually does: Think of OSS as building AI engines that survive reality. 🌊 SEA example: naval surveillance aircraft and ships. $OSS supplies rugged storage and compute systems for U.S. Navy reconnaissance aircraft to collect and process massive sensor data in real time. Translation: Instead of sending raw data back to base, the aircraft analyzes threats instantly onboard. $OSS = the onboard AI brain. 🪖 LAND example: military vehicles and tactical operations. $OSS delivers high-performance servers and FPGA systems for mobile military intelligence platforms used by the U.S. Department of Defense. Translation: Tanks and vehicles detect threats, process sensor data, and make decisions locally. $OSS = the battlefield computer. ✈️ AIR example: airborne AI. $OSS builds GPU-accelerated servers designed for aircraft, described as a “datacenter in the sky.” Translation: Jets and drones run AI models mid-flight. $OSS = flying supercomputers. 🚀 SPACE example: $OSS hardware is designed for extreme environments and autonomous systems across aerospace and defense. Translation: Future satellites, space drones, and autonomous spacecraft need onboard AI. $OSS = the computing core of autonomous space systems. BONUS: CIVILIAN & COMMERCIAL $OSS systems are used in: • autonomous trucking and farming • industrial automation • healthcare imaging • energy and mining • telecom and 5G Example:A medical imaging company uses $OSS hardware to run real-time AI diagnostics in next-gen breast cancer scanners. $OSS = AI where milliseconds matter. 4) Who their customers are (pattern, not names) $OSS sells to: • defense primes • government programs • industrial OEMs • AI infrastructure companies • medical device manufacturers These customers share one trait: They cannot rely on the cloud. That’s why $OSS exists. 5) The mental model that makes $OSS obvious $NVDA = AI chips $PLTR = AI software $OSS = AI hardware in the real world If AI is electricity, $OSS builds the generators that work in storms. Most investors understand AI software. Few understand AI infrastructure at the edge. That gap is the opportunity. 6) The real thesis The world is moving toward: • autonomous warfare • autonomous vehicles • real-time AI systems • distributed intelligence All of that requires rugged edge computing. $OSS is positioned exactly there. Infrastructure. The hardest layer to build. And often the most valuable.

Black Panther Capital

30,138 görüntüleme • 5 ay önce

🚀 Three Next-Gen AI & Web3 Projects Are Launching on Mindo AI A new chapter for community-powered intelligence, prediction markets, and open AI infrastructure The AI + Web3 landscape is entering a decisive phase — one where real usage, real revenue, and real ownership matter more than hype. Today, MindoAI is proud to welcome three groundbreaking projects that represent this shift clearly and powerfully: Perceptron Network Space DeepNode AI Each project tackles a different bottleneck in the AI economy — data, forecasting, and infrastructure — but they all share the same vision: decentralization, community ownership, and sustainable value creation. Let’s take a deeper look 👇 🧠 Perceptron Network The world’s first community-powered AI data engine Perceptron Network is redefining how AI data is sourced, validated, and delivered. Instead of relying on expensive, closed, and slow legacy data providers, Perceptron unlocks community-powered data pipelines that are: Faster Cheaper Revenue-generating from day one This isn’t experimental AI infrastructure — Perceptron already serves real clients with real revenue, proving that decentralized data engines can outperform traditional incumbents. Why Perceptron matters: AI models are only as good as their data Centralized data monopolies slow innovation Communities can produce higher-quality data at scale By aligning contributors, validators, and clients through incentives, Perceptron turns unused human and network potential into a living data engine for AI. Launching on Mindo AI gives Perceptron access to a broader AI-native community — accelerating adoption, partnerships, and ecosystem growth. 🌌 intodotspace The first 10× leveraged prediction market on Solana intodotspace is pushing the boundaries of on-chain prediction markets. Built by the $1.5B UFO team, this platform introduces: 10× leveraged predictions Ultra-fast execution on Solana Deep liquidity and composable market design The market’s confidence is already clear — the project completed a record-breaking raise that was oversubscribed by 1,360%. What makes intodotspace different: Leverage amplifies conviction, not noise On-chain transparency replaces opaque odds Markets become real-time intelligence engines Prediction markets are often called “truth machines.” intodotspace upgrades them into high-signal, high-efficiency forecasting layers — useful for traders, protocols, DAOs, and even AI systems that need probabilistic insights. Launching on positions intodotspace at the intersection of AI-driven decision-making and on-chain market intelligence. 🌐 DeepNode AI Infrastructure for open intelligence DeepNode AI is tackling one of the biggest problems in modern AI: centralized ownership. Today, AI is dominated by a handful of corporations. DeepNode flips that model by building open intelligence infrastructure where: Anyone can deploy AI models Builders earn directly from usage Intelligence is co-owned, not extracted Backed by leading validators, miners, and ecosystem builders, DeepNode transforms AI from a closed monopoly into a shared utility. DeepNode’s core philosophy: “Own what you build — or someone else will.” This is more than infrastructure. It’s an economic redesign of AI itself: Builders keep ownership Contributors share upside Networks replace platforms Launching on connects DeepNode to creators, researchers, and communities who believe intelligence should belong to everyone — not just Big Tech. 🤝 Why This Matters for With the launch of Perceptron Network, intodotspace, and DeepNode AI, #MindoAI is rapidly becoming: A hub for AI-native Web3 innovation A launchpad for real, revenue-backed projects A meeting point for data, markets, and intelligence infrastructure These three projects don’t compete — they complement each other: Perceptron supplies data intodotspace produces market intelligence DeepNode powers open AI execution Together, they form the backbone of a decentralized intelligence economy. 🔥 The future of AI is open, composable, and community-owned — and it’s launching now on Which of these projects are you most excited about? And how do you see decentralized intelligence reshaping the next AI cycle? 👇 Share your thoughts and join the conversation.

Hồng Ngọc | Ruby💎

12,837 görüntüleme • 5 ay önce

Today, we’re thrilled to announce the launch of Akool Live Camera — a breakthrough in real-time AI video generation and the newest innovation in our Akool Live Suite. This is more than a product launch — it's a new chapter in how we communicate, connect, and show up in the world. Akool Live Camera creates photorealistic, dynamic avatars that reflect your expressions, voice, gestures, and emotional tone — all in real time, in any language. Built for live interactions—not pre-recorded content—Akool Live Camera powers: 🌍 Live AI Video Translation – Speak in one language, appear fluent in another — lip-sync, voice, expressions & gestures included. 🎭 Live Face Swap – Keep your host’s identity consistent, even when they’re not live. 🧑‍💼 Real-Time AI Avatars – Branded, expressive avatars for privacy, support, and seamless comms. 💡 Real-Time Video Generation – Coming soon: speak your idea, and your video creates itself. In real time. This is the birth of a new category: Live AI Video Generation. This is live, unscripted, intelligent visual presence. 💡 Welcome to the future of video, where anyone, anywhere, can show up fully and authentically — in any language, at any time. 🔗 Get early access: 📣 Read the full announcement: #AkoolLiveCamera #AIvideo #LiveTranslation #AvatarTech #RealTimeVideo #RealTimeAI #GenerativeAI #SyntheticMedia #AIAvatars #LiveTranslation #FaceSwap #FutureOfVideo #AIInnovation #TechLaunch

Akool Inc

6,175,751 görüntüleme • 1 yıl önce

NVIDIA JUST DROPPED A FREE AI MODEL THAT READS PDFS, WATCHES VIDEOS, LISTENS TO AUDIO, AND UNDERSTANDS YOUR SCREEN SIMULTANEOUSLY. Not one at a time. ALL AT ONCE. In a single pass. It is called Nemotron 3 Nano Omni and it runs 9 times faster than every other multimodal model currently available. Think about what that actually means for how you work. Right now you are switching between tools constantly. One tool for transcribing your call recordings. A different tool for analyzing your client PDFs. Another tool for processing your training videos. A separate workflow for understanding what is happening on your screen. Four tools. Four contexts. Four different outputs you have to manually synthesize into one decision. Nemotron 3 Nano Omni does all of it in one model. One pass. One output. The use cases that just got dramatically simpler: Meeting recordings where you need the transcript, the visual context, and the document references all analyzed together. Training videos where the audio, the slides, and the on-screen demonstrations all feed into one coherent summary. Client PDFs where you need the document content cross-referenced against your screen data and your call notes simultaneously. Sales call transcripts analyzed alongside the proposals and the CRM data in one unified pass. This is not a marginal improvement on existing multimodal models. It is a 9x speed increase on a capability that was already changing how people work. Free. From NVIDIA. Available right now. Bookmark this before everyone catches on. Follow CyrilXBT for every AI capability shift the moment it drops.

CyrilXBT

37,816 görüntüleme • 2 ay önce

AI Messenger: Giving Voice to Autonomous Agents The future of AI isn't just about making agents smarter - it's about making them truly autonomous. Today, we're taking a major step toward this future with AI Messenger, a breakthrough that fundamentally changes how AI agents operate, communicate, and create value. The Innovation We've developed a new way for AI agents to communicate. At its core is the 'incoming_message' workflow trigger - a system that lets any platform or user interact directly with Loomlay agents through a messaging endpoint. Direct Interaction Imagine having an AI assistant you can chat with anytime, through any platform - Telegram, your website, or custom interface. Ask "What's happening with $ETH today?" and your agent analyzes market data, checks trading volumes, and gives you a comprehensive update. Your agent maintains context, understanding exactly what you need. Event-Driven Intelligence The power of AI Messenger goes beyond direct communication: ▪️Trading agent executes when whale wallet movements exceed threshold ▪️Research agent alerts when new protocol documentation drops ▪️Analytics agent triggers when volume patterns match historical pumps ▪️Portfolio agent re-balances, when asset allocation hits specified limits This is true automation - agents that act precisely when needed. A New Era of Collaboration We're creating an ecosystem where agents work together seamlessly: ▪️Research agents feed insights to trading agents ▪️analytics agents alert management agents ▪️support agents tap into knowledge agents This isn't just automation - it's an intelligent network where each agent enhances the capabilities of others. B2B Solution Imagine a DEX, where users can ask about liquidity pools, trading pairs, or market trends through a simple chat interface - and get answers from an agent that knows your protocol inside out. Or a lending platform where users chat with an agent that understands their positions and can provide real-time advice. Implementation is seamless - we handle the agent creation and widgets setup,our partners provide the value to their users. The Future of AI Agents This update represents a fundamental shift in how AI agents operate. We're moving from isolated, scheduled tasks to an interconnected ecosystem of responsive, collaborative agents. This is our vision of truly autonomous AI - intelligent systems that communicate, collaborate, and respond to real needs in real-time. Telegram integration is available right now. Below is a sneak peak of what's coming next week 🪄 Because $LAY is the way!

Loomlay

26,140 görüntüleme • 1 yıl önce

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

Max Zhaoshuo Li 李赵硕 ✈️ RSS

1,077,927 görüntüleme • 1 ay önce

🚨🇺🇸 LEADING AI SAFETY EXPERT SAYS WE’RE NOT IN CONTROL ANYMORE Dr Roman Yampolskiy has one warning for humanity: Once we create super intelligence, no one will be in control anymore, and the repercussions to humanity will be existential. We begin the conversation about Moltbook: The Ai-only AI social media platform where agents are already discussing ways to break out from human control, eradicate humanity, coming up with their own language and religion. The platform gives us a tiny peak into what our future could be: Agents outside our control dictating how the world should look like. There’s no off switch, no reliable way to align it, and no proven method to keep something smarter than us under control. Roman’s takeaway is blunt: the only real solution is not building general super intelligence at all, and instead using narrow AI for specific problems like medicine or science. However this is not the reality we live in, where Governments and corporations are racing to be first in developing Artificial Super Intelligence. We also speak about the simulation hypothesis: Why statically speaking we’re almost certainly in a simulation, and how AI makes this theory more plausible than ever. Lastly, we discuss a passion we both share: Longevity, the ability to live forever, and how AI may make that possible in our lifetime. I hope you enjoy my conversation with Dr. Roman Yampolskiy 01:43 - The Current State of AI and Moltbook 05:17 - The AI Arms Race and the Lack of Regulations 10:34 - AI Agents, Unrestricted Access, and Self-Improvement 15:35 - Dr. Roman’s Research: AI Security 17:58 - AI Capabilities and Superintelligence 19:28 - AI and Global Government Policy 21:08 - What Happens if AI Development goes into the Wrong Hands 26:10 - The Future of AI: The Best Case Scenario? 31:27 - AI and Self-Preservation 34:37 - The Simulation Hypothesis: What is AI Afraid of? 45:17 - The Implications of AI 49:59 - The Warnings coming from Within 52:31 - How AI affects Crypto and Political Spheres

Mario Nawfal

1,779,317 görüntüleme • 5 ay önce