Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Throughout my journey in developing multimodal models, I’ve always wanted a framework that lets me plug & play modality encoders/decoders on top of an auto-regressive LLM. I want to prototype fast, try new architectures, and have my demo files scale effortlessly — with full support for parallelism and optimization....

Brian_Bo_Li's profile picture

Brian Li

2,988 subscribers

54,757 görüntüleme • 7 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

🚨 New: Integrating Harbor (Harbor Framework) for end-to-end Computer-Use evaluation(for Windows and Linux) at scale with Thinking Machines' Tinker, OSWorld, Daytona, and bare-metal servers. We just added support for Computer Use, Tinker, and OSWorld to Harbor - a framework for evaluating agents and generating RL training data by running large-scale rollouts across parallel sandboxed environments and collecting trajectories for SFT and RL. Repo and blogpost below 👇
0:16

🚨 New: Integrating Harbor (Harbor Framework) for end-to-end Computer-Use evaluation(for Windows and Linux) at scale with Thinking Machines' Tinker, OSWorld, Daytona, and bare-metal servers. We just added support for Computer Use, Tinker, and OSWorld to Harbor - a framework for evaluating agents and generating RL training data by running large-scale rollouts across parallel sandboxed environments and collecting trajectories for SFT and RL. Repo and blogpost below 👇

Marco Mascorro

19,448 görüntüleme • 3 ay önce

GROK DOMINATES AI AT SCALE, REDEFINING WHAT’S POSSIBLE IN REAL TIME Most AI models stall at the prototype phase. Grok advances beyond limits where others fail to perform. •⁠ ⁠Built for real-time decisioning across vast data landscapes •⁠ ⁠Optimized to process, synthesize, and respond with human-like fluidity •⁠ ⁠Deploys intelligence at the edge, not just in the cloud •⁠ ⁠Powers robotics, research, and infrastructure in live environments •⁠ ⁠Infrastructure built to evolve, not collapse, under scale Grok delivers high-performance AI built for deployment and real-world use. Source: xAI, Grok, Elon Musk
0:16

GROK DOMINATES AI AT SCALE, REDEFINING WHAT’S POSSIBLE IN REAL TIME Most AI models stall at the prototype phase. Grok advances beyond limits where others fail to perform. •⁠ ⁠Built for real-time decisioning across vast data landscapes •⁠ ⁠Optimized to process, synthesize, and respond with human-like fluidity •⁠ ⁠Deploys intelligence at the edge, not just in the cloud •⁠ ⁠Powers robotics, research, and infrastructure in live environments •⁠ ⁠Infrastructure built to evolve, not collapse, under scale Grok delivers high-performance AI built for deployment and real-world use. Source: xAI, Grok, Elon Musk

Mario Nawfal

28,837 görüntüleme • 5 ay önce

Show-o One Single Transformer to Unify Multimodal Understanding and Generation discuss: We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model.
0:13

Show-o One Single Transformer to Unify Multimodal Understanding and Generation discuss: We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model.

AK

124,042 görüntüleme • 1 yıl önce

Something NVIDIA & Google do better than anyone else is software-hardware-system co-design, and not just optimizing hardware for current model architectures, but predicting future ones. Back in early 2022, when NVIDIA started the design process for NVL72, MoE (Mixture of Experts) models were not yet the standard, and dense models were still dominant for frontier models. However, NVIDIA's strong software-hardware co-design culture enabled them to make a calculated bet that MoEs were the future, and they built NVL72 specifically for best MoE performance per TCO (Total Cost of Ownership). Furthermore, back in 2022, disaggregated prefill and wide expert parallelism (wideEP) MoE inference optimizations hadn't been invented yet, but it turns out that these MoE inference optimizations work best on large-scale systems like NVL72. While most other AI chip companies' in-house AI labs focus on training small 5B models that mainly use data parallelism, NVIDIA and Google's in-house AI labs continuously push the boundaries of model architecture and training recipes, such as NVFP4 training. Just like Super Idol & IShowSpeed, there must be a strong partnership between software engineers and hardware engineers to deliver the best systems that maximize performance per TCO.
0:14

Something NVIDIA & Google do better than anyone else is software-hardware-system co-design, and not just optimizing hardware for current model architectures, but predicting future ones. Back in early 2022, when NVIDIA started the design process for NVL72, MoE (Mixture of Experts) models were not yet the standard, and dense models were still dominant for frontier models. However, NVIDIA's strong software-hardware co-design culture enabled them to make a calculated bet that MoEs were the future, and they built NVL72 specifically for best MoE performance per TCO (Total Cost of Ownership). Furthermore, back in 2022, disaggregated prefill and wide expert parallelism (wideEP) MoE inference optimizations hadn't been invented yet, but it turns out that these MoE inference optimizations work best on large-scale systems like NVL72. While most other AI chip companies' in-house AI labs focus on training small 5B models that mainly use data parallelism, NVIDIA and Google's in-house AI labs continuously push the boundaries of model architecture and training recipes, such as NVFP4 training. Just like Super Idol & IShowSpeed, there must be a strong partnership between software engineers and hardware engineers to deliver the best systems that maximize performance per TCO.

SemiAnalysis

51,021 görüntüleme • 6 ay önce

We are entering an extremely exciting era for open-weight models. Kimi K2.6 now feels like a top agentic model. I took it for a spin via Fireworks AI fast inference APIs. Kimi K2.6 has impressive agentic capabilities, design skills, and the ability to synthesize large amounts of information. I built a little Skill that produces survey papers on any AI research topic you want. (see example in the clip) You can use the skill to tell your agent to generate a survey on whatever topic and watch it go to work. The artifact was fully generated by Kimi.ai's Kimi K2.6. It's cheap and fast. Next step for me is to explore ways to continue integrating the capabilities of these models on use cases like automating my LLM knowledge bases and augmenting my agent memory capabilities. Stay tuned for more.
0:19

We are entering an extremely exciting era for open-weight models. Kimi K2.6 now feels like a top agentic model. I took it for a spin via Fireworks AI fast inference APIs. Kimi K2.6 has impressive agentic capabilities, design skills, and the ability to synthesize large amounts of information. I built a little Skill that produces survey papers on any AI research topic you want. (see example in the clip) You can use the skill to tell your agent to generate a survey on whatever topic and watch it go to work. The artifact was fully generated by Kimi.ai's Kimi K2.6. It's cheap and fast. Next step for me is to explore ways to continue integrating the capabilities of these models on use cases like automating my LLM knowledge bases and augmenting my agent memory capabilities. Stay tuned for more.

elvis

47,678 görüntüleme • 1 ay önce

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch
0:11

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 görüntüleme • 4 ay önce

I wanted to test one of the models out and so I made a chica walking cycle for the fun of it. ============= Please note that it's not suppose to be really accurate to the movie, but have that taste from the movie. THIS IS ALSO NOT RELATED TO MY PROJECT!!
0:17

I wanted to test one of the models out and so I made a chica walking cycle for the fun of it. ============= Please note that it's not suppose to be really accurate to the movie, but have that taste from the movie. THIS IS ALSO NOT RELATED TO MY PROJECT!!

UNKNOWNSPECIM3N

38,177 görüntüleme • 2 yıl önce

Dexter can now use local LLMs. We finally added ollama support today. Includes models like: • qwen 3 • gemma 3 • deepseek r1 Because Dexter is built on LangChain, switching between local and cloud models is easy. Huge thanks to Harsh Gupta for shipping this.
0:14

Dexter can now use local LLMs. We finally added ollama support today. Includes models like: • qwen 3 • gemma 3 • deepseek r1 Because Dexter is built on LangChain, switching between local and cloud models is easy. Huge thanks to Harsh Gupta for shipping this.

virat

36,456 görüntüleme • 5 ay önce

We are thrilled to announce that we have the support Solana as we build and scale the next $STAGE of our journey. Together, we’re paving the way for innovation and growth 🚀
0:17

We are thrilled to announce that we have the support Solana as we build and scale the next $STAGE of our journey. Together, we’re paving the way for innovation and growth 🚀

STAGE

2,281,273 görüntüleme • 1 yıl önce

Introducing Jan v3, with updates to Jan Desktop v0.7.6 💛 Jan v3 is our first v3 model, a 4B base built for fine-tuning and fast local use, with stronger math and coding. This release also includes a small Jan Desktop update, starting with a UI refresh as we move toward a more unified Jan experience. Try it: - Jan v3 is available in Jan Desktop and at - Get the latest desktop app at Model: - Jan-v3-4B: - Jan-v3-4B-GGUF: Thanks Qwen for the base model and Georgi Gerganov for llama.cpp 💛
0:17

Introducing Jan v3, with updates to Jan Desktop v0.7.6 💛 Jan v3 is our first v3 model, a 4B base built for fine-tuning and fast local use, with stronger math and coding. This release also includes a small Jan Desktop update, starting with a UI refresh as we move toward a more unified Jan experience. Try it: - Jan v3 is available in Jan Desktop and at - Get the latest desktop app at Model: - Jan-v3-4B: - Jan-v3-4B-GGUF: Thanks Qwen for the base model and Georgi Gerganov for llama.cpp 💛

👋 Jan

53,881 görüntüleme • 4 ay önce

Introducing Arcana. The only framework that lets you build and run a complete onchain app in one place. Built for the way people build now. Prompt it, deploy it, run it onchain, all from one framework with no infrastructure to assemble.
0:11

Introducing Arcana. The only framework that lets you build and run a complete onchain app in one place. Built for the way people build now. Prompt it, deploy it, run it onchain, all from one framework with no infrastructure to assemble.

Arcana

72,429 görüntüleme • 27 gün önce

Today we're officially launching Moby 2 to the world (and to our full house at The Whalies in Los Angeles). It is the only AI ecommerce brands can trust to do work for them. We’re also launching: • Moby Specialists, purpose-built AI specialists for media buying, creative, and conversion optimization • Compass, our new unified measurement system combining attribution, incrementality, and MMM • New upgrades to Sonar Optimize (including attribution passback) and Clicks & Deterministic Views Attribution Built on data from 60,000+ brands and $82B in tracked revenue, Triple Whale is the AI operating system for ecommerce, and Moby 2 is the operator, always working for you. See it in action:
0:11

Today we're officially launching Moby 2 to the world (and to our full house at The Whalies in Los Angeles). It is the only AI ecommerce brands can trust to do work for them. We’re also launching: • Moby Specialists, purpose-built AI specialists for media buying, creative, and conversion optimization • Compass, our new unified measurement system combining attribution, incrementality, and MMM • New upgrades to Sonar Optimize (including attribution passback) and Clicks & Deterministic Views Attribution Built on data from 60,000+ brands and $82B in tracked revenue, Triple Whale is the AI operating system for ecommerce, and Moby 2 is the operator, always working for you. See it in action:

Triple Whale 🐳

995,215 görüntüleme • 29 gün önce

I built a Claude agent for Meta ads ...that analyzes your account and tells you exactly what to fix to scale profitably Comment "SCALE" and I'll send you the full workflow 👀
0:16

I built a Claude agent for Meta ads ...that analyzes your account and tells you exactly what to fix to scale profitably Comment "SCALE" and I'll send you the full workflow 👀

Dom

92,182 görüntüleme • 2 ay önce

We’re not just training models anymore. We’re deploying intelligence at scale. On the latest episode of Advanced Insights, AMD CTO MarkPapermaster sits down with Oracle's Chris Gandolfo to talk AI, infrastructure, and what it really takes to train and deploy LLMs at scale.
0:16

We’re not just training models anymore. We’re deploying intelligence at scale. On the latest episode of Advanced Insights, AMD CTO MarkPapermaster sits down with Oracle's Chris Gandolfo to talk AI, infrastructure, and what it really takes to train and deploy LLMs at scale.

AMD

16,961 görüntüleme • 11 ay önce

Happy to introduce my video on this alternative LLM architecture, Mamba and State Space Models! I wanted to do it for a while now and finally found the time to work on animating my visual guide. Expect many, many, many visuals! Link in comment 👇
0:11

Happy to introduce my video on this alternative LLM architecture, Mamba and State Space Models! I wanted to do it for a while now and finally found the time to work on animating my visual guide. Expect many, many, many visuals! Link in comment 👇

Maarten Grootendorst

34,041 görüntüleme • 1 yıl önce

We are excited to launch our two models Pharia-1-LLM-7B-control and Pharia-1-LLM-7B-control-aligned. Both models and the code used to train them are now publicly available and open-sourced for non-commercial research and educational use. Read our model blog post here: Learn more about our open-source codebase Scaling: #writtenbyalephalpha
0:13

We are excited to launch our two models Pharia-1-LLM-7B-control and Pharia-1-LLM-7B-control-aligned. Both models and the code used to train them are now publicly available and open-sourced for non-commercial research and educational use. Read our model blog post here: Learn more about our open-source codebase Scaling: #writtenbyalephalpha

Aleph Alpha

44,326 görüntüleme • 1 yıl önce

Backlog → shipped. Engine is a remote AI software engineer built for pros. It integrates with all of your existing tools and supports any frontier LLM.
0:11

Backlog → shipped. Engine is a remote AI software engineer built for pros. It integrates with all of your existing tools and supports any frontier LLM.

cto.new

51,179 görüntüleme • 10 ay önce

1/ Happy to share UniDisc - Unified Multimodal Discrete Diffusion – We train a 1.5 billion parameter transformer model from scratch on 250 million image/caption pairs using a **discrete diffusion objective**. Our model has all the benefits of diffusion models but now in multimodal space! - flexible compute-quality tradeoff, zero-shot inpainting and editing, better control via classifier-free guidance and lower latency! We open source everything - our code, weights and the training dataset.
0:10

1/ Happy to share UniDisc - Unified Multimodal Discrete Diffusion – We train a 1.5 billion parameter transformer model from scratch on 250 million image/caption pairs using a **discrete diffusion objective**. Our model has all the benefits of diffusion models but now in multimodal space! - flexible compute-quality tradeoff, zero-shot inpainting and editing, better control via classifier-free guidance and lower latency! We open source everything - our code, weights and the training dataset.

Mihir Prabhudesai

104,862 görüntüleme • 1 yıl önce

Social media really messes with your head and your sense of reality, especially when it comes to what you’re supposed to look like. Women’s bodies come in all shapes and sizes! I’ve birthed 3 babies! I have extra skin, I’ll always have a “belly” (I’ve had a curve to my stomach since HS no matter how tiny I was) some women are built like that. I have hip dips and cellulite. And guess what I love my body! I workout and fuel my body with healthy foods to be strong and to enjoy my life and not be a slave to a scale or mirror. Let’s normalize normal bodies! ALL BODIES ARE BEAUTIFUL💗 #bodypositivity
0:11

Social media really messes with your head and your sense of reality, especially when it comes to what you’re supposed to look like. Women’s bodies come in all shapes and sizes! I’ve birthed 3 babies! I have extra skin, I’ll always have a “belly” (I’ve had a curve to my stomach since HS no matter how tiny I was) some women are built like that. I have hip dips and cellulite. And guess what I love my body! I workout and fuel my body with healthy foods to be strong and to enjoy my life and not be a slave to a scale or mirror. Let’s normalize normal bodies! ALL BODIES ARE BEAUTIFUL💗 #bodypositivity

Nora Rose🌹

133,894 görüntüleme • 3 ay önce

NVIDIA AI Released DiffusionRenderer: An AI Model for Editable, Photorealistic 3D Scenes from a Single Video In a groundbreaking new paper, researchers at NVIDIA, University of Toronto, Vector Institute and the University of Illinois Urbana-Champaign have unveiled a framework that directly tackles this challenge. DiffusionRenderer represents a revolutionary leap forward, moving beyond mere generation to offer a unified solution for understanding and manipulating 3D scenes from a single video. It effectively bridges the gap between generation and editing, unlocking the true creative potential of AI-driven content. DiffusionRenderer treats the “what” (the scene’s properties) and the “how” (the rendering) in one unified framework built on the same powerful video diffusion architecture that underpins models like Stable Video Diffusion..... Read full article here: Paper: GitHub Page: NVIDIA NVIDIA AI NVIDIAnewsroom NVIDIA AIDev
0:10

NVIDIA AI Released DiffusionRenderer: An AI Model for Editable, Photorealistic 3D Scenes from a Single Video In a groundbreaking new paper, researchers at NVIDIA, University of Toronto, Vector Institute and the University of Illinois Urbana-Champaign have unveiled a framework that directly tackles this challenge. DiffusionRenderer represents a revolutionary leap forward, moving beyond mere generation to offer a unified solution for understanding and manipulating 3D scenes from a single video. It effectively bridges the gap between generation and editing, unlocking the true creative potential of AI-driven content. DiffusionRenderer treats the “what” (the scene’s properties) and the “how” (the rendering) in one unified framework built on the same powerful video diffusion architecture that underpins models like Stable Video Diffusion..... Read full article here: Paper: GitHub Page: NVIDIA NVIDIA AI NVIDIAnewsroom NVIDIA AIDev

Marktechpost AI Dev News ⚡

104,741 görüntüleme • 11 ay önce