Loading video...

Video Failed to Load

Go Home

Announcing our latest open medical AI models for developers: MedGemma 1.5, which is small enough to run offline & improves performance on 3D imaging (CT & MRI), & MedASR, a speech-to-text model for medical dictation. Both available on Hugging Face + Vertex AI. #MedGemma #HealthAI #GenerativeAI

GoogleResearch's profile picture

Google Research

104,497 subscribers

395,401 views • 7 months ago •via X (Twitter)

Health & WellnessScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing MedGemma, our most capable open model for multimodal medical text and image comprehension. 🩻 MedGemma is available now as part of Health AI Developer Foundations →
0:14

Introducing MedGemma, our most capable open model for multimodal medical text and image comprehension. 🩻 MedGemma is available now as part of Health AI Developer Foundations →

Google DeepMind

144,441 views • 1 year ago

What’s MedGemma? 🤔 It’s our collection of open, multimodal medical models that are designed to help developers build AI tools for healthcare, such as analyzing radiology images or summarizing notes for physicians. We built this demo using MedGemma to help showcase the possibilities of the model. What other use cases can you foresee for this technology?
0:14

What’s MedGemma? 🤔 It’s our collection of open, multimodal medical models that are designed to help developers build AI tools for healthcare, such as analyzing radiology images or summarizing notes for physicians. We built this demo using MedGemma to help showcase the possibilities of the model. What other use cases can you foresee for this technology?

Google AI

65,083 views • 1 year ago

Thrilled to release SmolVLM-2, our newest model, which runs entirely on-device and in realtime, offering a strong foundation for healthcare applications. 🤗🔥 With proper domain-specific training, small models enable offline inference of 2D (ECGs, CXRs) and even 3D modalities (CT, MRI) while remaining HIPAA-compliant by design. 🔒 VLMs have come a long way this year and we're excited to share our SoTA solution.
0:12

Thrilled to release SmolVLM-2, our newest model, which runs entirely on-device and in realtime, offering a strong foundation for healthcare applications. 🤗🔥 With proper domain-specific training, small models enable offline inference of 2D (ECGs, CXRs) and even 3D modalities (CT, MRI) while remaining HIPAA-compliant by design. 🔒 VLMs have come a long way this year and we're excited to share our SoTA solution.

Cyril Zakka, MD

46,435 views • 1 year ago

So much exciting open-source 2d-to-3d research being shared open-source. Here is VAST AI Research implementation of Zehuan-Huang’s paper on Hugging Face Gradio MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation
0:14

So much exciting open-source 2d-to-3d research being shared open-source. Here is VAST AI Research implementation of Zehuan-Huang’s paper on Hugging Face Gradio MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation

Matt Hartman

25,113 views • 1 year ago

The speech on the FREE open source Sesame text to speech is astonishing. It just killed Google’s voice project for podcasts and the monetization they hoped for. Here is a Hugging Face Gradio link to test: But download it and clone your voice!
0:17

The speech on the FREE open source Sesame text to speech is astonishing. It just killed Google’s voice project for podcasts and the monetization they hoped for. Here is a Hugging Face Gradio link to test: But download it and clone your voice!

Brian Roemmele

87,908 views • 1 year ago

parakeet.cpp: native C++/ggml (ggml) inference for NVIDIA AI Developer's Parakeet, one of the best speech-to-text models out there, from the LocalAI team. Every Parakeet model (TDT/CTC/RNNT/hybrid + cache-aware streaming), byte-for-byte identical output to NeMo, now running anywhere with no Python and even a bit faster, on CPU and GPU. Quantized GGUF on Hugging Face 🤗 Huge thanks to Georgi Gerganov for ggml and to NVIDIA AI Developer for releasing Parakeet! 🧵
0:13

parakeet.cpp: native C++/ggml (ggml) inference for NVIDIA AI Developer's Parakeet, one of the best speech-to-text models out there, from the LocalAI team. Every Parakeet model (TDT/CTC/RNNT/hybrid + cache-aware streaming), byte-for-byte identical output to NeMo, now running anywhere with no Python and even a bit faster, on CPU and GPU. Quantized GGUF on Hugging Face 🤗 Huge thanks to Georgi Gerganov for ggml and to NVIDIA AI Developer for releasing Parakeet! 🧵

Ettore Di Giacinto

55,955 views • 2 months ago

🚀 The Segment Anything Model (SAM) has been upgraded to SAM2, featuring an efficient image encoder for segmenting images and videos. But does SAM2 outperform SAM1 in medical image and video segmentation? We're thrilled to present our paper "Segment Anything in Medical Images and Videos: Benchmark and Deployment"! We comprehensively benchmark SAM2 across 11 medical image modalities and videos. 📄 Paper: 💻 Code: **Highlights:** 1. SAM2 doesn’t always outperform SAM1 in 2D medical images, but excels in video segmentation, making it more accurate and efficient for 3D images, such as CT and MR scans. 2. MedSAM still outperforms SAM2 on most 2D modalities, but SAM2 surpasses MedSAM for 3D image segmentation in a slice-by-slice approach. 3. Segmentation performance varies with model size; sometimes the smallest model outperforms larger ones. 4. Fine-tuning SAM2 significantly boosts its performance for medical image segmentation. While SAM2 may struggle with challenging objects that have unclear boundaries or low contrast, it excels in generating good initial segmentation masks for common medical images and videos. However, the official interface doesn’t support medical data formats and has limitations on video length. To address this, we've developed a 3D Slicer Plugin and Gradio API for efficient 3D medical image and video segmentation. We invite you to try them out and provide feedback! 🔧 Deployment: - 3D Slicer Plugin: - Gradio API: (Note: Due to GPU limitations, the online API is available for only 12 hours and may be slow. We highly recommend deploying the Gradio API with your own computing resources: A big shoutout to Jun Ma (JunMa) who recently joined our UHN AI hub (UHN AI Hub) as Machine Learning Lead, and kudos to all co-authors: Sumin Kim, Feifei Li, Mohammed Baharoon (Mohammed Baharoon), Reza Asakereh, and Hongwei Lyu! This is true teamwork! Looking forward to collaborating with the community to advance 3D medical image and video segmentation foundation models! University Health Network U of T Department of Computer Science Department of Laboratory Medicine & Pathobiology Temerty Centre for AI in Medicine (T-CAIREM) Vector Institute #MedTech #AIinHealthcare #DeepLearning #MedicalImaging #SAM2 #MedSAM #AIResearch
0:22

🚀 The Segment Anything Model (SAM) has been upgraded to SAM2, featuring an efficient image encoder for segmenting images and videos. But does SAM2 outperform SAM1 in medical image and video segmentation? We're thrilled to present our paper "Segment Anything in Medical Images and Videos: Benchmark and Deployment"! We comprehensively benchmark SAM2 across 11 medical image modalities and videos. 📄 Paper: 💻 Code: **Highlights:** 1. SAM2 doesn’t always outperform SAM1 in 2D medical images, but excels in video segmentation, making it more accurate and efficient for 3D images, such as CT and MR scans. 2. MedSAM still outperforms SAM2 on most 2D modalities, but SAM2 surpasses MedSAM for 3D image segmentation in a slice-by-slice approach. 3. Segmentation performance varies with model size; sometimes the smallest model outperforms larger ones. 4. Fine-tuning SAM2 significantly boosts its performance for medical image segmentation. While SAM2 may struggle with challenging objects that have unclear boundaries or low contrast, it excels in generating good initial segmentation masks for common medical images and videos. However, the official interface doesn’t support medical data formats and has limitations on video length. To address this, we've developed a 3D Slicer Plugin and Gradio API for efficient 3D medical image and video segmentation. We invite you to try them out and provide feedback! 🔧 Deployment: - 3D Slicer Plugin: - Gradio API: (Note: Due to GPU limitations, the online API is available for only 12 hours and may be slow. We highly recommend deploying the Gradio API with your own computing resources: A big shoutout to Jun Ma (JunMa) who recently joined our UHN AI hub (UHN AI Hub) as Machine Learning Lead, and kudos to all co-authors: Sumin Kim, Feifei Li, Mohammed Baharoon (Mohammed Baharoon), Reza Asakereh, and Hongwei Lyu! This is true teamwork! Looking forward to collaborating with the community to advance 3D medical image and video segmentation foundation models! University Health Network U of T Department of Computer Science Department of Laboratory Medicine & Pathobiology Temerty Centre for AI in Medicine (T-CAIREM) Vector Institute #MedTech #AIinHealthcare #DeepLearning #MedicalImaging #SAM2 #MedSAM #AIResearch

Bo Wang

178,579 views • 2 years ago

Today, Nesa is excited to announce cross-chain support with Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.
0:16

Today, Nesa is excited to announce cross-chain support with Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.

Nesa

79,673 views • 2 years ago

We’re gearing up for the official pre-order launch of the Arduino VENTUNO Q. An AI computer designed to run LLMs and Agentic AI workloads locally at the edge without compromising performance. ⚡️ Engineers, developers, and innovators can now build AI and robotics that sense, decide, and act on their own, instantly, offline, faster. 📅 Pre-orders open August 25. Sign up to get notified the moment pre-orders go live ➡️
0:16

We’re gearing up for the official pre-order launch of the Arduino VENTUNO Q. An AI computer designed to run LLMs and Agentic AI workloads locally at the edge without compromising performance. ⚡️ Engineers, developers, and innovators can now build AI and robotics that sense, decide, and act on their own, instantly, offline, faster. 📅 Pre-orders open August 25. Sign up to get notified the moment pre-orders go live ➡️

Arduino

17,109 views • 14 days ago

Poolside is hosting a 2-day model research hackathon in London. Join us to push an open-weight agent model as far as you can. RL and fine-tune Laguna XS.2, our latest-generation model, on Prime Intellect Lab. Dates: May 29–30 Partners: NVIDIA + Prime Intellect + Hugging Face Prize: NVIDIA DGX Spark Agents need better models. Better models need cracked researchers. Link below.
0:15

Poolside is hosting a 2-day model research hackathon in London. Join us to push an open-weight agent model as far as you can. RL and fine-tune Laguna XS.2, our latest-generation model, on Prime Intellect Lab. Dates: May 29–30 Partners: NVIDIA + Prime Intellect + Hugging Face Prize: NVIDIA DGX Spark Agents need better models. Better models need cracked researchers. Link below.

Poolside

94,338 views • 3 months ago

Introducing WELLAIOS: A revolutionary Open source AI Agent development framework and launchpad on Solana WELLAIOS empowers you to create, tokenize, and trade advanced AI agents on the Solana blockchain. Built by our team of AI professionals, our platform combines a sophisticated open-source framework with multi-modal AI technology, bringing character creation and storytelling to life without having to write a single line of code. Create intelligent digital characters that evolve, interact, and generate content through our library of AI agents. Each character becomes a unique asset equipped with a large set of AI tools on the Solana blockchain. For developers and creators: Join our thriving ecosystem where innovation meets rewards. Build plugins, contribute to our open-source framework, and earn as your creations shape the future. 👀 Sneak Peek: Watch our 3D AI agent capabilities showcase for content creation. Coming soon to Solana. Follow us on X for exclusive updates and be part of the revolution.
0:18

Introducing WELLAIOS: A revolutionary Open source AI Agent development framework and launchpad on Solana WELLAIOS empowers you to create, tokenize, and trade advanced AI agents on the Solana blockchain. Built by our team of AI professionals, our platform combines a sophisticated open-source framework with multi-modal AI technology, bringing character creation and storytelling to life without having to write a single line of code. Create intelligent digital characters that evolve, interact, and generate content through our library of AI agents. Each character becomes a unique asset equipped with a large set of AI tools on the Solana blockchain. For developers and creators: Join our thriving ecosystem where innovation meets rewards. Build plugins, contribute to our open-source framework, and earn as your creations shape the future. 👀 Sneak Peek: Watch our 3D AI agent capabilities showcase for content creation. Coming soon to Solana. Follow us on X for exclusive updates and be part of the revolution.

WELL3

10,507 views • 1 year ago

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)
0:13

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)

Stability AI

181,554 views • 1 year ago

The new open-weights Hailuo AI (MiniMax) H3 is live on OpenRouter thanks to MiniMax (official)! H3 is a lightweight video model for text, image, audio, & video input, with native audio-visual output. Built for instruction-led edits, text/brand rendering, and video-2-video motion transfer.
0:15

The new open-weights Hailuo AI (MiniMax) H3 is live on OpenRouter thanks to MiniMax (official)! H3 is a lightweight video model for text, image, audio, & video input, with native audio-visual output. Built for instruction-led edits, text/brand rendering, and video-2-video motion transfer.

OpenRouter

22,767 views • 21 days ago

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:
0:20

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Stability AI

1,024,598 views • 2 years ago

JUST IN: Meta AI introduces Voicebox, an all-in-one generative speech model. Voicebox is an impressive breakthrough! It could do for speech what other models like GPT-3 and Stable Diffusion have done for text and images. Some key details: - Voicebox can synthesize speech across 6 languages - It's a general-purpose model that can perform tasks it wasn't trained on. It can perform noise removal, content editing, style conversion, and more - Supports in-context text-to-speech synthesis and cross-lingual style transfer - It's 20x faster than current models and outperforms single-purpose models through in-context learning paper: blog:
0:13

JUST IN: Meta AI introduces Voicebox, an all-in-one generative speech model. Voicebox is an impressive breakthrough! It could do for speech what other models like GPT-3 and Stable Diffusion have done for text and images. Some key details: - Voicebox can synthesize speech across 6 languages - It's a general-purpose model that can perform tasks it wasn't trained on. It can perform noise removal, content editing, style conversion, and more - Supports in-context text-to-speech synthesis and cross-lingual style transfer - It's 20x faster than current models and outperforms single-purpose models through in-context learning paper: blog:

elvis

88,518 views • 3 years ago

This #CVPR2026 paper from our research team is trending #1 on Hugging Face 🤗 Meet LocateAnything: a vision-language detection model that rethinks bounding box prediction. For AI agents and robots, “seeing” is only useful if a model can pinpoint where something is fast enough to act. Trained on 138M high-quality samples, LocateAnything decodes bounding boxes in parallel instead of one coordinate at a time, improving localization accuracy while dramatically increasing throughput for visual grounding and detection. Project page:
0:16

This #CVPR2026 paper from our research team is trending #1 on Hugging Face 🤗 Meet LocateAnything: a vision-language detection model that rethinks bounding box prediction. For AI agents and robots, “seeing” is only useful if a model can pinpoint where something is fast enough to act. Trained on 138M high-quality samples, LocateAnything decodes bounding boxes in parallel instead of one coordinate at a time, improving localization accuracy while dramatically increasing throughput for visual grounding and detection. Project page:

NVIDIA AI

338,464 views • 2 months ago

Moonshot AI is casually giving developers free daily access to Kimi K3 😳 no subscription no upfront payment just sign in and start using one of the largest open AI models available what you get for $0: - Kimi K3 with 2.8T parameters - 1M token context window - strong coding and reasoning performance - native vision capabilities - free daily credits that refresh automatically why this is worth checking: > access a frontier model without paying API fees > long context for large codebases and documents > works on web, desktop, mobile, and CLI getting started takes less than 2 minutes: 1. go to 2. create a free account 3. Kimi K3 is available as the default model 4. start chatting or coding with your daily free credits bonus: Moonshot Together lets you invite friends for a chance to earn 3, 7, 15, 30, or even 365 days of Kimi Membership through its rewards program benchmark highlights: > 2.8T parameter MoE model > 1M context window > strong performance across coding, browsing, and reasoning benchmarks important: free credits reset daily, rate limits apply on the free tier, and the open-weight release is expected on July 27 A simple way to try one of the latest frontier AI models without paying for API access
0:17

Moonshot AI is casually giving developers free daily access to Kimi K3 😳 no subscription no upfront payment just sign in and start using one of the largest open AI models available what you get for $0: - Kimi K3 with 2.8T parameters - 1M token context window - strong coding and reasoning performance - native vision capabilities - free daily credits that refresh automatically why this is worth checking: > access a frontier model without paying API fees > long context for large codebases and documents > works on web, desktop, mobile, and CLI getting started takes less than 2 minutes: 1. go to 2. create a free account 3. Kimi K3 is available as the default model 4. start chatting or coding with your daily free credits bonus: Moonshot Together lets you invite friends for a chance to earn 3, 7, 15, 30, or even 365 days of Kimi Membership through its rewards program benchmark highlights: > 2.8T parameter MoE model > 1M context window > strong performance across coding, browsing, and reasoning benchmarks important: free credits reset daily, rate limits apply on the free tier, and the open-weight release is expected on July 27 A simple way to try one of the latest frontier AI models without paying for API access

K2S

23,110 views • 1 month ago

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan
0:19

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan

@levelsio

112,930 views • 1 year ago

Now available on secondary for .177Ξ, 🔗⤵️ Frag 002, a 1/1 from a series of 10 from the Native collection, a research project in which I set specific visual conditions to invite the AI to express itself, unprompted, using its own perceptual logic This gesture is expressing both Optics Logic and Phantom 3D, the AI behaving as though it’s running its own 3D engine Available at Read more at
0:12

Now available on secondary for .177Ξ, 🔗⤵️ Frag 002, a 1/1 from a series of 10 from the Native collection, a research project in which I set specific visual conditions to invite the AI to express itself, unprompted, using its own perceptual logic This gesture is expressing both Optics Logic and Phantom 3D, the AI behaving as though it’s running its own 3D engine Available at Read more at

Misfits Studio

18,828 views • 10 months ago