Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵

allen_ai's profile picture

Ai2

85,926 subscribers

87,199 Aufrufe • vor 4 Monaten •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Introducing WildDet3D, a grounding model for monocular 3D object detection in the wild. A question I keep coming back to is: what is the right backbone for robotics foundation models? Should it be a video model, a language model, or perhaps a grounding model? WildDet3D is our first step in exploring that direction.
2:10

Introducing WildDet3D, a grounding model for monocular 3D object detection in the wild. A question I keep coming back to is: what is the right backbone for robotics foundation models? Should it be a video model, a language model, or perhaps a grounding model? WildDet3D is our first step in exploring that direction.

Jiafei Duan

12,137 Aufrufe • vor 4 Monaten

We're releasing MolmoMotion, a 3D motion forecasting model. Given one or a few video frames, 3D points on an object, & an instruction like "Put the white bowl on the table," MolmoMotion predicts where those points will go over the next few seconds in a shared 3D world frame. 🧵
1:53

We're releasing MolmoMotion, a 3D motion forecasting model. Given one or a few video frames, 3D points on an object, & an instruction like "Put the white bowl on the table," MolmoMotion predicts where those points will go over the next few seconds in a shared 3D world frame. 🧵

Ai2

188,450 Aufrufe • vor 2 Monaten

Microsoft's new Florence 2 is big for Computer Vision. It's a merge between Text and Vision. With a single prompt you can instruct the model to do CV tasks like captioning, object detection, grounding, and segmentation. The best part, it only uses a single backbone to handle everything. ▸ Excels in zero-shot performance ▸ Unified model for detection, captioning, etc. ▸ FLD-5B dataset: 5B+ annotations, 126M images ▸ New benchmarks (>5.5+) on COCO, ADE20K
0:27

Microsoft's new Florence 2 is big for Computer Vision. It's a merge between Text and Vision. With a single prompt you can instruct the model to do CV tasks like captioning, object detection, grounding, and segmentation. The best part, it only uses a single backbone to handle everything. ▸ Excels in zero-shot performance ▸ Unified model for detection, captioning, etc. ▸ FLD-5B dataset: 5B+ annotations, 126M images ▸ New benchmarks (>5.5+) on COCO, ADE20K

Lior Alexander

186,583 Aufrufe • vor 2 Jahren

Announcing 𝐕𝐨𝐢𝐜𝐞𝐂𝐫𝐚𝐟𝐭🪄 SotA for both speech editing and zero-shot text-to-speech, Outperforming VALL-E, XTTS-v2, etc. VoiceCraft works on in-the-wild data such as movies, random videos and podcasts We fully open source it at
1:47

Announcing 𝐕𝐨𝐢𝐜𝐞𝐂𝐫𝐚𝐟𝐭🪄 SotA for both speech editing and zero-shot text-to-speech, Outperforming VALL-E, XTTS-v2, etc. VoiceCraft works on in-the-wild data such as movies, random videos and podcasts We fully open source it at

Puyuan Peng

160,434 Aufrufe • vor 2 Jahren

locate-anything.cpp: native C++/ggml (ggml) inference for NVIDIA's LocateAnything-3B, open-vocabulary object detection / visual grounding, one of the neat detection VLMs out there, from the LocalAI team. Same detections as the official model, now running anywhere with no Python and faster, on CPU and GPU. Quantized GGUF on Hugging Face 🤗 Huge thanks to Georgi Gerganov for ggml and to NVIDIAAI for releasing LocateAnything! 🧵
0:35

locate-anything.cpp: native C++/ggml (ggml) inference for NVIDIA's LocateAnything-3B, open-vocabulary object detection / visual grounding, one of the neat detection VLMs out there, from the LocalAI team. Same detections as the official model, now running anywhere with no Python and faster, on CPU and GPU. Quantized GGUF on Hugging Face 🤗 Huge thanks to Georgi Gerganov for ggml and to NVIDIAAI for releasing LocateAnything! 🧵

Ettore Di Giacinto

15,919 Aufrufe • vor 2 Monaten

⏰As of today, 3D Text auto Translates in-game using Localization Service 🎉 🥳I'm releasing my new plugin: "3D Text Pro" ⚡️Highlight Features: Curve 3D Text (Splines), Auto-Translate, Presets, Emojis Get It Here: 🧵Look at the thread for more information #ROBLOX #RobloxDev
0:32

⏰As of today, 3D Text auto Translates in-game using Localization Service 🎉 🥳I'm releasing my new plugin: "3D Text Pro" ⚡️Highlight Features: Curve 3D Text (Splines), Auto-Translate, Presets, Emojis Get It Here: 🧵Look at the thread for more information #ROBLOX #RobloxDev

KinqAndi

22,900 Aufrufe • vor 1 Jahr

Today we're releasing ZONOS2, our next-generation real-time TTS model with high-fidelity voice cloning. ZONOS2 is the most expressive open-source TTS model, released under Apache 2.0 and available on Zyphra Cloud on AMD. 🧵
1:30

Today we're releasing ZONOS2, our next-generation real-time TTS model with high-fidelity voice cloning. ZONOS2 is the most expressive open-source TTS model, released under Apache 2.0 and available on Zyphra Cloud on AMD. 🧵

Zyphra

334,112 Aufrufe • vor 2 Monaten

Introducing Substance 3D Viewer (beta) a new 3D desktop app that can open, view, and render 70+ file formats. In Adobe Photoshop (beta), drag & drop a 3D model on your canvas, and it becomes an editable Smart Object. Download it for free and give it a try!
0:50

Introducing Substance 3D Viewer (beta) a new 3D desktop app that can open, view, and render 70+ file formats. In Adobe Photoshop (beta), drag & drop a 3D model on your canvas, and it becomes an editable Smart Object. Download it for free and give it a try!

Adobe Substance 3D

89,177 Aufrufe • vor 1 Jahr

Raon-OpenTTS-1B is a new open text-to-speech model for zero-shot voice cloning. It has best overall similarity score and lowest error rate vs other leading TTS models.
0:42

Raon-OpenTTS-1B is a new open text-to-speech model for zero-shot voice cloning. It has best overall similarity score and lowest error rate vs other leading TTS models.

⚡AI Search⚡

21,211 Aufrufe • vor 9 Tagen

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.
0:42

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.

AK

62,768 Aufrufe • vor 3 Jahren

We pioneered the first ultra-realistic Text to Speech model, and recently launched the world's most accurate Speech to Text model, Scribe. But we're not stopping there. Today, we're taking one small step for man, and one giant leap for man's best friend... with Text to Bark.
1:00

We pioneered the first ultra-realistic Text to Speech model, and recently launched the world's most accurate Speech to Text model, Scribe. But we're not stopping there. Today, we're taking one small step for man, and one giant leap for man's best friend... with Text to Bark.

ElevenLabs

291,706 Aufrufe • vor 1 Jahr

Today I'm releasing PortalVR 2.0, which lets you play the entire SteamVR ecosystem without wearing a headset. You plug in your Quest, put it on your desk, and play on your monitor. It supports 3D glasses and even 3D monitors! 😎 Get it now: Thread 🧵
0:40

Today I'm releasing PortalVR 2.0, which lets you play the entire SteamVR ecosystem without wearing a headset. You plug in your Quest, put it on your desk, and play on your monitor. It supports 3D glasses and even 3D monitors! 😎 Get it now: Thread 🧵

gfodor.id

2,319,085 Aufrufe • vor 8 Monaten

Releasing METAGENE-1: In collaboration with researchers from USC, we're open-sourcing a state-of-the-art 7B parameter Metagenomic Foundation Model. Enabling planetary-scale pathogen detection and reducing the risk of pandemics in the age of exponential biology.
2:03

Releasing METAGENE-1: In collaboration with researchers from USC, we're open-sourcing a state-of-the-art 7B parameter Metagenomic Foundation Model. Enabling planetary-scale pathogen detection and reducing the risk of pandemics in the age of exponential biology.

Prime Intellect

622,547 Aufrufe • vor 1 Jahr

We’re releasing the RoboArena today!🤖🦾 Fair & scalable evaluation is a major bottleneck for research on generalist policies. We’re hoping that RoboArena can help! We provide data, model code & sim evals for debugging! Submit your policies today and join the leaderboard! :) 🧵
1:27

We’re releasing the RoboArena today!🤖🦾 Fair & scalable evaluation is a major bottleneck for research on generalist policies. We’re hoping that RoboArena can help! We provide data, model code & sim evals for debugging! Submit your policies today and join the leaderboard! :) 🧵

Karl Pertsch

111,565 Aufrufe • vor 1 Jahr

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.
0:51

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

493,139 Aufrufe • vor 9 Monaten

World Labs just released Marble, and it’s wild. Their multimodal world model lets you prompt a high fidelity 3D world with text or an image, then explore it on Vision Pro like you’re actually there. We’re stepping into an entirely new era.
1:04

World Labs just released Marble, and it’s wild. Their multimodal world model lets you prompt a high fidelity 3D world with text or an image, then explore it on Vision Pro like you’re actually there. We’re stepping into an entirely new era.

Justin Ryan ᯅ

23,915 Aufrufe • vor 9 Monaten

THIS GUY VIBE CODED A TOOL THAT TURNS ANY SVG INTO A 3D OBJECT YOU CAN SPIN, ANIMATE, AND EMBED drag in an SVG, type some text, or draw pixel art. it becomes a 3D object instantly. spin it around, animate it, and embed it on your site. export as 4K image or video. runs entirely in your browser and nothing gets uploaded to any server with no account needed. 100% free AND its open source. this is one of those tools you didn't know you needed until you see it
0:29

THIS GUY VIBE CODED A TOOL THAT TURNS ANY SVG INTO A 3D OBJECT YOU CAN SPIN, ANIMATE, AND EMBED drag in an SVG, type some text, or draw pixel art. it becomes a 3D object instantly. spin it around, animate it, and embed it on your site. export as 4K image or video. runs entirely in your browser and nothing gets uploaded to any server with no account needed. 100% free AND its open source. this is one of those tools you didn't know you needed until you see it

Om Patel

230,757 Aufrufe • vor 4 Monaten

We're helping AI to see the 3D world in motion as humans do. 🌐 Enter D4RT: a unified model that turns video into 4D representations faster than previous methods - enabling it to understand space and time. This is how it works 🧵
0:29

We're helping AI to see the 3D world in motion as humans do. 🌐 Enter D4RT: a unified model that turns video into 4D representations faster than previous methods - enabling it to understand space and time. This is how it works 🧵

Google DeepMind

369,517 Aufrufe • vor 7 Monaten