Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

🚨 Forget LIDAR. The Robbyant team just dropped a streaming 3D model that reconstructs scenes live, at ~20 FPS, over long sequences. One single camera. Runs in real time. Open-source. Entirely end-to-end. NO iterative optimization tricks and no post-processing cleanup steps! It outperforms both existing streaming approaches and several... show more

Charly Wargnier

177,845 subscribers

36,165 Aufrufe • vor 1 Monat •via X (Twitter)

Bildung Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

Superman

1,448,893 Aufrufe • vor 26 Tagen

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

Yasir Ai

253,656 Aufrufe • vor 24 Tagen

That was quick: last week Genie 3 was revealed. One week later Skywork AI releases Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model. Matrix-Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. They open-source our model weights and codebase to advance research in interactive world modeling. Some examples:

That was quick: last week Genie 3 was revealed. One week later Skywork AI releases Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model. Matrix-Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. They open-source our model weights and codebase to advance research in interactive world modeling. Some examples:

Chubby♨️

115,138 Aufrufe • vor 1 Jahr

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

Chubby♨️

37,776 Aufrufe • vor 7 Monaten

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

PlayCanvas

53,617 Aufrufe • vor 2 Monaten

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.

How To Prompt

703,059 Aufrufe • vor 4 Monaten

NVIDIA just removed one of the biggest friction points in Voice AI. PersonaPlex-7B is an open-source, full-duplex conversational model. Free, open source (MIT), with open model weights on Hugging Face 🤗 Links to repo and weights in 🧵↓ The traditional ASR → LLM → TTS pipeline forces rigid turn-taking. It’s efficient, but it never feels natural. PersonaPlex-7B changes that. This NVIDIA model can listen and speak at the same time. It runs directly on continuous audio tokens with a dual-stream transformer, generating text and audio in parallel instead of passing control between components. That unlocks: → instant back-channel responses → interruptions that feel human → real conversational rhythm Persona control is fully zero-shot! If you’re building low-latency assistants or support agents, this is a big step forward 🔥

NVIDIA just removed one of the biggest friction points in Voice AI. PersonaPlex-7B is an open-source, full-duplex conversational model. Free, open source (MIT), with open model weights on Hugging Face 🤗 Links to repo and weights in 🧵↓ The traditional ASR → LLM → TTS pipeline forces rigid turn-taking. It’s efficient, but it never feels natural. PersonaPlex-7B changes that. This NVIDIA model can listen and speak at the same time. It runs directly on continuous audio tokens with a dual-stream transformer, generating text and audio in parallel instead of passing control between components. That unlocks: → instant back-channel responses → interruptions that feel human → real conversational rhythm Persona control is fully zero-shot! If you’re building low-latency assistants or support agents, this is a big step forward 🔥

Charly Wargnier

565,502 Aufrufe • vor 6 Monaten

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.

Simplifying AI

278,970 Aufrufe • vor 6 Monaten

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

The Humanoid Hub

17,721 Aufrufe • vor 6 Monaten

I just open-sourced OpenReel Video - a professional video editor that runs 100% in your browser. The open source alternative to capcut No installation. No cloud uploads. No subscriptions. No watermarks. Just drag, drop, and edit. Here's everything it can do 🧵

I just open-sourced OpenReel Video - a professional video editor that runs 100% in your browser. The open source alternative to capcut No installation. No cloud uploads. No subscriptions. No watermarks. Just drag, drop, and edit. Here's everything it can do 🧵

pythonxi

70,558 Aufrufe • vor 6 Monaten

Turn any GitHub repo into a visual, interactive diagram in one click 🤯 Just replace `github` with `gitdiagram` in the URL… or go to: → - It maps your entire repo - Shows all files - Reveals every dependency 100% open-source and free. Repo in 🧵↓

Turn any GitHub repo into a visual, interactive diagram in one click 🤯 Just replace `github` with `gitdiagram` in the URL… or go to: → - It maps your entire repo - Shows all files - Reveals every dependency 100% open-source and free. Repo in 🧵↓

Charly Wargnier

15,034 Aufrufe • vor 8 Monaten

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

InSpatio｜影溯

28,892 Aufrufe • vor 7 Tagen

We are introducing Hunyuan3D-Part: an open-source part-level 3D shape generation model that outperforms all existing open and close-source models. Highlights: 🔹P3-SAM: The industry's first native 3D part segmentation model. 🔹X-Part: A part generation model that achieves state-of-the-art results in controllability and shape quality. Key-features: 1️⃣Eliminates the use of 2D SAM during training, relying solely on a large-scale dataset with 3.7 million shapes and clean part annotations. 2️⃣Introduces a new automated segmentation pipeline in 3D without user intervention. 3️⃣Implements a diffusion-based part decomposition pipeline utilizing both geometry and semantic clues. Code: Weights: Tech reports: 🔸P3-SAM： → Paper: → Project page: 🔸X-Part： → Paper: → Project page: Try it now： → (Light version) Hugging Face demo: → (Full version) Hunyuan3D Studio:

We are introducing Hunyuan3D-Part: an open-source part-level 3D shape generation model that outperforms all existing open and close-source models. Highlights: 🔹P3-SAM: The industry's first native 3D part segmentation model. 🔹X-Part: A part generation model that achieves state-of-the-art results in controllability and shape quality. Key-features: 1️⃣Eliminates the use of 2D SAM during training, relying solely on a large-scale dataset with 3.7 million shapes and clean part annotations. 2️⃣Introduces a new automated segmentation pipeline in 3D without user intervention. 3️⃣Implements a diffusion-based part decomposition pipeline utilizing both geometry and semantic clues. Code: Weights: Tech reports: 🔸P3-SAM： → Paper: → Project page: 🔸X-Part： → Paper: → Project page: Try it now： → (Light version) Hugging Face demo: → (Full version) Hunyuan3D Studio:

Tencent Hy

72,522 Aufrufe • vor 10 Monaten

NVIDIA just dropped another revolution in AI animation — real-time and open source. It's called ARDY. You type what the character should do — and it just does it. While moving. Change the text mid-walk, click a waypoint, add keyframes — it re-plans instantly. No baking, no waiting. And this time they dropped EVERYTHING at once: code, weights, working demo. Fully ready to run locally. I tested it. Honestly — shock. Feels like Kimodo × MotionBricks: that amount of control (text + constraints + trajectories), but live. And it fits in 20–24GB of VRAM. I didn't expect animation to move this fast — I thought 3D would get solved first. It's robotics pushing it: the same model drives their humanoid robots. Paper + code:

NVIDIA just dropped another revolution in AI animation — real-time and open source. It's called ARDY. You type what the character should do — and it just does it. While moving. Change the text mid-walk, click a waypoint, add keyframes — it re-plans instantly. No baking, no waiting. And this time they dropped EVERYTHING at once: code, weights, working demo. Fully ready to run locally. I tested it. Honestly — shock. Feels like Kimodo × MotionBricks: that amount of control (text + constraints + trajectories), but live. And it fits in 20–24GB of VRAM. I didn't expect animation to move this fast — I thought 3D would get solved first. It's robotics pushing it: the same model drives their humanoid robots. Paper + code:

Stefan 3D AI

110,180 Aufrufe • vor 28 Tagen

someone open-sourced a tool that turns any phone video into a full 3D world in real time. you record a walk around your house, drop the mp4 in, and the entire scene comes back as a walkable 996k-point world at 60fps on your local GPU. no cloud. no subscription. runs 100% locally. 100% open source.

someone open-sourced a tool that turns any phone video into a full 3D world in real time. you record a walk around your house, drop the mp4 in, and the entire scene comes back as a walkable 996k-point world at 60fps on your local GPU. no cloud. no subscription. runs 100% locally. 100% open source.

Superman

815,712 Aufrufe • vor 25 Tagen

$Someone open-sourced a 66M parameter model that beats ElevenLabs, OpenAI, and Gemini and runs entirely offline on a Raspberry Pi. it's called Supertonic, a text-to-speech model so fast it turns an entire webpage into audio in under 1 second. locally. offline. for free. text-to-speech has lived in the cloud for years. every spoken character was an API call and a fraction of a cent. Supertonic 3 kills that entirely. the model is 99M parameters. ships as a single ONNX file. hits 167× faster than real-time on a laptop CPU. that's ~1,263 characters of speech per second. other open systems sit at 55–287. no cloud. no API. no GPU. → 31 languages, no separate adapters → works inside a browser tab (WebGPU/WASM) → handles phone numbers, currency, dates — no preprocessing → inline tags for laugh and breath → Turns an entire webpage into audio in under 1 second → 44.1kHz studio-grade WAV, no upsampler needed` and on real-world text, "$5.2M", "(212) 555-0142 ext. 402", "30kph”, it's the only one that reads them correctly. ElevenLabs Flash, OpenAI TTS-1, Gemini 2.5 Flash all fail. Supertonic passes. 11.2k stars. 100% Open Source.$

Someone open-sourced a 66M parameter model that beats ElevenLabs, OpenAI, and Gemini and runs entirely offline on a Raspberry Pi. it's called Supertonic, a text-to-speech model so fast it turns an entire webpage into audio in under 1 second. locally. offline. for free. text-to-speech has lived in the cloud for years. every spoken character was an API call and a fraction of a cent. Supertonic 3 kills that entirely. the model is 99M parameters. ships as a single ONNX file. hits 167× faster than real-time on a laptop CPU. that's ~1,263 characters of speech per second. other open systems sit at 55–287. no cloud. no API. no GPU. → 31 languages, no separate adapters → works inside a browser tab (WebGPU/WASM) → handles phone numbers, currency, dates — no preprocessing → inline tags for laugh and breath → Turns an entire webpage into audio in under 1 second → 44.1kHz studio-grade WAV, no upsampler needed` and on real-world text, "$5.2M", "(212) 555-0142 ext. 402", "30kph”, it's the only one that reads them correctly. ElevenLabs Flash, OpenAI TTS-1, Gemini 2.5 Flash all fail. Supertonic passes. 11.2k stars. 100% Open Source.

Superman

30,261 Aufrufe • vor 24 Tagen

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

Jun Gao

104,624 Aufrufe • vor 2 Monaten

someone built a free open-source version of manus. no invite code needed. it's called OpenManus. built in 3 hours by researchers from metagpt. give it any task via terminal and it handles everything end to end: ✦ plans and reasons through the task ✦ browses the web autonomously ✦ uses tools and executes actions ✦ mcp support included ✦ works with any llm provider 100% free. open source.

someone built a free open-source version of manus. no invite code needed. it's called OpenManus. built in 3 hours by researchers from metagpt. give it any task via terminal and it handles everything end to end: ✦ plans and reasons through the task ✦ browses the web autonomously ✦ uses tools and executes actions ✦ mcp support included ✦ works with any llm provider 100% free. open source.

Oliver Prompts

56,964 Aufrufe • vor 1 Monat

Just dropped on HF: Supertonic TTS, a blazing fast speech model. 🤯 > RTF as low as 0.001 on RTX4090 > Runs on-device (no latency, full privacy) > 66M params + 8+ language SDKs > Browser, mobile, edge — it just works. > You can adjust inference steps, batch processing, and other parameters to match your specific needs! > Open-source. Ready to build with!

Just dropped on HF: Supertonic TTS, a blazing fast speech model. 🤯 > RTF as low as 0.001 on RTX4090 > Runs on-device (no latency, full privacy) > 66M params + 8+ language SDKs > Browser, mobile, edge — it just works. > You can adjust inference steps, batch processing, and other parameters to match your specific needs! > Open-source. Ready to build with!

steven

17,784 Aufrufe • vor 8 Monaten

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike

Harry Stebbings

63,672 Aufrufe • vor 1 Monat