Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

New research with Tsinghua University: Spatial-TTT. A framework for streaming visual-based spatial intelligence with test-time training (TTT). Spatial-TTT adapts fast weights to capture and organize spatial evidence from long video streams, enabling models to build structured 3D spatial memory over time. Highlights: 🔹Efficient streaming memory. Fast weights act as...

TencentHunyuan's profile picture

Tencent Hy

39,481 subscribers

20,792 Aufrufe • vor 3 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Latent Spatial Memory for Video World Models
1:10

Latent Spatial Memory for Video World Models

AK

22,597 Aufrufe • vor 21 Tagen

Announcing the Video Editor in Spatial Media Toolkit. Effortlessly create spatial videos or photo slideshows with music, all privately on-device. Seamlessly integrates with our powerful 2D-to-3D conversion for stunning spatial storytelling.
0:47

Announcing the Video Editor in Spatial Media Toolkit. Effortlessly create spatial videos or photo slideshows with music, all privately on-device. Seamlessly integrates with our powerful 2D-to-3D conversion for stunning spatial storytelling.

Ryan Gordon

12,353 Aufrufe • vor 1 Jahr

Test-Time Training (TTT) is available in video generation now! We can directly generate complete one-minute video, with great temporal and spatial coherence. We created more episodes of Tom and Jerry (my favorite cartoon in childhood) with our model. Enjoy more in 🧵
1:03

Test-Time Training (TTT) is available in video generation now! We can directly generate complete one-minute video, with great temporal and spatial coherence. We created more episodes of Tom and Jerry (my favorite cartoon in childhood) with our model. Enjoy more in 🧵

Jiarui Xu

15,415 Aufrufe • vor 1 Jahr

ทำไมผู้หญิงชอบหลงทาง อ่าน Google Maps ไม่ออก บางคนจำทางเก่ง เดินไปไหนก็ไม่หลง แต่บางคนต่อให้เปิดแผนที่ก็ยังงงว่าต้องเลี้ยวซ้ายหรือขวา นี่คือเรื่อง Spatial Memory หรือความจำเชิงพื้นที่ของสมอง Spatial Memory คือความสามารถในการจำตำแหน่ง วัตถุ และเส้นทางรอบตัว สมองส่วน Hippocampus จะสร้าง “แผนที่ในหัว” หรือ Cognitive Map ให้เราใช้ในการนำทาง หากสมองส่วนนี้ไม่แข็งแรง เราจะหลงทางง่าย และอาจเป็นสัญญาณเริ่มต้นของสมองเสื่อม วิธีฝึก Spatial Memory 1.สังเกต Landmark รอบตัวเวลาเดินทาง 2.วาดแผนที่ในหัว หรือหมุนแผนที่ให้ตรงกับทิศทางที่เราเดิน 3.ออกกำลังกายแบบแอโรบิกเพื่อกระตุ้น Hippocampus 4.นอนหลับเพียงพอและลดความเครียด เพื่อให้สมองเรียนรู้ทิศทางได้ดีที่สุด การฝึก Spatial Memory ไม่ใช่แค่ช่วยให้ไม่หลงทาง แต่ยังเป็นการป้องกันสมองเสื่อมในอนาคต #BrainLongevity #TheLongevist #หมออั๋น #longevity
0:53

ทำไมผู้หญิงชอบหลงทาง อ่าน Google Maps ไม่ออก บางคนจำทางเก่ง เดินไปไหนก็ไม่หลง แต่บางคนต่อให้เปิดแผนที่ก็ยังงงว่าต้องเลี้ยวซ้ายหรือขวา นี่คือเรื่อง Spatial Memory หรือความจำเชิงพื้นที่ของสมอง Spatial Memory คือความสามารถในการจำตำแหน่ง วัตถุ และเส้นทางรอบตัว สมองส่วน Hippocampus จะสร้าง “แผนที่ในหัว” หรือ Cognitive Map ให้เราใช้ในการนำทาง หากสมองส่วนนี้ไม่แข็งแรง เราจะหลงทางง่าย และอาจเป็นสัญญาณเริ่มต้นของสมองเสื่อม วิธีฝึก Spatial Memory 1.สังเกต Landmark รอบตัวเวลาเดินทาง 2.วาดแผนที่ในหัว หรือหมุนแผนที่ให้ตรงกับทิศทางที่เราเดิน 3.ออกกำลังกายแบบแอโรบิกเพื่อกระตุ้น Hippocampus 4.นอนหลับเพียงพอและลดความเครียด เพื่อให้สมองเรียนรู้ทิศทางได้ดีที่สุด การฝึก Spatial Memory ไม่ใช่แค่ช่วยให้ไม่หลงทาง แต่ยังเป็นการป้องกันสมองเสื่อมในอนาคต #BrainLongevity #TheLongevist #หมออั๋น #longevity

The Longevist

283,914 Aufrufe • vor 10 Monaten

Spatial reconstruction is a long-context problem: real scenes come with hundreds of images. But O(N²) transformer-based models don’t scale efficiently. Introducing: 🤐ZipMap (CVPR ’26): Linear-Time, Stateful 3D Reconstruction via Test-Time Training (TTT). ZipMap “zips” a large image collection into an implicit TTT scene state in a single linear-time operation. The state will then be decoded into spatial outputs, and can be queried efficiently for novel-view geometry and appearance (~100 FPS) ZipMap is not only much faster (>20× faster than VGGT), but also matches or surpasses the accuracy of all SOTA models.
0:35

Spatial reconstruction is a long-context problem: real scenes come with hundreds of images. But O(N²) transformer-based models don’t scale efficiently. Introducing: 🤐ZipMap (CVPR ’26): Linear-Time, Stateful 3D Reconstruction via Test-Time Training (TTT). ZipMap “zips” a large image collection into an implicit TTT scene state in a single linear-time operation. The state will then be decoded into spatial outputs, and can be queried efficiently for novel-view geometry and appearance (~100 FPS) ZipMap is not only much faster (>20× faster than VGGT), but also matches or surpasses the accuracy of all SOTA models.

Haian Jin

78,274 Aufrufe • vor 3 Monaten

MindJourney Test-Time Scaling with World Models for Spatial Reasoning
0:43

MindJourney Test-Time Scaling with World Models for Spatial Reasoning

AK

61,714 Aufrufe • vor 11 Monaten

SpatialLM just dropped on Hugging Face Large Language Model for Spatial Understanding
0:50

SpatialLM just dropped on Hugging Face Large Language Model for Spatial Understanding

AK

673,688 Aufrufe • vor 1 Jahr

Free4D announced on Hugging Face Tuning-free 4D Scene Generation with Spatial-Temporal Consistency
0:30

Free4D announced on Hugging Face Tuning-free 4D Scene Generation with Spatial-Temporal Consistency

AK

22,878 Aufrufe • vor 1 Jahr

With our support & Forensic Architecture our Ukrainian partners at Center for Spatial Technologies Center for Spatial Technologies released new additions to their spatial archive, gathering digital & visual evidence & testimonies from the Mariupol Theatre bombing 2 years ago.
0:40

With our support & Forensic Architecture our Ukrainian partners at Center for Spatial Technologies Center for Spatial Technologies released new additions to their spatial archive, gathering digital & visual evidence & testimonies from the Mariupol Theatre bombing 2 years ago.

Forensis

14,694 Aufrufe • vor 2 Jahren

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI
3:58

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Zhiyang (Frank) Dou

14,610 Aufrufe • vor 11 Monaten

AnchorWeave World-Consistent Video Generation with Retrieved Local Spatial Memories paper:
0:24

AnchorWeave World-Consistent Video Generation with Retrieved Local Spatial Memories paper:

AK

23,312 Aufrufe • vor 4 Monaten

Can video generative models exhibit visuospatial intelligence? 🤔 Introducing Video4Spatial — a video-only framework that tackles spatial tasks. With just video context, our model can: 🔍 Ground objects by planning geometry-consistent paths 📸 Follow camera-pose instructions for scene navigation 🌐 Generalize to long contexts & unseen outdoor scenes A step toward video models as visual-spatial reasoners. Project: arXiv:
0:25

Can video generative models exhibit visuospatial intelligence? 🤔 Introducing Video4Spatial — a video-only framework that tackles spatial tasks. With just video context, our model can: 🔍 Ground objects by planning geometry-consistent paths 📸 Follow camera-pose instructions for scene navigation 🌐 Generalize to long contexts & unseen outdoor scenes A step toward video models as visual-spatial reasoners. Project: arXiv:

Xingang Pan

15,902 Aufrufe • vor 6 Monaten

Spatial photos and videos on Apple Vision Pro are like nothing you’ve ever seen before. Check out these tips for capturing spatial photos and spatial videos with iPhone 16 Pro, iPhone 16, and iPhone 15 Pro.
1:35

Spatial photos and videos on Apple Vision Pro are like nothing you’ve ever seen before. Check out these tips for capturing spatial photos and spatial videos with iPhone 16 Pro, iPhone 16, and iPhone 15 Pro.

Apple Support

53,422 Aufrufe • vor 1 Jahr

🚀 Introducing scGPT-spatial! 🧬🌍 A game-changing spatial-omic foundation model, built on the powerful scGPT framework with MoE (mixture of experts) and continually pretrained on a massive 30 million spatial single-cell profiles! 🧠 What’s the challenge? Spatial transcriptomics is next-level complex—not only must we model single-cell/spot profiles, but we also need to capture intricate spatial relationships while handling diverse sequencing protocols (imaging-based vs. sequencing-based). 🔥 Why scGPT-spatial? ✨ A Spatial-omic Foundation Model with Continual Pretraining – Built on scGPT’s robust initialization, it unlocks spatial context in tissues. ✨ SpatialHuman30M Dataset – The largest curated dataset: 30M profiles from Visium, Visium HD, Xenium, and MERFISH across 821 slides. ✨ Revolutionary MoE Decoders – A cutting-edge Mixture of Experts (MoE) architecture for protocol-aware gene expression decoding. ✨ Spatially-Aware Training Strategy – A neighborhood-based masked reconstruction approach to capture complex cell-type colocalization. ✨ Multi-Modal & Multi-Slide Integration – Seamless clustering & spatial domain identification across slides and modalities. ✨ Cell-Type Deconvolution & Gene Imputation – Unlocks cross-resolution & cross-modality harmonization with fine-tuned embeddings. 📄 Read the preprint: 💻 Explore the code/weights: #SpatialTranscriptomics #SingleCell #AIResearch #MachineLearning #SpatialData Huge shoutout to the incredible PHD students Chloe (ChloeXWang) and Haotian (Haotian Cui) for leading this groundbreaking project! 🎉 Massive thanks to our amazing co-authors Andrew, Ronald, and Hani (Hani Goodarzi) from Arc Institute—this work wouldn't have been possible without you! 👏
0:37

🚀 Introducing scGPT-spatial! 🧬🌍 A game-changing spatial-omic foundation model, built on the powerful scGPT framework with MoE (mixture of experts) and continually pretrained on a massive 30 million spatial single-cell profiles! 🧠 What’s the challenge? Spatial transcriptomics is next-level complex—not only must we model single-cell/spot profiles, but we also need to capture intricate spatial relationships while handling diverse sequencing protocols (imaging-based vs. sequencing-based). 🔥 Why scGPT-spatial? ✨ A Spatial-omic Foundation Model with Continual Pretraining – Built on scGPT’s robust initialization, it unlocks spatial context in tissues. ✨ SpatialHuman30M Dataset – The largest curated dataset: 30M profiles from Visium, Visium HD, Xenium, and MERFISH across 821 slides. ✨ Revolutionary MoE Decoders – A cutting-edge Mixture of Experts (MoE) architecture for protocol-aware gene expression decoding. ✨ Spatially-Aware Training Strategy – A neighborhood-based masked reconstruction approach to capture complex cell-type colocalization. ✨ Multi-Modal & Multi-Slide Integration – Seamless clustering & spatial domain identification across slides and modalities. ✨ Cell-Type Deconvolution & Gene Imputation – Unlocks cross-resolution & cross-modality harmonization with fine-tuned embeddings. 📄 Read the preprint: 💻 Explore the code/weights: #SpatialTranscriptomics #SingleCell #AIResearch #MachineLearning #SpatialData Huge shoutout to the incredible PHD students Chloe (ChloeXWang) and Haotian (Haotian Cui) for leading this groundbreaking project! 🎉 Massive thanks to our amazing co-authors Andrew, Ronald, and Hani (Hani Goodarzi) from Arc Institute—this work wouldn't have been possible without you! 👏

Bo Wang

58,991 Aufrufe • vor 1 Jahr

We present VLM-3R: a Vision-Language Model capable of 3D spatial reasoning from monocular video, grounding visual cues, geometry, and camera motion. ✅ No depth sensor ✅ No pre-built 3D maps ✅ End-to-end spatial + temporal reasoning 🔗 Code & benchmark: #VLM #3DVision #LLMs
0:20

We present VLM-3R: a Vision-Language Model capable of 3D spatial reasoning from monocular video, grounding visual cues, geometry, and camera motion. ✅ No depth sensor ✅ No pre-built 3D maps ✅ End-to-end spatial + temporal reasoning 🔗 Code & benchmark: #VLM #3DVision #LLMs

Zhiwen(Aaron) Fan

14,895 Aufrufe • vor 1 Jahr

Here’s a demo of our Agentic Memory system, inspired by how our own brain holds information in a 3D spatial space. This feels, natural. Extending this further, we announced the Agentic Memory Protocol on July 15th in SF - which enables memory to be local, encrypted and available to other agents and apps based on your permission-only. We believe this is the future of memory - not owned by any one app, spatial, and always improving. Aaron Levie Andrej Karpathy
1:03

Here’s a demo of our Agentic Memory system, inspired by how our own brain holds information in a 3D spatial space. This feels, natural. Extending this further, we announced the Agentic Memory Protocol on July 15th in SF - which enables memory to be local, encrypted and available to other agents and apps based on your permission-only. We believe this is the future of memory - not owned by any one app, spatial, and always improving. Aaron Levie Andrej Karpathy

Varun

187,489 Aufrufe • vor 10 Monaten

Spatial optimization has applications in nearly every field but it's underutilized. In 2026, I'm working on open source and lightning-fast tools to make spatial optimization accessible. Shown: interactively solving a "location-allocation" problem in an app with instant results.
0:43

Spatial optimization has applications in nearly every field but it's underutilized. In 2026, I'm working on open source and lightning-fast tools to make spatial optimization accessible. Shown: interactively solving a "location-allocation" problem in an app with instant results.

Kyle Walker

28,495 Aufrufe • vor 5 Monaten

Video to Spatial conversion coming soon to Spatial Media Tookit. Here's 1080p 10sec Sora mammoth video, all converted on device. The effect is unreal. #visonpro #spatialvideo #sora You can already convert Photos to Spatial right now! download here:
0:37

Video to Spatial conversion coming soon to Spatial Media Tookit. Here's 1080p 10sec Sora mammoth video, all converted on device. The effect is unreal. #visonpro #spatialvideo #sora You can already convert Photos to Spatial right now! download here:

Ryan Gordon

12,130 Aufrufe • vor 2 Jahren