Загрузка видео...

Не удалось загрузить видео

На главную

Coarse2Real (C2R) transfers simple 3D renderings into realistic style video. Check our paper and project page to learn how to hedge small amount of synthetic paired data with real non-pair data for training the C2R model. We will release the model soon!

Papagina_Yi's profile picture

Yi Zhou

1,383 subscribers

12,406 просмотров • 2 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Grok 4.4 with proper 𝕏 training data is coming soon. It will be the first Grok model release with 1T parameters.
0:10

Grok 4.4 with proper 𝕏 training data is coming soon. It will be the first Grok model release with 1T parameters.

Testlabor

16,269 просмотров • 2 месяцев назад

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.
0:13

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.

MrNeRF

27,428 просмотров • 1 год назад

GPT-4 is the new data scientist 🤯 With the new OpenAI code interpreter model, you just have to upload the data and provide instructions in simple english. The model does everything from cleaning data to generating insightful visualizations on autopilot!!
0:14

GPT-4 is the new data scientist 🤯 With the new OpenAI code interpreter model, you just have to upload the data and provide instructions in simple english. The model does everything from cleaning data to generating insightful visualizations on autopilot!!

Shubham Saboo

1,693,352 просмотров • 3 лет назад

My sister and I are putting great care into the physics of our 3D customizable vtuber avatar! -^u^- We wanna make the tails as flowy as possible! 🐾 Here is the link to our model's preview page! A guide on how to use the model will be uploaded soon 🩷
0:13

My sister and I are putting great care into the physics of our 3D customizable vtuber avatar! -^u^- We wanna make the tails as flowy as possible! 🐾 Here is the link to our model's preview page! A guide on how to use the model will be uploaded soon 🩷

Pastell & Palette🤍 3D Customizable Model!

14,921 просмотров • 8 месяцев назад

Thanks for the tweet. We improve 3D Gaussain splatting for dash cam videos that contain serious reflections and obstructions. With Dash cam videos, it's possible to leverage massive driving data. Visit our page at Codes will be soon.
0:11

Thanks for the tweet. We improve 3D Gaussain splatting for dash cam videos that contain serious reflections and obstructions. With Dash cam videos, it's possible to leverage massive driving data. Visit our page at Codes will be soon.

Xiao-Xiao Long

44,444 просмотров • 2 лет назад

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.
0:18

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

Alec Helbling

65,253 просмотров • 1 месяц назад

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]
0:14

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]

Francis Williams

42,417 просмотров • 2 лет назад

Diffusions are excellent in creating fantastic images and videos 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/n
0:15

Diffusions are excellent in creating fantastic images and videos 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/n

Minkai Xu

50,434 просмотров • 1 год назад

It's almost out! In just 3 hours, our 3D vtuber customizable model will release! 🩷-^u^- Stay tuned for full showcase! For those new to 3D or Warudo, a guide on how to use the model will be included <3
0:16

It's almost out! In just 3 hours, our 3D vtuber customizable model will release! 🩷-^u^- Stay tuned for full showcase! For those new to 3D or Warudo, a guide on how to use the model will be included <3

Pastell & Palette🤍 3D Customizable Model!

21,293 просмотров • 8 месяцев назад

A Letter to Our Community: The Road Ahead for Robotics To our Community and Partners, As we step into 2026, our mission at Axis is clearer than ever: Constructing the definitive End-to-End Scaling Layer for Robotics. Our goal is to accelerate the transfer of diverse human intelligence into Robotics General Intelligence (RGI). By owning the critical path of intelligence creation, we are turning the physical limitations of robotics into a scalable, software-driven future. Here is our strategic outlook and roadmap for the year ahead. The Core Thesis: Simulation is the Only Way Out The path to RGI is currently blocked by Data Scarcity, Generalization Fragility, and Hardware Fragmentation. At Axis, we believe Simulation is the only way out. Our Simulation Data Platform and Data Augmentation Engine transform raw data into "Synthetic Gold". Backed by academic milestones like Roboverse, Skill Blending, and GraspVLA, we have proven that pure simulation can achieve the generalization required for the real world. We don’t just collect data; we architect it. The Engine: Why Crypto? We believe RGI should come from all, not a few. Crypto is not just a feature; it is the primitive that powers our entire ecosystem flywheel: - Incentive Mechanism: Democratizing contribution and rewarding the trainers and developers. - Assetization: Turning proprietary data and refined models into liquid, ownable assets. - Verifiable Workflow: We are opening the "Black Box" of AI. By bringing total transparency to the Task Generation → Data Collection → Model Training pipeline, we ensure every byte of intelligence is verifiable, traceable, and secure. 2026 Strategic Deliverables This year, we are committed to delivering three foundational pillars: - The World's Largest Training Dataset for Robots: A robot training set—diverse, high-quality interaction data at an unprecedented scale. - A Robotics Foundation Model: A universal robotic brain trained on our pure simulation and synthetic data, capable of robust cross-embodiment transfer and open-world adaptability. - Evolvable Robot Hardware: Robots deployed with Axis models that autonomously evolve through continuous interaction, turning every deployment into a self-improving node within our RGI network. The Ultimate Vision We are building more than models; we are architecting the Distributed Machine Economy. A future where every dataset, model, and robotic embodiment is a verifiable asset in a global, autonomous network. Thank you for building the future of intelligence with us✌️📷
0:13

A Letter to Our Community: The Road Ahead for Robotics To our Community and Partners, As we step into 2026, our mission at Axis is clearer than ever: Constructing the definitive End-to-End Scaling Layer for Robotics. Our goal is to accelerate the transfer of diverse human intelligence into Robotics General Intelligence (RGI). By owning the critical path of intelligence creation, we are turning the physical limitations of robotics into a scalable, software-driven future. Here is our strategic outlook and roadmap for the year ahead. The Core Thesis: Simulation is the Only Way Out The path to RGI is currently blocked by Data Scarcity, Generalization Fragility, and Hardware Fragmentation. At Axis, we believe Simulation is the only way out. Our Simulation Data Platform and Data Augmentation Engine transform raw data into "Synthetic Gold". Backed by academic milestones like Roboverse, Skill Blending, and GraspVLA, we have proven that pure simulation can achieve the generalization required for the real world. We don’t just collect data; we architect it. The Engine: Why Crypto? We believe RGI should come from all, not a few. Crypto is not just a feature; it is the primitive that powers our entire ecosystem flywheel: - Incentive Mechanism: Democratizing contribution and rewarding the trainers and developers. - Assetization: Turning proprietary data and refined models into liquid, ownable assets. - Verifiable Workflow: We are opening the "Black Box" of AI. By bringing total transparency to the Task Generation → Data Collection → Model Training pipeline, we ensure every byte of intelligence is verifiable, traceable, and secure. 2026 Strategic Deliverables This year, we are committed to delivering three foundational pillars: - The World's Largest Training Dataset for Robots: A robot training set—diverse, high-quality interaction data at an unprecedented scale. - A Robotics Foundation Model: A universal robotic brain trained on our pure simulation and synthetic data, capable of robust cross-embodiment transfer and open-world adaptability. - Evolvable Robot Hardware: Robots deployed with Axis models that autonomously evolve through continuous interaction, turning every deployment into a self-improving node within our RGI network. The Ultimate Vision We are building more than models; we are architecting the Distributed Machine Economy. A future where every dataset, model, and robotic embodiment is a verifiable asset in a global, autonomous network. Thank you for building the future of intelligence with us✌️📷

Axis Robotics

27,858 просмотров • 6 месяцев назад

The Blender Grease Pencil is great for 2D animation, storyboarding, 3D sketching, illustrating, and allows devs to draw directly into the 3D viewport. Check out SIMON BLAKENEY's tutorial on how to bring Grease Pencil data over to the Epic Ecosystem of tools and start creating non-photorealistic styles!:
0:19

The Blender Grease Pencil is great for 2D animation, storyboarding, 3D sketching, illustrating, and allows devs to draw directly into the 3D viewport. Check out SIMON BLAKENEY's tutorial on how to bring Grease Pencil data over to the Epic Ecosystem of tools and start creating non-photorealistic styles!:

Unreal Engine

15,464 просмотров • 10 месяцев назад

We’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. Learn more about how Dynamic Byte Latent Transformer is paving the way for groundbreaking developments in the field of language modeling. Read the research paper, and download the model and code.
0:12

We’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. Learn more about how Dynamic Byte Latent Transformer is paving the way for groundbreaking developments in the field of language modeling. Read the research paper, and download the model and code.

AI at Meta

195,546 просмотров • 1 год назад

Introducing Make-A-Video3D! Generating 3D dynamic (mini) scenes from input text. That is, text --> 4D! Needs no 4D data (i.e., no dynamic 3D data), no static 3D data, no paired text-video data. Paper: Website:
0:16

Introducing Make-A-Video3D! Generating 3D dynamic (mini) scenes from input text. That is, text --> 4D! Needs no 4D data (i.e., no dynamic 3D data), no static 3D data, no paired text-video data. Paper: Website:

Devi Parikh

305,729 просмотров • 3 лет назад

A real-time AI motion capture model with 1B parameters. Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.
0:13

A real-time AI motion capture model with 1B parameters. Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.

CYANPUPPETS

36,748 просмотров • 4 месяцев назад

With 3M+ downloads and counting, NVIDIA Cosmos is redefining physical AI. Announced at #CORL25, new Cosmos updates are allowing developers to generate diverse data for accelerating training robot models at scale. 👏 Cosmos Predict 2.5 will combine three models into one powerful model—reducing complexity, powering up to 30s video generation, and enabling multi-view simulations. 👏 Cosmos Transfer 2.5 will be 3.5x smaller yet faster and sharper—generating photorealistic synthetic data from 3D scenes or spatial inputs. 🔗
0:15

With 3M+ downloads and counting, NVIDIA Cosmos is redefining physical AI. Announced at #CORL25, new Cosmos updates are allowing developers to generate diverse data for accelerating training robot models at scale. 👏 Cosmos Predict 2.5 will combine three models into one powerful model—reducing complexity, powering up to 30s video generation, and enabling multi-view simulations. 👏 Cosmos Transfer 2.5 will be 3.5x smaller yet faster and sharper—generating photorealistic synthetic data from 3D scenes or spatial inputs. 🔗

NVIDIA AI

40,332 просмотров • 9 месяцев назад

🎉 We just released code, data and model for our #SIGGRAPH2023 work "CT2Hair"!! CT2Hair achieves fully automatic reconstruction of production-ready hair strands from computed tomography (CT) scans!! Code&Data: Project:
0:14

🎉 We just released code, data and model for our #SIGGRAPH2023 work "CT2Hair"!! CT2Hair achieves fully automatic reconstruction of production-ready hair strands from computed tomography (CT) scans!! Code&Data: Project:

Shunsuke Saito

56,125 просмотров • 2 лет назад

🚨How do LLMs acquire human values?🤔 We often point to preference optimization. However, in our new work, we trace how and when model values shift during post-training and uncover surprising dynamics. We ask: How do data, algorithms, and their interaction shape model values?🧵
0:18

🚨How do LLMs acquire human values?🤔 We often point to preference optimization. However, in our new work, we trace how and when model values shift during post-training and uncover surprising dynamics. We ask: How do data, algorithms, and their interaction shape model values?🧵

Mehar Bhatia

41,286 просмотров • 8 месяцев назад