Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Dissolve Shader = Interactive edge glow + world space control. Perfect for enemy deaths or teleport effects! by @techartshahbaz. #Unity #ShaderGraph #TechArt #GameDev"

VFX_Therapy's profile picture

VFX Therapy

10,538 subscribers

12,974 Aufrufe • vor 2 Monaten •via X (Twitter)

#Unity#ShaderGraph#TechArt#GameDev
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Stunning interactive waterfall shader's breakdown in 30sec by Josué Ortigoza Ramos, crafted with Unity and Shader Graph. #GameDev #ShaderGraph #Unity3D"
0:38

Stunning interactive waterfall shader's breakdown in 30sec by Josué Ortigoza Ramos, crafted with Unity and Shader Graph. #GameDev #ShaderGraph #Unity3D"

VFX Therapy

48,288 Aufrufe • vor 1 Jahr

Want to achieve realistic caustics? You can do it by projecting a texture in world space using a shader. Don't know how to code shaders? Here are some books for Unity and Godot 🔗 #gamedev
0:31

Want to achieve realistic caustics? You can do it by projecting a texture in world space using a shader. Don't know how to code shaders? Here are some books for Unity and Godot 🔗 #gamedev

Shaders Bible Series

22,559 Aufrufe • vor 5 Tagen

"Learn Daniel Santalla's quick technique for creating interactive snow trails in Unity! Perfect for car tracks or footsteps, all in under 60 seconds! #Unity3D #GameDev #Under60Sec"
1:09

"Learn Daniel Santalla's quick technique for creating interactive snow trails in Unity! Perfect for car tracks or footsteps, all in under 60 seconds! #Unity3D #GameDev #Under60Sec"

VFX Therapy

61,242 Aufrufe • vor 1 Jahr

I’m really excited to announce that the writing of The Shader Survival Guide is done! We’re now working on the final formatting for this e-book about shader development using Shader Graph in Unity. I also want to mention that this is an interactive e-book that will include a Unity 6 project with lots of shader samples to help you understand the topics covered. This book contains more than 500 pages of knowledge I’ve gained over 10 years working as a Technical Artist in the video game industry. It will be released in the last days of June, so if you’re interested in these topics, consider adding it to your wishlist! We’ll keep you updated with more news. #shader #shadergraph #madewithunity #shadersurvivalguide #hlsl #gamedev #gameart #vfx
0:22

I’m really excited to announce that the writing of The Shader Survival Guide is done! We’re now working on the final formatting for this e-book about shader development using Shader Graph in Unity. I also want to mention that this is an interactive e-book that will include a Unity 6 project with lots of shader samples to help you understand the topics covered. This book contains more than 500 pages of knowledge I’ve gained over 10 years working as a Technical Artist in the video game industry. It will be released in the last days of June, so if you’re interested in these topics, consider adding it to your wishlist! We’ll keep you updated with more news. #shader #shadergraph #madewithunity #shadersurvivalguide #hlsl #gamedev #gameart #vfx

Josue Ortigoza

22,919 Aufrufe • vor 3 Monaten

🚀 Real-time Gaussian Splat Morphing Unlike typical cross-fades, this actually moves each splat through 3D world space from source → target positions. World Labs Features: -Per-splat speed control with stagger effects -3D turbulence noise for organic paths -8 transition modes (radial, directional reveals) -GPU compute shader - handles millions of splats #madewithunity #worldlabs #realtime #computeshader #Gaussiansplatting
0:28

🚀 Real-time Gaussian Splat Morphing Unlike typical cross-fades, this actually moves each splat through 3D world space from source → target positions. World Labs Features: -Per-splat speed control with stagger effects -3D turbulence noise for organic paths -8 transition modes (radial, directional reveals) -GPU compute shader - handles millions of splats #madewithunity #worldlabs #realtime #computeshader #Gaussiansplatting

Daniel Skaale

47,397 Aufrufe • vor 8 Monaten

🌊: Ever wondered what cutting-edge physics simulation looks like in the browser? Check out saharan / さはら's collection at - Realistic water droplets with WebAssembly SIMD - Interactive fluffy ball sim using GPGPU - Coupled cloth and fluid dynamics in real-time - A digital clock powered by a custom physics engine Saharan built everything in Haxe using techniques like MLS-MPM and parallel computation. The physical accuracy and performance are exceptional. All MIT-licensed on GitHub. Perfect if you're exploring GPGPU techniques, browser physics, or just want to see what's possible with WebGL/WebGPU. #WebGL #WebGPU #Physics #GameDev #ComputationalPhysics
1:55

🌊: Ever wondered what cutting-edge physics simulation looks like in the browser? Check out saharan / さはら's collection at - Realistic water droplets with WebAssembly SIMD - Interactive fluffy ball sim using GPGPU - Coupled cloth and fluid dynamics in real-time - A digital clock powered by a custom physics engine Saharan built everything in Haxe using techniques like MLS-MPM and parallel computation. The physical accuracy and performance are exceptional. All MIT-licensed on GitHub. Perfect if you're exploring GPGPU techniques, browser physics, or just want to see what's possible with WebGL/WebGPU. #WebGL #WebGPU #Physics #GameDev #ComputationalPhysics

WebGL / WebGPU

14,778 Aufrufe • vor 7 Monaten

𝗦𝗰𝗶𝗲𝗻𝗰𝗲 𝗖𝗶𝘁𝘆 Hyderabad is set to embark on a remarkable journey of scientific discovery with the upcoming Science Experience Centre. The centre to be established by Govt of India at CSIR-IICT with a budget of ₹232.70 Crores will have: ➡️ Interactive and immersive exhibition halls ➡️ Motion simulators ➡️ A walk-through aquarium ➡️ 3D digital dome theatre ➡️ Dedicated exhibitions on astronomy and space sciences ➡️ A cutting-edge robotics centre ➡️ Innovation hubs and activity zones for students This world-class facility will inspire young minds, spark innovation, and provide hands-on learning experiences for the youth of Telangana.
8:40

𝗦𝗰𝗶𝗲𝗻𝗰𝗲 𝗖𝗶𝘁𝘆 Hyderabad is set to embark on a remarkable journey of scientific discovery with the upcoming Science Experience Centre. The centre to be established by Govt of India at CSIR-IICT with a budget of ₹232.70 Crores will have: ➡️ Interactive and immersive exhibition halls ➡️ Motion simulators ➡️ A walk-through aquarium ➡️ 3D digital dome theatre ➡️ Dedicated exhibitions on astronomy and space sciences ➡️ A cutting-edge robotics centre ➡️ Innovation hubs and activity zones for students This world-class facility will inspire young minds, spark innovation, and provide hands-on learning experiences for the youth of Telangana.

G Kishan Reddy

14,555 Aufrufe • vor 8 Monaten

Step into the map with the Street View grounding feature in Project Genie from Google DeepMind and Google Labs. Announced at I/O, this research prototype uses locations from Google Maps Street View as a foundation, letting you generate and explore interactive, 360-degree virtual environments from just a text prompt or real-world starting place. Cool, right? But… How does it actually work? 🤔 As an experimental tool, Project Genie tackles the "blank space" problem (showing both what’s in front of the camera and behind it) by utilizing Street View data to realistically generate a 360-degree view of the location you selected as the starting point for your world to generate from. Worlds generated by Genie are far more dynamic and rich because they’re created frame-by-frame based on the world description and user actions. By predicting each subsequent frame, Genie is able to simulate what it looks like to swim across an ocean, or hike to the top of a peak, marking a massive shift in interactive media and simulation pipelines. What real-world place would you want to step into and explore?
0:27

Step into the map with the Street View grounding feature in Project Genie from Google DeepMind and Google Labs. Announced at I/O, this research prototype uses locations from Google Maps Street View as a foundation, letting you generate and explore interactive, 360-degree virtual environments from just a text prompt or real-world starting place. Cool, right? But… How does it actually work? 🤔 As an experimental tool, Project Genie tackles the "blank space" problem (showing both what’s in front of the camera and behind it) by utilizing Street View data to realistically generate a 360-degree view of the location you selected as the starting point for your world to generate from. Worlds generated by Genie are far more dynamic and rich because they’re created frame-by-frame based on the world description and user actions. By predicting each subsequent frame, Genie is able to simulate what it looks like to swim across an ocean, or hike to the top of a peak, marking a massive shift in interactive media and simulation pipelines. What real-world place would you want to step into and explore?

Google AI

3,340,681 Aufrufe • vor 28 Tagen

The successful man doesn’t waste time overanalyzing every decision. He doesn’t drown in research or wait for the “perfect moment.” He understands momentum is built by doing, not by planning. Action creates feedback. Feedback creates clarity. While others debate the best method, he experiments, adapts, and sharpens his edge through real-world execution. He knows confidence is earned by collecting wins, not collecting ideas. And most importantly, he values progress over perfection. He may not always get it right on the first try—but he never gets left behind.
0:48

The successful man doesn’t waste time overanalyzing every decision. He doesn’t drown in research or wait for the “perfect moment.” He understands momentum is built by doing, not by planning. Action creates feedback. Feedback creates clarity. While others debate the best method, he experiments, adapts, and sharpens his edge through real-world execution. He knows confidence is earned by collecting wins, not collecting ideas. And most importantly, he values progress over perfection. He may not always get it right on the first try—but he never gets left behind.

Man’s Bible⚡️

43,458 Aufrufe • vor 1 Jahr

Blue Max (1983) was developed by Bob Polin and published by Synapse Software for Atari 8-bit computers and Commodore 64. You control a World War I plane in an isometric view (those of you who played Zaxxon will feel familiar with the perspective), flying over rivers, roads, and enemy territory. The goal is to bomb ground targets, strafe enemies, and ultimately destroy the enemy headquarters while surviving anti-aircraft fire and dogfights. For 1983 the graphics were absoluetly top notch, and so were the music and effects. Isometric perspectives were not common for early 80s games, and the altitude and timing when you dropped the bombs really mattered. Another one of those early 80s games that were developed by a single person - Polin created the original Atari version, Adams did the C64 port - I find that remarkable. Speaking of remarkable: The game's total size was 20 KB, less than an average desktop icon on your PC.
1:21

Blue Max (1983) was developed by Bob Polin and published by Synapse Software for Atari 8-bit computers and Commodore 64. You control a World War I plane in an isometric view (those of you who played Zaxxon will feel familiar with the perspective), flying over rivers, roads, and enemy territory. The goal is to bomb ground targets, strafe enemies, and ultimately destroy the enemy headquarters while surviving anti-aircraft fire and dogfights. For 1983 the graphics were absoluetly top notch, and so were the music and effects. Isometric perspectives were not common for early 80s games, and the altitude and timing when you dropped the bombs really mattered. Another one of those early 80s games that were developed by a single person - Polin created the original Atari version, Adams did the C64 port - I find that remarkable. Speaking of remarkable: The game's total size was 20 KB, less than an average desktop icon on your PC.

exQUIZitely 🕹️

16,332 Aufrufe • vor 4 Monaten

Battle for the #RedSea 🔥 -- It is time for 🇸🇴🇸🇦🇹🇷🇪🇬🇩🇯 and every other party with a geopolitical stake to formalize a #Defense Alliance and mount together a solid military resistance to this unprecedented immediate threat by Israel & UAE against regional stability. After US' action in Venezuela and inaction in Gaza, it is CRYSTAL CLEAR that the #UN/int'l law/courts mechanism has completely collapsed and we're back to a kill or be killed world. The enemy only respects military power, and thus, it's time for us to earn that respect. Let's make brotherly #Somalia the symbol of our sacred unity. 🪖
2:13

Battle for the #RedSea 🔥 -- It is time for 🇸🇴🇸🇦🇹🇷🇪🇬🇩🇯 and every other party with a geopolitical stake to formalize a #Defense Alliance and mount together a solid military resistance to this unprecedented immediate threat by Israel & UAE against regional stability. After US' action in Venezuela and inaction in Gaza, it is CRYSTAL CLEAR that the #UN/int'l law/courts mechanism has completely collapsed and we're back to a kill or be killed world. The enemy only respects military power, and thus, it's time for us to earn that respect. Let's make brotherly #Somalia the symbol of our sacred unity. 🪖

Turkish Century

146,690 Aufrufe • vor 7 Monaten

Google presents Genie Generative Interactive Environments introduce Genie, the first generative interactive environment trained in an unsupervised manner from unlabelled Internet videos. The model can be prompted to generate an endless variety of action-controllable virtual worlds described through text, synthetic images, photographs, and even sketches. At 11B parameters, Genie can be considered a foundation world model. It is comprised of a spatiotemporal video tokenizer, an autoregressive dynamics model, and a simple and scalable latent action model. Genie enables users to act in the generated environments on a frame-by-frame basis despite training without any ground-truth action labels or other domain-specific requirements typically found in the world model literature. Further the resulting learned latent action space facilitates training agents to imitate behaviors from unseen videos, opening the path for training generalist agents of the future.
0:27

Google presents Genie Generative Interactive Environments introduce Genie, the first generative interactive environment trained in an unsupervised manner from unlabelled Internet videos. The model can be prompted to generate an endless variety of action-controllable virtual worlds described through text, synthetic images, photographs, and even sketches. At 11B parameters, Genie can be considered a foundation world model. It is comprised of a spatiotemporal video tokenizer, an autoregressive dynamics model, and a simple and scalable latent action model. Genie enables users to act in the generated environments on a frame-by-frame basis despite training without any ground-truth action labels or other domain-specific requirements typically found in the world model literature. Further the resulting learned latent action space facilitates training agents to imitate behaviors from unseen videos, opening the path for training generalist agents of the future.

AK

684,372 Aufrufe • vor 2 Jahren

What would a World Model look like if we start from a real embodied agent acting in the real world? It has to have: 1) A real, physically grounded and complex action space—not just abstract control signals. 2) Diverse, real-life scenarios and activities. Or in short: It has to be annoyingly complex—in both the action and vision space—to even get close to real life. We did an initial attempt: Whole-Body Conditioned Egocentric Video Prediction. In collaboration with @dans_t123 , Amir Bar, Yann LeCun , trevordarrell and Jitendra MALIK. (For more details, check: What we did is very simple: Predict Egocentric Video from human Actions (PEVA) - Given the past video and a future action represented by relative 3D body pose, PEVA predicts how the world looks next—from the first-person view. By conditioning on kinematic pose trajectories, structured by the joint hierarchy of the body, it learns how physical actions shape perception.
3:12

What would a World Model look like if we start from a real embodied agent acting in the real world? It has to have: 1) A real, physically grounded and complex action space—not just abstract control signals. 2) Diverse, real-life scenarios and activities. Or in short: It has to be annoyingly complex—in both the action and vision space—to even get close to real life. We did an initial attempt: Whole-Body Conditioned Egocentric Video Prediction. In collaboration with @dans_t123 , Amir Bar, Yann LeCun , trevordarrell and Jitendra MALIK. (For more details, check: What we did is very simple: Predict Egocentric Video from human Actions (PEVA) - Given the past video and a future action represented by relative 3D body pose, PEVA predicts how the world looks next—from the first-person view. By conditioning on kinematic pose trajectories, structured by the joint hierarchy of the body, it learns how physical actions shape perception.

Yutong Bai

179,017 Aufrufe • vor 1 Jahr

One of Russia's most aggressively pushed disinformation narratives regarding the events of 2014 surrounds their failed takeover of the city of Odesa. On May 2nd, 2014, Russians and paid pro-Russian thugs attacked city residents during a march for unity. This ended in 48 deaths amid the burning Trade Unions building. Russia then allocated enormous resources toward convincing the world these pro-Russians were "peaceful demonstrators" attacked by "Ukrainian nationalists" or "nazis". One of those "peaceful demonstrators" can be seen here, shortly before his death on that day, a Russian citizen, Gennadiy Kushnarev from Chelyabinsk, explaining how he will "shoot down" Ukrainians "like dogs".
0:34

One of Russia's most aggressively pushed disinformation narratives regarding the events of 2014 surrounds their failed takeover of the city of Odesa. On May 2nd, 2014, Russians and paid pro-Russian thugs attacked city residents during a march for unity. This ended in 48 deaths amid the burning Trade Unions building. Russia then allocated enormous resources toward convincing the world these pro-Russians were "peaceful demonstrators" attacked by "Ukrainian nationalists" or "nazis". One of those "peaceful demonstrators" can be seen here, shortly before his death on that day, a Russian citizen, Gennadiy Kushnarev from Chelyabinsk, explaining how he will "shoot down" Ukrainians "like dogs".

SPRAVDI — Stratcom Centre

23,605 Aufrufe • vor 3 Monaten

Elon Musk is changing the world SpaceX is making space travel much cheaper by reusing rockets. Launch costs dropped 85% and they now launch over 80% of everything going into orbit Most of SpaceX’s money actually comes from Starlink, their satellite internet service with 10 million customers, not just rocket launches Elon Musk is combining SpaceX with his other companies, xAI, Groq, and X. He’s planning to take it public through a huge IPO The big vision: Build giant AI data centers in space. Why space? - Unlimited cheap solar power from the sun - Very cold temperatures, perfect for cooling computers - No angry neighbors or strict environmental rules This would cost a fortune, so they want to raise money from public investors This in my opinion is the best part, Elon Musk is making sure he stays in control of decisions Musk will have 10x voting power over the whole company If you invest, you’re mostly betting on Elon Musk himself This is exactly what you want. You want Musk making the decisions not being overruled by people with other motives
2:50

Elon Musk is changing the world SpaceX is making space travel much cheaper by reusing rockets. Launch costs dropped 85% and they now launch over 80% of everything going into orbit Most of SpaceX’s money actually comes from Starlink, their satellite internet service with 10 million customers, not just rocket launches Elon Musk is combining SpaceX with his other companies, xAI, Groq, and X. He’s planning to take it public through a huge IPO The big vision: Build giant AI data centers in space. Why space? - Unlimited cheap solar power from the sun - Very cold temperatures, perfect for cooling computers - No angry neighbors or strict environmental rules This would cost a fortune, so they want to raise money from public investors This in my opinion is the best part, Elon Musk is making sure he stays in control of decisions Musk will have 10x voting power over the whole company If you invest, you’re mostly betting on Elon Musk himself This is exactly what you want. You want Musk making the decisions not being overruled by people with other motives

Wall Street Apes

28,675 Aufrufe • vor 2 Monaten

Exploring 3D Generation Capabilities in Alchemist AI🔮 Alchemist AI now enables users to create basic 3D assets, including models, objects, environments, and simulations, expanding its capabilities beyond 2D asset generation. What Does This Mean for You? • 3D Environment Creation: Generate virtual worlds, such as game environments or fantasy landscapes. Define parameters like terrain or structures to create dynamic and adaptable spaces tailored to your needs. • Customizable 3D Models and Objects: Design and modify 3D assets by adjusting dimensions, materials, and textures. Whether crafting prototypes or characters, users maintain full creative control. • Interactive Simulations: Build physics-based simulations or animated scenes. With upcoming support for sprite libraries and animation rigs, fine-tune object behaviors and interactions to suit your projects. With future API updates, Alchemist AI’s 3D generation capabilities will further expand, enhancing tools for creating models, environments, and simulations. AI-assisted text-to-3D will also be introduced—just describe your vision, such as 'space station' or 'orange sports car' and the system will generate customizable base assets.
0:20

Exploring 3D Generation Capabilities in Alchemist AI🔮 Alchemist AI now enables users to create basic 3D assets, including models, objects, environments, and simulations, expanding its capabilities beyond 2D asset generation. What Does This Mean for You? • 3D Environment Creation: Generate virtual worlds, such as game environments or fantasy landscapes. Define parameters like terrain or structures to create dynamic and adaptable spaces tailored to your needs. • Customizable 3D Models and Objects: Design and modify 3D assets by adjusting dimensions, materials, and textures. Whether crafting prototypes or characters, users maintain full creative control. • Interactive Simulations: Build physics-based simulations or animated scenes. With upcoming support for sprite libraries and animation rigs, fine-tune object behaviors and interactions to suit your projects. With future API updates, Alchemist AI’s 3D generation capabilities will further expand, enhancing tools for creating models, environments, and simulations. AI-assisted text-to-3D will also be introduced—just describe your vision, such as 'space station' or 'orange sports car' and the system will generate customizable base assets.

ALCHEMIST AI 🔮

35,673 Aufrufe • vor 1 Jahr

AI for robotics has some monumental challenges, like high dimensionality and reasoning with the physical world. Ashok Elluswamy, AI lead at Tesla, thinks the hardest problem is Evaluation. - Loss isn't a perfect indicator of Policy Neural Network's quality. - Testing in the real world for all the long-tail failure cases is not possible. To solve the evaluation challenge, Tesla has developed a World Simulator Model. It is trained on state and action pairs, so for a given current camera feed and current action, the model generates the next frame in the cameras. Once the world simulation is good enough, it can be hooked up to the policy network for a closed-loop simulation. In this setup, the model generates the next video frames, and based on those, the policy network comes up with the next action, which feeds back into the world simulation; this continuous loop creates a coherent simulation. The world simulation neural network is not just applicable to self-driving but also to humanoids, because Tesla trains it on common data. The examples show Optimus navigating or manipulating inside the world simulation, with all the pixels being generated by the world simulation model. The robotic agents can be tested in an accurately reproduced edge case and in other potential variations of the same edge case.
1:29

AI for robotics has some monumental challenges, like high dimensionality and reasoning with the physical world. Ashok Elluswamy, AI lead at Tesla, thinks the hardest problem is Evaluation. - Loss isn't a perfect indicator of Policy Neural Network's quality. - Testing in the real world for all the long-tail failure cases is not possible. To solve the evaluation challenge, Tesla has developed a World Simulator Model. It is trained on state and action pairs, so for a given current camera feed and current action, the model generates the next frame in the cameras. Once the world simulation is good enough, it can be hooked up to the policy network for a closed-loop simulation. In this setup, the model generates the next video frames, and based on those, the policy network comes up with the next action, which feeds back into the world simulation; this continuous loop creates a coherent simulation. The world simulation neural network is not just applicable to self-driving but also to humanoids, because Tesla trains it on common data. The examples show Optimus navigating or manipulating inside the world simulation, with all the pixels being generated by the world simulation model. The robotic agents can be tested in an accurately reproduced edge case and in other potential variations of the same edge case.

The Humanoid Hub

17,065 Aufrufe • vor 6 Monaten

A differently-abled man is forced to ride his tricycle on the very edge of the footpath because it has been completely encroached upon by local vendors. While trying to squeeze through the narrow space, he loses balance and falls. This is the reality in India. Even footpaths are not safe or accessible for the people who actually need them the most. Encroachment everywhere, zero enforcement, and complete neglect of basic civic responsibility. A country that cannot even keep its footpaths clear for a differently-abled person should seriously question its claims of development. Sometimes it feels like nothing will ever change in this third-world chaos.
0:24

A differently-abled man is forced to ride his tricycle on the very edge of the footpath because it has been completely encroached upon by local vendors. While trying to squeeze through the narrow space, he loses balance and falls. This is the reality in India. Even footpaths are not safe or accessible for the people who actually need them the most. Encroachment everywhere, zero enforcement, and complete neglect of basic civic responsibility. A country that cannot even keep its footpaths clear for a differently-abled person should seriously question its claims of development. Sometimes it feels like nothing will ever change in this third-world chaos.

The Nalanda Index

21,398 Aufrufe • vor 5 Monaten

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:26

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

59,835 Aufrufe • vor 7 Monaten

🧑‍🏫 How to make a glass/refraction shader: 🍷 Refraction will ultimately have the effect that whatever is behind your mesh should appear distorted by the surface of the mesh itself. We're not going for external caustics projection, just modelling glass-like, distorting "transparency". 🌆 In Unity, you can sample the *global* _CameraOpaqueTexture (make sure it's enabled in your URP asset settings), which is what your scene looks like rendered without any transparent objects. In Shader Graph, you can simply use the Scene Colour node. 🔢 The UVs required for this texture are the normalized screen coordinates, so if we offset/warp/distort these coordinates and sample the texture, we ultimately produce a distorted image. We can offset the UVs by some normal map, as well as a refraction vector based on the direction from the camera -> the vertex/fragment (flip viewDir, which is otherwise vertex/fragment -> camera) and normals of the object. 📸 Input the (reversed) world space view direction and normal into HLSL refract. **Convert the refraction direction vector to tangent space before adding it to the screen UV.** Use the result to sample _CameraOpaqueTexture. refract(-worldViewDirection, worldNormal, eta); eta -> refraction ratio (from_IOR / to_IOR), > for air, 1.0 / indexOfRefraction (IOR). IOR of water = 1.33, glass = 1.54... 💡 You can also do naive "looks about right" hacks: fresnel -> normal from grayscale, which can be used for distortion. Or distort it any other way (without even specifically using refract at all), really... 🧠 Thus, even if your object is rendered as a transparent type (and vanilla Unity URP will require that it is), it is fully 'opaque' (max alpha), but it renders on its surface what is behind it, using the screen UV. If you distort those UVs by the camera view and normals of the surface it will be rendered on, it then appears like refractive glass on that surface. > Transparent render queue, but alpha = 1.0.
0:39

🧑‍🏫 How to make a glass/refraction shader: 🍷 Refraction will ultimately have the effect that whatever is behind your mesh should appear distorted by the surface of the mesh itself. We're not going for external caustics projection, just modelling glass-like, distorting "transparency". 🌆 In Unity, you can sample the *global* _CameraOpaqueTexture (make sure it's enabled in your URP asset settings), which is what your scene looks like rendered without any transparent objects. In Shader Graph, you can simply use the Scene Colour node. 🔢 The UVs required for this texture are the normalized screen coordinates, so if we offset/warp/distort these coordinates and sample the texture, we ultimately produce a distorted image. We can offset the UVs by some normal map, as well as a refraction vector based on the direction from the camera -> the vertex/fragment (flip viewDir, which is otherwise vertex/fragment -> camera) and normals of the object. 📸 Input the (reversed) world space view direction and normal into HLSL refract. **Convert the refraction direction vector to tangent space before adding it to the screen UV.** Use the result to sample _CameraOpaqueTexture. refract(-worldViewDirection, worldNormal, eta); eta -> refraction ratio (from_IOR / to_IOR), > for air, 1.0 / indexOfRefraction (IOR). IOR of water = 1.33, glass = 1.54... 💡 You can also do naive "looks about right" hacks: fresnel -> normal from grayscale, which can be used for distortion. Or distort it any other way (without even specifically using refract at all), really... 🧠 Thus, even if your object is rendered as a transparent type (and vanilla Unity URP will require that it is), it is fully 'opaque' (max alpha), but it renders on its surface what is behind it, using the screen UV. If you distort those UVs by the camera view and normals of the surface it will be rendered on, it then appears like refractive glass on that surface. > Transparent render queue, but alpha = 1.0.

Mirza Beig

125,253 Aufrufe • vor 1 Jahr