Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Workflow explained by Creative Multi-Dimensional Specialist, Tony Hou: This short was created with the AI powered 3D workflow which utilized traditional 3D processes and Luma’s Ray3.14 Modify video. We are at a point where AI integration is no longer a binary but is flexible to the artist’s needs. This... show more

Luma | Dream Lab

3,251 subscribers

31,492 просмотров • 5 месяцев назад •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

This might be the craziest workflow you'll see this week. From #VR greyboxing to 3D worlds with the help of #AI. The 2 tools I used are ShapesXR and Marble from World Labs. Let me tell you why and how. - ShapesXR is the most powerful and fastest way to assemble 3D scenes at scale. - The library of assets + ability to sketch from procedural primitives gives the perfect balance between speed and freedom. - ShapesXR allows you to export your creation as a glTF that can be used as a "3D prompt" into Marble - Marble now allows you to create a panorama using a 3D scene as input increasing DRAMATICALLY the control you have during the creation process - Through the workflow you can adjust textures and objects in the scene using AI inpainting - There are tons of options on how to use the final output (create a #GaussianSplatting, export collision mesh and even a detailed mesh 🤯) This is the perfect examples of how VR creative tools improve and accelerate the design process... so make sure to follow me if that's your jam 😉.

This might be the craziest workflow you'll see this week. From #VR greyboxing to 3D worlds with the help of #AI. The 2 tools I used are ShapesXR and Marble from World Labs. Let me tell you why and how. - ShapesXR is the most powerful and fastest way to assemble 3D scenes at scale. - The library of assets + ability to sketch from procedural primitives gives the perfect balance between speed and freedom. - ShapesXR allows you to export your creation as a glTF that can be used as a "3D prompt" into Marble - Marble now allows you to create a panorama using a 3D scene as input increasing DRAMATICALLY the control you have during the creation process - Through the workflow you can adjust textures and objects in the scene using AI inpainting - There are tons of options on how to use the final output (create a #GaussianSplatting, export collision mesh and even a detailed mesh 🤯) This is the perfect examples of how VR creative tools improve and accelerate the design process... so make sure to follow me if that's your jam 😉.

Gabriele Romagnoli

20,126 просмотров • 8 месяцев назад

A level of realism you could never achieve with traditional 3d. A level of control you could never get with text to video. This is the type of workflows I'm most excited about.. the type that allows us to paint, sculpt, act and direct worlds into existence.

A level of realism you could never achieve with traditional 3d. A level of control you could never get with text to video. This is the type of workflows I'm most excited about.. the type that allows us to paint, sculpt, act and direct worlds into existence.

Martin Nebelong

49,301 просмотров • 1 год назад

Here is a step-by-step introduction to building a workflow with a custom AI agent that uses MCP. I explain every component in the video: 1. Building the MCP server 2. Building the agent and an MCP client 3. Building a workflow that uses the agent The goal is simple: Generate a dialogue between two people and make one yell and the other answer with sarcasm. Kestra is sponsoring this video. They are an open-source orchestration platform (repo link below), and I used them to build the workflow that connects every component.

Here is a step-by-step introduction to building a workflow with a custom AI agent that uses MCP. I explain every component in the video: 1. Building the MCP server 2. Building the agent and an MCP client 3. Building a workflow that uses the agent The goal is simple: Generate a dialogue between two people and make one yell and the other answer with sarcasm. Kestra is sponsoring this video. They are an open-source orchestration platform (repo link below), and I used them to build the workflow that connects every component.

Santiago

51,527 просмотров • 1 год назад

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Martin Nebelong

48,200 просмотров • 2 лет назад

🚀 React Server Components are coming to every platform with Expo Router! To showcase all the new possibilities, I wrote the most powerful demo AI app I could think of—took less than a day to write, and it runs everywhere! Unlike traditional AI apps, which stream plain-text, Expo RSC can server render interactive native views and animations. This is the future of mobile apps.

🚀 React Server Components are coming to every platform with Expo Router! To showcase all the new possibilities, I wrote the most powerful demo AI app I could think of—took less than a day to write, and it runs everywhere! Unlike traditional AI apps, which stream plain-text, Expo RSC can server render interactive native views and animations. This is the future of mobile apps.

Evan Bacon 🥓

170,837 просмотров • 2 лет назад

I tried to see how far I could push my current AI + 3D workflow and build a playable 3D game prototype in just 3 days😶 Not by asking AI to make the whole game in one prompt. I had my own idea, knew what I wanted to build, and used AI as a tool: - for concepting, - asset generation & texturing, - gameplay logic with the new UE 5.8 MCP + Claude Code. And honestly, it is crazy how far you can get now with the right workflow. Full video - #UE5 #ClaudeCode #AI3D #3DAI

I tried to see how far I could push my current AI + 3D workflow and build a playable 3D game prototype in just 3 days😶 Not by asking AI to make the whole game in one prompt. I had my own idea, knew what I wanted to build, and used AI as a tool: - for concepting, - asset generation & texturing, - gameplay logic with the new UE 5.8 MCP + Claude Code. And honestly, it is crazy how far you can get now with the right workflow. Full video - #UE5 #ClaudeCode #AI3D #3DAI

Stefan 3D AI

20,841 просмотров • 25 дней назад

Phoenix GenAI’s new generative AI model Image-to-3D is now online. Create high fidelity 3D models importable to Unreal Engine 5 or Unity simply by sending an original image into PhoenixLLM. Better yet, generate the source image using Phoenix GenAI’s Flux and feed it into Image-to-3D. This release marks yet another upgrade of GenAI’s arsenal of capabilities, getting it ready for multi-workflow GenAI agents, in which users will be able to combine text-to-image, image-to-prompt, text-to-video, text-to-3D, and image-to-3D into complex multi-step workflows with simple commands via PhoenixLLM. Image-to-3D is yet another addition to Phoenix’s Vertical AI Solutions for gaming, content, and metaverse. Users are able to use it as a Phoenix-native alternative to SkyNet AI Marketplace’s Tripo Integration earlier this year. #Phoenix $PHB

Phoenix GenAI’s new generative AI model Image-to-3D is now online. Create high fidelity 3D models importable to Unreal Engine 5 or Unity simply by sending an original image into PhoenixLLM. Better yet, generate the source image using Phoenix GenAI’s Flux and feed it into Image-to-3D. This release marks yet another upgrade of GenAI’s arsenal of capabilities, getting it ready for multi-workflow GenAI agents, in which users will be able to combine text-to-image, image-to-prompt, text-to-video, text-to-3D, and image-to-3D into complex multi-step workflows with simple commands via PhoenixLLM. Image-to-3D is yet another addition to Phoenix’s Vertical AI Solutions for gaming, content, and metaverse. Users are able to use it as a Phoenix-native alternative to SkyNet AI Marketplace’s Tripo Integration earlier this year. #Phoenix $PHB

Phoenix AI

30,853 просмотров • 1 год назад

🇺🇸DAVID FRIEDBERG: AI VIDEO GENERATORS ARE SET TO CHANGE ENTERTAINMENT 'Genesis renders the actual 3D objects into a 3D environment rather than rendering a two-dimensional set of pixels to look like a video. Suddenly, you can actually render in real-time: a video game, a movie, a visual experience. And it goes to this point that we're unleashing the capacity for human imagination and creativity with these systems because it's no longer just a look-a-like 2-dimensional image. Source: The All-In Podcast, david friedberg

🇺🇸DAVID FRIEDBERG: AI VIDEO GENERATORS ARE SET TO CHANGE ENTERTAINMENT 'Genesis renders the actual 3D objects into a 3D environment rather than rendering a two-dimensional set of pixels to look like a video. Suddenly, you can actually render in real-time: a video game, a movie, a visual experience. And it goes to this point that we're unleashing the capacity for human imagination and creativity with these systems because it's no longer just a look-a-like 2-dimensional image. Source: The All-In Podcast, david friedberg

Mario Nawfal

82,293 просмотров • 1 год назад

A player in Where Winds Meet made a Keanu Reeves character and played See You Again with Kong Hou. Yes, you can basically do anything in this Wuxia open world RPG with MMO features. For those curious, Kong Hou is an Chinese harp-like instrument from the Tang Dynasty. There are 2 versions, one is the modern Kong Hou, which is basically a western harp but with 2 rows of strings. The traditional Tang dynasty version looks similar to the one in this video with a single row of strings. The strings are attached to the hollow structure at the top of the Kong Hou, which creates a very unique sound.

A player in Where Winds Meet made a Keanu Reeves character and played See You Again with Kong Hou. Yes, you can basically do anything in this Wuxia open world RPG with MMO features. For those curious, Kong Hou is an Chinese harp-like instrument from the Tang Dynasty. There are 2 versions, one is the modern Kong Hou, which is basically a western harp but with 2 rows of strings. The traditional Tang dynasty version looks similar to the one in this video with a single row of strings. The strings are attached to the hollow structure at the top of the Kong Hou, which creates a very unique sound.

Zhao DaShuai 东北进修🇨🇳 Commentary

230,270 просмотров • 7 месяцев назад

Elon Musk: To really be intelligent, AI has to make predictions that are in line with reality. “It's incredibly important for an AI model to be grounded in reality. I have a saying, which is physics is the law and everything else is a recommendation. I'm not suggesting people break the laws made by humans, we should generally obey the laws of humans. But I've seen many people break human made laws, but I have not seen anyone break the laws of physics. So, for any given AI, grounding it against reality and reality, for example, as you mentioned with the car, it needs to drive safely and correctly. The humanoid robot Optimus needs to perform the task that it's being asked to perform. These are things that are very helpful for ensuring that the model is truthful and accurate because it has to adhere to the laws of physics. So I think that's actually maybe somewhat overlooked or at least not talked about enough is that to really be intelligent it's got to make predictions that are in line with reality. In other words, physics.” Conversation with Satya Nadella, May 19, 2025

Elon Musk: To really be intelligent, AI has to make predictions that are in line with reality. “It's incredibly important for an AI model to be grounded in reality. I have a saying, which is physics is the law and everything else is a recommendation. I'm not suggesting people break the laws made by humans, we should generally obey the laws of humans. But I've seen many people break human made laws, but I have not seen anyone break the laws of physics. So, for any given AI, grounding it against reality and reality, for example, as you mentioned with the car, it needs to drive safely and correctly. The humanoid robot Optimus needs to perform the task that it's being asked to perform. These are things that are very helpful for ensuring that the model is truthful and accurate because it has to adhere to the laws of physics. So I think that's actually maybe somewhat overlooked or at least not talked about enough is that to really be intelligent it's got to make predictions that are in line with reality. In other words, physics.” Conversation with Satya Nadella, May 19, 2025

ELON CLIPS

17,791 просмотров • 2 месяцев назад

We are thrilled to announce a $7M raise to become the leading Open-Access AI Cloud 🤘🏼🌪️ At Hyperbolic, we’re building an open AI ecosystem and economy where everyone who contributes is rewarded. Our goal is not to merely optimize AI performance to compete with traditional Web2 services, but to create an inclusive AI economy accessible to all. The future of AI is collaborative. Join us.

We are thrilled to announce a $7M raise to become the leading Open-Access AI Cloud 🤘🏼🌪️ At Hyperbolic, we’re building an open AI ecosystem and economy where everyone who contributes is rewarded. Our goal is not to merely optimize AI performance to compete with traditional Web2 services, but to create an inclusive AI economy accessible to all. The future of AI is collaborative. Join us.

Hyperbolic

931,340 просмотров • 2 лет назад

Elon Musk: To really be intelligent, AI has to make predictions that are in line with reality. “It's incredibly important for an AI model to be grounded in reality. I have a saying, which is physics is the law and everything else is a recommendation. I'm not suggesting people break the laws made by humans, we should generally obey the laws of humans. But I've seen many people break human made laws, but I have not seen anyone break the laws of physics. So, for any given AI, grounding it against reality and reality, for example, as you mentioned with the car, it needs to drive safely and correctly. The humanoid robot Optimus needs to perform the task that it's being asked to perform. These are things that are very helpful for ensuring that the model is truthful and accurate because it has to adhere to the laws of physics. So I think that's actually maybe somewhat overlooked or at least not talked about enough is that to really be intelligent it's got to make predictions that are in line with reality. In other words, physics.” Conversation with Satya Nadella, May 19, 2025

Elon Musk: To really be intelligent, AI has to make predictions that are in line with reality. “It's incredibly important for an AI model to be grounded in reality. I have a saying, which is physics is the law and everything else is a recommendation. I'm not suggesting people break the laws made by humans, we should generally obey the laws of humans. But I've seen many people break human made laws, but I have not seen anyone break the laws of physics. So, for any given AI, grounding it against reality and reality, for example, as you mentioned with the car, it needs to drive safely and correctly. The humanoid robot Optimus needs to perform the task that it's being asked to perform. These are things that are very helpful for ensuring that the model is truthful and accurate because it has to adhere to the laws of physics. So I think that's actually maybe somewhat overlooked or at least not talked about enough is that to really be intelligent it's got to make predictions that are in line with reality. In other words, physics.” Conversation with Satya Nadella, May 19, 2025

ELON CLIPS

675,907 просмотров • 6 месяцев назад

"Hah - generative ai can't even make an image of a hand with the right number of fingers.." "Stop pushing this slop" It's way past the point now where it must be clear to everyone, that generative ai is here to stay AND that the quality will continue to increase. I've been talking about this trajectory for years now, and I've been working towards finding ways to combine the strength of these models, with the best of what I love about "old-school" creation. Building with my hands, moving a pencil across the paper and seeing shapes emerge, moving a building slightly to the right to get just that composition I had in mind. Being fully immersed in a scene I'm building in VR, being inspired by the immersion to take the story in a new direction. For years I've been talking about how powerful the combination of 3d and generative ai is, be it traditional 3d, SDF volumes in Dreams or Gaussian splats - with experiments around using V2V as a "render pass" or with experiments around realtime ai. Enough talk you might think, where's the proof? It's all around us these days honestly and here's a small test I did during some OOO. Blender MPC + Fable - a pretty powerful combination! With a bit of Google Omni Fast on top as a "render" pass. What do you think of where this is heading? Hopeful, disheartened, inspired or the opposite? Can you imagine working with tools like this in a way where we still retain the human "spark" and the creative nerve that makes each persons creation unique?

"Hah - generative ai can't even make an image of a hand with the right number of fingers.." "Stop pushing this slop" It's way past the point now where it must be clear to everyone, that generative ai is here to stay AND that the quality will continue to increase. I've been talking about this trajectory for years now, and I've been working towards finding ways to combine the strength of these models, with the best of what I love about "old-school" creation. Building with my hands, moving a pencil across the paper and seeing shapes emerge, moving a building slightly to the right to get just that composition I had in mind. Being fully immersed in a scene I'm building in VR, being inspired by the immersion to take the story in a new direction. For years I've been talking about how powerful the combination of 3d and generative ai is, be it traditional 3d, SDF volumes in Dreams or Gaussian splats - with experiments around using V2V as a "render pass" or with experiments around realtime ai. Enough talk you might think, where's the proof? It's all around us these days honestly and here's a small test I did during some OOO. Blender MPC + Fable - a pretty powerful combination! With a bit of Google Omni Fast on top as a "render" pass. What do you think of where this is heading? Hopeful, disheartened, inspired or the opposite? Can you imagine working with tools like this in a way where we still retain the human "spark" and the creative nerve that makes each persons creation unique?

Martin Nebelong

48,179 просмотров • 4 дней назад

Old Art to full 3D using Cinema 4D . Created a free and open-source plugin to bring Hunyuan 3D directly into Cinema 4D. This workflow combines multiple tools that are available today into a single, cohesive pipeline. I wanted to show that AI is never an end product by itself, it’s not the finality. Used properly, AI becomes an extremely powerful tool that lets you build exactly what you want. I hope you like it. The final step will be to bake all textures so I can share the project as a WebGL experience, a small interactive website to explore it directly in the browser. Made with heart, and with fal ❤️

Old Art to full 3D using Cinema 4D . Created a free and open-source plugin to bring Hunyuan 3D directly into Cinema 4D. This workflow combines multiple tools that are available today into a single, cohesive pipeline. I wanted to show that AI is never an end product by itself, it’s not the finality. Used properly, AI becomes an extremely powerful tool that lets you build exactly what you want. I hope you like it. The final step will be to bake all textures so I can share the project as a WebGL experience, a small interactive website to explore it directly in the browser. Made with heart, and with fal ❤️

Lovis Odin

21,909 просмотров • 6 месяцев назад

Excited to announce our new preprint! We developed a method to automatically extract standard 2D views from 3D echocardiography volumes. This method allows for novel approach to echo acquisition: Instead of moving the probe across patients chest in the search of standard views, a sonographer would only have to place the probe in the apical position to capture the whole snapshot of the heart, which is then decomposed into all standard views with the similar quality to the views obtained in the traditional pipeline. That way we benefit from the speed of 3D acquisition while allowing clinicians to preserve their familiar 2D interpretation workflow.

Excited to announce our new preprint! We developed a method to automatically extract standard 2D views from 3D echocardiography volumes. This method allows for novel approach to echo acquisition: Instead of moving the probe across patients chest in the search of standard views, a sonographer would only have to place the probe in the apical position to capture the whole snapshot of the heart, which is then decomposed into all standard views with the similar quality to the views obtained in the traditional pipeline. That way we benefit from the speed of 3D acquisition while allowing clinicians to preserve their familiar 2D interpretation workflow.

Milos Vukadinovic

11,193 просмотров • 4 месяцев назад

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

Lovis Odin

58,769 просмотров • 10 месяцев назад

In my AI filming career, there is a niche I really enjoy working with and where AI Video brings lots of value. That niche is Real Estate. AI is perfect to animate 3D renders and to create b-role for mood. Here I will try to answer two questions: 1 - How to make a real estate video? 2- How to sell a house? This was a work done based on 3D Renders (provided by The Creative Farm, more on them below). Sound design made by noon (feel free to DM her for great sound design) Below I will break down a bit of the process, the prompts, timespans, the tools I used as well as some secrets this time around (feeling pretty today) It will be a bit long, so bookmark it or save it for later if you have the interest but lack the time.

In my AI filming career, there is a niche I really enjoy working with and where AI Video brings lots of value. That niche is Real Estate. AI is perfect to animate 3D renders and to create b-role for mood. Here I will try to answer two questions: 1 - How to make a real estate video? 2- How to sell a house? This was a work done based on 3D Renders (provided by The Creative Farm, more on them below). Sound design made by noon (feel free to DM her for great sound design) Below I will break down a bit of the process, the prompts, timespans, the tools I used as well as some secrets this time around (feeling pretty today) It will be a bit long, so bookmark it or save it for later if you have the interest but lack the time.

FERA

218,120 просмотров • 11 месяцев назад

Just won the second place at the Google Gemini Hackathon hosted by Cerebral Valley! Absolutely unreal as I vibe coded the whole thing! This is Atelier AI, Cursor for Fashion Designers .The entire industry is focused on building tools for developers (ide, devops tools)..but creatives are often left behind. The tool allows the designer to take their idea from a sketch to a Technical Drawing, 3D render and finally a visualization of the garment on the runway. These are the tools I used - v0 -Nano Banana 2 Lite -VEO3 by Google AI Y Combinator deadline is tomorrow. Do you think I should apply with it?

Just won the second place at the Google Gemini Hackathon hosted by Cerebral Valley! Absolutely unreal as I vibe coded the whole thing! This is Atelier AI, Cursor for Fashion Designers .The entire industry is focused on building tools for developers (ide, devops tools)..but creatives are often left behind. The tool allows the designer to take their idea from a sketch to a Technical Drawing, 3D render and finally a visualization of the garment on the runway. These are the tools I used - v0 -Nano Banana 2 Lite -VEO3 by Google AI Y Combinator deadline is tomorrow. Do you think I should apply with it?

Safinaz Elhadary

109,457 просмотров • 8 месяцев назад