Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

🙏Thanks I'm overwhelmed by all the response!😍 ✨ Quick test with Pano360Sharp Just playing around with the output... 4M splats Added my Unity re-lighting and that dreamy tilt-shift blur effect 🎬 There's something magical about turning a single 360° photo into a little 3D world you can fly through... show more

Daniel Skaale

3,397 subscribers

25,097 Aufrufe • vor 8 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

Daniel Skaale

73,120 Aufrufe • vor 8 Monaten

This is the biggest announcement from Apple that nobody has talked about. Generating #GaussianSplatting with #AI using models like Trellis or Sam3D hasn’t made much sense...until now. Meshes are still far easier to edit, integrate cleanly into #3D workflows, and with recent retopology advances, you can get high-quality low-poly assets with detailed textures. That said, this is where the balance starts to shift toward 3DGS. Until recently, AI struggled to generate splats with proper view-dependent effects. That’s changed with LiTo, a new model from Apple that can generate 3DGS with realistic view-dependent rendering, and the results are impressive. They’re not ready for game development pipelines yet. But for VFX, e-commerce, configurators, architecture, and similar domains, the implications are significant. What would it take for you to seriously explore AI-generated 3DGS for non-gaming use cases?

This is the biggest announcement from Apple that nobody has talked about. Generating #GaussianSplatting with #AI using models like Trellis or Sam3D hasn’t made much sense...until now. Meshes are still far easier to edit, integrate cleanly into #3D workflows, and with recent retopology advances, you can get high-quality low-poly assets with detailed textures. That said, this is where the balance starts to shift toward 3DGS. Until recently, AI struggled to generate splats with proper view-dependent effects. That’s changed with LiTo, a new model from Apple that can generate 3DGS with realistic view-dependent rendering, and the results are impressive. They’re not ready for game development pipelines yet. But for VFX, e-commerce, configurators, architecture, and similar domains, the implications are significant. What would it take for you to seriously explore AI-generated 3DGS for non-gaming use cases?

Gabriele Romagnoli

20,817 Aufrufe • vor 4 Monaten

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

𝐑𝐔𝐁𝐄𝐍🥽𝐅𝐑𝐎

51,284 Aufrufe • vor 4 Monaten

Accessibility is the magic here. Anyone with a phone can do this. Capture > upload > process > boom - you’ve got a real environment stored as a 3DGS asset. Right before HalfRez in Chicago, I shot a few quick videos while walking around the city. Nothing planned, nothing fancy - just some passive captures while killing time. I processed them remotely, and now I’ve got three little Chicago Gaussian splats I can pull up whenever I want. Gaussian splats shine for exactly this: grabbing pieces of the real world and turning them into reusable 3D assets. I can drop them straight into OTOY Octane 2026 and treat them almost like standard 3D geometry. They’re perfect for: building out larger environments creating real-world set extensions capturing everyday places in tiny, efficient packages and storing “location assets” you can reuse later If you travel, or just find yourself in unique places, don’t forget the opportunity to take that world home with you!

Accessibility is the magic here. Anyone with a phone can do this. Capture > upload > process > boom - you’ve got a real environment stored as a 3DGS asset. Right before HalfRez in Chicago, I shot a few quick videos while walking around the city. Nothing planned, nothing fancy - just some passive captures while killing time. I processed them remotely, and now I’ve got three little Chicago Gaussian splats I can pull up whenever I want. Gaussian splats shine for exactly this: grabbing pieces of the real world and turning them into reusable 3D assets. I can drop them straight into OTOY Octane 2026 and treat them almost like standard 3D geometry. They’re perfect for: building out larger environments creating real-world set extensions capturing everyday places in tiny, efficient packages and storing “location assets” you can reuse later If you travel, or just find yourself in unique places, don’t forget the opportunity to take that world home with you!

Spenser Dickerson

19,831 Aufrufe • vor 9 Monaten

Have you made some #3D models with #gaussiansplatting using Luma or polycam ? Here is how you can now clean them up directly on the web: People nowadays call them "Splats". These 3D models have the advantage of being extremely light compared to polygon-based 3D models. You can use various apps to generate these assets like the one I mentioned above. Often what you need is just a video or a set of images that you can shoot directly from your phone. To my knowledge, none of those apps right now offer the ability to edit and "clean" the model you get.... UNTIL NOW! You can go to from PlayCanvas import the splats you have downloaded and start cleaning it up directly on your #browser. After that the asset is ready to be exported as a PLY file Was this useful? Follow me for more content around #XR and #AI 😉

Have you made some #3D models with #gaussiansplatting using Luma or polycam ? Here is how you can now clean them up directly on the web: People nowadays call them "Splats". These 3D models have the advantage of being extremely light compared to polygon-based 3D models. You can use various apps to generate these assets like the one I mentioned above. Often what you need is just a video or a set of images that you can shoot directly from your phone. To my knowledge, none of those apps right now offer the ability to edit and "clean" the model you get.... UNTIL NOW! You can go to from PlayCanvas import the splats you have downloaded and start cleaning it up directly on your #browser. After that the asset is ready to be exported as a PLY file Was this useful? Follow me for more content around #XR and #AI 😉

Gabriele Romagnoli

70,987 Aufrufe • vor 2 Jahren

Here is how you turn a #GaussianSplatting into a walkable world with 2 clicks. First of all, do yourself a favour and try out PostShot. The splat you see was created from a 3-minute video taken with my phone. It ran for around 12 hours on a laptop with a 3060, and the output was beyond my expectations! That being said, whatever tool or app you use to create your Splat, you can import it directly into arrival.space from there you can: - Clean it up and compress it thanks to the direct integration with Supersplat Editor - Generate a rough mesh (that you can export with a paid plan and adjust in Blender ) - Explore it freely on the #web or in #VR Make sure to drop your Space in the comments. Would love to see it!

Here is how you turn a #GaussianSplatting into a walkable world with 2 clicks. First of all, do yourself a favour and try out PostShot. The splat you see was created from a 3-minute video taken with my phone. It ran for around 12 hours on a laptop with a 3060, and the output was beyond my expectations! That being said, whatever tool or app you use to create your Splat, you can import it directly into arrival.space from there you can: - Clean it up and compress it thanks to the direct integration with Supersplat Editor - Generate a rough mesh (that you can export with a paid plan and adjust in Blender ) - Explore it freely on the #web or in #VR Make sure to drop your Space in the comments. Would love to see it!

Gabriele Romagnoli

12,086 Aufrufe • vor 1 Jahr

✨ I'm getting very very close to the original vision I had for Photo AI when I started it 3 years ago which was essentially: [ 📸 Photography Simulator 2025 ] I wanted to 100% be able to simulate being a real photographer, and what that means is actually being able to move the camera around a subject I think I'm getting really close now by integrating World Labs, it lets me put real people into a 3d world that you can then move around in with WASD and your mouse Then my idea is you have a [ 📸 Take photo ] button there to turn that shot into a new photo with AI I'm not there yet but I'm getting close I think, one thing is that World Labs still suck at people and faces, although if I just ask the AI to take only the angle of the pic maybe that's not a problem so much I first used World Labs on Interior AI where it lets people move around in their re-styled interior design, I thought it'd be a gimmick maybe and few would use it, but now it's one of the most used features Anyway very exciting!!!! 😊

✨ I'm getting very very close to the original vision I had for Photo AI when I started it 3 years ago which was essentially: [ 📸 Photography Simulator 2025 ] I wanted to 100% be able to simulate being a real photographer, and what that means is actually being able to move the camera around a subject I think I'm getting really close now by integrating World Labs, it lets me put real people into a 3d world that you can then move around in with WASD and your mouse Then my idea is you have a [ 📸 Take photo ] button there to turn that shot into a new photo with AI I'm not there yet but I'm getting close I think, one thing is that World Labs still suck at people and faces, although if I just ask the AI to take only the angle of the pic maybe that's not a problem so much I first used World Labs on Interior AI where it lets people move around in their re-styled interior design, I thought it'd be a gimmick maybe and few would use it, but now it's one of the most used features Anyway very exciting!!!! 😊

@levelsio

423,508 Aufrufe • vor 8 Monaten

Adobe.. has released a tool that combines Generative Gaussian Splats with a Diffusion layer and it's not all over the internet? WHAT IS GOING ON :D I had to test this out ofc! Substance 3D viewer, the new 3d viewer just released by Adobe, not only supports viewing of a large, large list of 3d formats, but it also supports generating of 3d models as Gaussian Splats. Combine that with the built-in 3d to image functionality and you basically have at least a few of the steps I've been doing for the last year or so using multiple tools. Exciting stuff! The new Photoshop Beta also supports the 3D viewer and you can import 3d files directly in photoshop as smart objects linked to the viewer. The elements you prompt in based on your models, can be easily exported to your clipboard without backgrounds making it very easy to use this in your normal image editing workflows. I have a suspicion that we'll see much more of this in other Adobe tools and I'm very curious to see this used for things like this in more 3d tools than "just" Adobe Neo (which is fantastic btw). #adobe #art #gaussiansplatting

Adobe.. has released a tool that combines Generative Gaussian Splats with a Diffusion layer and it's not all over the internet? WHAT IS GOING ON :D I had to test this out ofc! Substance 3D viewer, the new 3d viewer just released by Adobe, not only supports viewing of a large, large list of 3d formats, but it also supports generating of 3d models as Gaussian Splats. Combine that with the built-in 3d to image functionality and you basically have at least a few of the steps I've been doing for the last year or so using multiple tools. Exciting stuff! The new Photoshop Beta also supports the 3D viewer and you can import 3d files directly in photoshop as smart objects linked to the viewer. The elements you prompt in based on your models, can be easily exported to your clipboard without backgrounds making it very easy to use this in your normal image editing workflows. I have a suspicion that we'll see much more of this in other Adobe tools and I'm very curious to see this used for things like this in more 3d tools than "just" Adobe Neo (which is fantastic btw). #adobe #art #gaussiansplatting

Martin Nebelong

280,050 Aufrufe • vor 1 Jahr

This style of AI renovation video is helping RE agents and contractors close more deals (and it starts with a single photo). No staging company. No 3D rendering service. No $2K virtual staging package. Just one image and 10 minutes inside Calico AI. Here's how the system works: → Drop any room photo into the AI Room Renovator GPT → Choose a renovation style: modern, coastal, luxury → It hands you a perfectly tuned image prompt → Paste it inside Calico along with the original photo → Generate the renovated room in seconds → Open Kling 3.0 (same platform, no switching tools) — set original as start, renovation as end → Generate the animation — the room transforms before your eyes Before to after. In a video. From one photo. Drop that into a listing, an ad, or a client walkthrough and watch what happens. Comment "RENOVATE" and I'll send you the exact GPT link, prompts, and workflow (must be following so I can DM you!).

This style of AI renovation video is helping RE agents and contractors close more deals (and it starts with a single photo). No staging company. No 3D rendering service. No $2K virtual staging package. Just one image and 10 minutes inside Calico AI. Here's how the system works: → Drop any room photo into the AI Room Renovator GPT → Choose a renovation style: modern, coastal, luxury → It hands you a perfectly tuned image prompt → Paste it inside Calico along with the original photo → Generate the renovated room in seconds → Open Kling 3.0 (same platform, no switching tools) — set original as start, renovation as end → Generate the animation — the room transforms before your eyes Before to after. In a video. From one photo. Drop that into a listing, an ad, or a client walkthrough and watch what happens. Comment "RENOVATE" and I'll send you the exact GPT link, prompts, and workflow (must be following so I can DM you!).

David Roberts

34,768 Aufrufe • vor 5 Monaten

3D scanning and rendering is moving so fast - got my splats up and running and I'm mind blown getting ~100fps for this complex 3D scene ⬇️ 🤯 1. WAY faster than NeRF: For comparison, NeRFs would takes around 10 seconds per frame (!) Instead I'm zipping around with FPV controls without breaking a sweat - though I do crash a few times towards the end of the video lol 2. Old Meets New: Gaussian Splatting is cool in that it fuses classical graphics and deep learning techniques. Like NeRFs, this is still a radiance field - just without the slower (ne)ural rendering part. 3. Explicit Representation: Instead you represent a 3D scene as a collection of ellipsoidal "splats" called gaussians. Each gaussian has a position, size, and color. Rendering in real-time is done by projecting into the image plane and alpha blending. 4. Photorealistic Effects: Gaussian splatting use spherical harmonics to represent the view-dependent effects and lighting - allowing surfaces to change color when viewed from different angles, enabling greater photorealism. It doesn't use a neural network, but the training loop is similar to deep learning. 5. Enables Direct Editing: But it's not just speed - with Gaussian Splatting you also get 3D editing support! So you can select, move, and delete stuff, even relight stuff. This type of editing has been more tedious to do with NeRFs and their implicit black box representations. 📲 More tests cooking! Much more to unpack here including simpler explanations. If you enjoyed this post, you might enjoy my feed: Bilawal Sidhu

3D scanning and rendering is moving so fast - got my splats up and running and I'm mind blown getting ~100fps for this complex 3D scene ⬇️ 🤯 1. WAY faster than NeRF: For comparison, NeRFs would takes around 10 seconds per frame (!) Instead I'm zipping around with FPV controls without breaking a sweat - though I do crash a few times towards the end of the video lol 2. Old Meets New: Gaussian Splatting is cool in that it fuses classical graphics and deep learning techniques. Like NeRFs, this is still a radiance field - just without the slower (ne)ural rendering part. 3. Explicit Representation: Instead you represent a 3D scene as a collection of ellipsoidal "splats" called gaussians. Each gaussian has a position, size, and color. Rendering in real-time is done by projecting into the image plane and alpha blending. 4. Photorealistic Effects: Gaussian splatting use spherical harmonics to represent the view-dependent effects and lighting - allowing surfaces to change color when viewed from different angles, enabling greater photorealism. It doesn't use a neural network, but the training loop is similar to deep learning. 5. Enables Direct Editing: But it's not just speed - with Gaussian Splatting you also get 3D editing support! So you can select, move, and delete stuff, even relight stuff. This type of editing has been more tedious to do with NeRFs and their implicit black box representations. 📲 More tests cooking! Much more to unpack here including simpler explanations. If you enjoyed this post, you might enjoy my feed: Bilawal Sidhu

Bilawal Sidhu

337,090 Aufrufe • vor 2 Jahren

Dormant Memories — a gallery regrouping my recent experiments built from real-world captures, reconstructed as 3D Gaussian Splats, and in many cases manipulated using World Labs' Marble. Everything is built with Spark, the 3D Gaussian splat renderer released by World Labs. It runs in the browser and can be experienced across devices: desktop, mobile, and headsets like Apple Vision Pro and Quest 3. This work comes out of something I've been exploring for a few years now: capturing fragments of the world (places, objects, moments...) and turning them into spaces that can then be revisited, manipulated, and explored in real time. What particularly interests me here is the process of creating alternate versions of the same place; starting from something that physically exists and using it as a base to explore variations, instead of generating from scratch. These explorations are part of what we do at Dpt.... same tools, same curiosity, same collaborative energy that shape the studio's work on interactive and immersive experiences. Some of these experiments were featured as part of the Spark 2.0 release by World Labs. Their technical blog post is a must-read; link in the thread ↓ These are experiments. They aren't fully optimized, they aren't bug-free, and the UX has rough edges. The goal is to explore, test, and learn. #GaussianSplatting #3DGS #pointcloud #WorldModels #sparkjs #threejs

Dormant Memories — a gallery regrouping my recent experiments built from real-world captures, reconstructed as 3D Gaussian Splats, and in many cases manipulated using World Labs' Marble. Everything is built with Spark, the 3D Gaussian splat renderer released by World Labs. It runs in the browser and can be experienced across devices: desktop, mobile, and headsets like Apple Vision Pro and Quest 3. This work comes out of something I've been exploring for a few years now: capturing fragments of the world (places, objects, moments...) and turning them into spaces that can then be revisited, manipulated, and explored in real time. What particularly interests me here is the process of creating alternate versions of the same place; starting from something that physically exists and using it as a base to explore variations, instead of generating from scratch. These explorations are part of what we do at Dpt.... same tools, same curiosity, same collaborative energy that shape the studio's work on interactive and immersive experiences. Some of these experiments were featured as part of the Spark 2.0 release by World Labs. Their technical blog post is a must-read; link in the thread ↓ These are experiments. They aren't fully optimized, they aren't bug-free, and the UX has rough edges. The goal is to explore, test, and learn. #GaussianSplatting #3DGS #pointcloud #WorldModels #sparkjs #threejs

Hugues Bruyère

12,408 Aufrufe • vor 4 Monaten

lando: “dementia is not something that just people have as they get older. you can be born with it, young people can have it. and it affects over 50 million people around the world. so it's something that none of us want to have. and i'm a guy that my whole life is about memories. it's about creating those pictures in your mind. and the last thing i ever want to do is lose that as i get older. that's what everything in my life is about. so it's cool that i can go out and track. i can have my fun. i can go and race. but there's a kind of second meaning behind it all. and at the same time, i get to do something good for the world. and that's something that i love” ❤️❤️

lando: “dementia is not something that just people have as they get older. you can be born with it, young people can have it. and it affects over 50 million people around the world. so it's something that none of us want to have. and i'm a guy that my whole life is about memories. it's about creating those pictures in your mind. and the last thing i ever want to do is lose that as i get older. that's what everything in my life is about. so it's cool that i can go out and track. i can have my fun. i can go and race. but there's a kind of second meaning behind it all. and at the same time, i get to do something good for the world. and that's something that i love” ❤️❤️

ray

58,627 Aufrufe • vor 3 Monaten

Have you ever seen a robot walk along a waterfront, understand its surroundings, and look out at the sea? 🤖 Thanks to Over the Reality, this is possible. Places like this are mapped every day by our global community of 360 mappers. Using our technology, they are transformed into high-fidelity machine-readable 3D Gaussian Splats. This data can be used to: • navigate robots through the physical world • train AI and Visual Models • power VPS localization • anchor persistent XR content to real-world locations This is just one of more than 250,000 real-world locations already mapped by the Over the Reality community. And unlike traditional datasets, these places can be explored directly through a smartphone, browser, or XR headset, allowing anyone to navigate and experience them in first person. From city streets and waterfronts to landmarks and cultural sites, we're building one of the world's largest machine-readable maps for AI, robotics, and spatial computing.

Have you ever seen a robot walk along a waterfront, understand its surroundings, and look out at the sea? 🤖 Thanks to Over the Reality, this is possible. Places like this are mapped every day by our global community of 360 mappers. Using our technology, they are transformed into high-fidelity machine-readable 3D Gaussian Splats. This data can be used to: • navigate robots through the physical world • train AI and Visual Models • power VPS localization • anchor persistent XR content to real-world locations This is just one of more than 250,000 real-world locations already mapped by the Over the Reality community. And unlike traditional datasets, these places can be explored directly through a smartphone, browser, or XR headset, allowing anyone to navigate and experience them in first person. From city streets and waterfronts to landmarks and cultural sites, we're building one of the world's largest machine-readable maps for AI, robotics, and spatial computing.

Over the Reality 🌐

31,824 Aufrufe • vor 2 Monaten

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

InSpatio｜影溯

29,262 Aufrufe • vor 21 Tagen

✨ I made a 100% AI video of a single night in 🇩🇪 Berlin's underground techno scene Doing an AI shoot is very much like a real life shoot, you have to prepare locations, settings, outfits and models, you can do the same: 1) First I generated photos with the [ 🇩🇪 Berlin nightlife ] photo pack on they're all non-existing AI people except me and my gf 2) Then I put the pics I liked in Kling AI to make them into 10 second videos (with Professional Mode), soon I'll have API access and it'll be one-click inside Photo AI to turn a photo into a 10-sec video, it then takes about 5 minutes to make a video. It's not always great, especially dancing is hard to get right! 3) Then I wanted to have a German narrator talking about Berlin's techno nights in a poetic way like a documentary, so I asked ChatGPT 4o: "write in the style of a cult German novelist about the Berlin techno scene" I then copied that text into Eleven Labs and selected a German AI voice 4) I then collected all the videos, the music and the audio narrator and edited them together in Final Cut Pro adding music from HÖR and adding audio effects 5) Then I added English captions with CapCut Time to make it: 3 hours for 1 minute of video I hope you like it! My dream is to have this entire pipeline in Photo AI at some point. Connecting to Kling AI's video API is the first step to that. Imagine just writing a prompt and you end up with a video like this without all the work Credits: Music: Asquith - Let Me (Rave Mix) [ASQ004] Barbax - Si Vis Pacem Para Bellum (Original Mix) Mixed by Ellen Allien @ HÖR Video: 100% AI characters and video by Photo AI Edited by me Narrator voice: 100% written by ChatGPT 4o 100% narrated by Eleven Labs AI voice

✨ I made a 100% AI video of a single night in 🇩🇪 Berlin's underground techno scene Doing an AI shoot is very much like a real life shoot, you have to prepare locations, settings, outfits and models, you can do the same: 1) First I generated photos with the [ 🇩🇪 Berlin nightlife ] photo pack on they're all non-existing AI people except me and my gf 2) Then I put the pics I liked in Kling AI to make them into 10 second videos (with Professional Mode), soon I'll have API access and it'll be one-click inside Photo AI to turn a photo into a 10-sec video, it then takes about 5 minutes to make a video. It's not always great, especially dancing is hard to get right! 3) Then I wanted to have a German narrator talking about Berlin's techno nights in a poetic way like a documentary, so I asked ChatGPT 4o: "write in the style of a cult German novelist about the Berlin techno scene" I then copied that text into Eleven Labs and selected a German AI voice 4) I then collected all the videos, the music and the audio narrator and edited them together in Final Cut Pro adding music from HÖR and adding audio effects 5) Then I added English captions with CapCut Time to make it: 3 hours for 1 minute of video I hope you like it! My dream is to have this entire pipeline in Photo AI at some point. Connecting to Kling AI's video API is the first step to that. Imagine just writing a prompt and you end up with a video like this without all the work Credits: Music: Asquith - Let Me (Rave Mix) [ASQ004] Barbax - Si Vis Pacem Para Bellum (Original Mix) Mixed by Ellen Allien @ HÖR Video: 100% AI characters and video by Photo AI Edited by me Narrator voice: 100% written by ChatGPT 4o 100% narrated by Eleven Labs AI voice

@levelsio

676,094 Aufrufe • vor 1 Jahr

"Hah - generative ai can't even make an image of a hand with the right number of fingers.." "Stop pushing this slop" It's way past the point now where it must be clear to everyone, that generative ai is here to stay AND that the quality will continue to increase. I've been talking about this trajectory for years now, and I've been working towards finding ways to combine the strength of these models, with the best of what I love about "old-school" creation. Building with my hands, moving a pencil across the paper and seeing shapes emerge, moving a building slightly to the right to get just that composition I had in mind. Being fully immersed in a scene I'm building in VR, being inspired by the immersion to take the story in a new direction. For years I've been talking about how powerful the combination of 3d and generative ai is, be it traditional 3d, SDF volumes in Dreams or Gaussian splats - with experiments around using V2V as a "render pass" or with experiments around realtime ai. Enough talk you might think, where's the proof? It's all around us these days honestly and here's a small test I did during some OOO. Blender MPC + Fable - a pretty powerful combination! With a bit of Google Omni Fast on top as a "render" pass. What do you think of where this is heading? Hopeful, disheartened, inspired or the opposite? Can you imagine working with tools like this in a way where we still retain the human "spark" and the creative nerve that makes each persons creation unique?

"Hah - generative ai can't even make an image of a hand with the right number of fingers.." "Stop pushing this slop" It's way past the point now where it must be clear to everyone, that generative ai is here to stay AND that the quality will continue to increase. I've been talking about this trajectory for years now, and I've been working towards finding ways to combine the strength of these models, with the best of what I love about "old-school" creation. Building with my hands, moving a pencil across the paper and seeing shapes emerge, moving a building slightly to the right to get just that composition I had in mind. Being fully immersed in a scene I'm building in VR, being inspired by the immersion to take the story in a new direction. For years I've been talking about how powerful the combination of 3d and generative ai is, be it traditional 3d, SDF volumes in Dreams or Gaussian splats - with experiments around using V2V as a "render pass" or with experiments around realtime ai. Enough talk you might think, where's the proof? It's all around us these days honestly and here's a small test I did during some OOO. Blender MPC + Fable - a pretty powerful combination! With a bit of Google Omni Fast on top as a "render" pass. What do you think of where this is heading? Hopeful, disheartened, inspired or the opposite? Can you imagine working with tools like this in a way where we still retain the human "spark" and the creative nerve that makes each persons creation unique?

Martin Nebelong

49,395 Aufrufe • vor 1 Monat

I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world. As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows. If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it. What do you think of Omni so far?

I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world. As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows. If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it. What do you think of Omni so far?

Martin Nebelong

38,451 Aufrufe • vor 3 Monaten

This might be the craziest workflow you'll see this week. From #VR greyboxing to 3D worlds with the help of #AI. The 2 tools I used are ShapesXR and Marble from World Labs. Let me tell you why and how. - ShapesXR is the most powerful and fastest way to assemble 3D scenes at scale. - The library of assets + ability to sketch from procedural primitives gives the perfect balance between speed and freedom. - ShapesXR allows you to export your creation as a glTF that can be used as a "3D prompt" into Marble - Marble now allows you to create a panorama using a 3D scene as input increasing DRAMATICALLY the control you have during the creation process - Through the workflow you can adjust textures and objects in the scene using AI inpainting - There are tons of options on how to use the final output (create a #GaussianSplatting, export collision mesh and even a detailed mesh 🤯) This is the perfect examples of how VR creative tools improve and accelerate the design process... so make sure to follow me if that's your jam 😉.

This might be the craziest workflow you'll see this week. From #VR greyboxing to 3D worlds with the help of #AI. The 2 tools I used are ShapesXR and Marble from World Labs. Let me tell you why and how. - ShapesXR is the most powerful and fastest way to assemble 3D scenes at scale. - The library of assets + ability to sketch from procedural primitives gives the perfect balance between speed and freedom. - ShapesXR allows you to export your creation as a glTF that can be used as a "3D prompt" into Marble - Marble now allows you to create a panorama using a 3D scene as input increasing DRAMATICALLY the control you have during the creation process - Through the workflow you can adjust textures and objects in the scene using AI inpainting - There are tons of options on how to use the final output (create a #GaussianSplatting, export collision mesh and even a detailed mesh 🤯) This is the perfect examples of how VR creative tools improve and accelerate the design process... so make sure to follow me if that's your jam 😉.

Gabriele Romagnoli

20,126 Aufrufe • vor 9 Monaten

The Reality portal is here, and you can test it yourself by downloading Decart XR from SideQuest 👇 It works in 3 steps: 1- Decart #XR streams the #MetaQuest camera feed to its AI models over WebRTC 2- MirageLSD the world transformation model by Decart, transforms the video in real time based on the prompt, 3- The processed feed is sent back into Unity for in-headset display. There is some latency, and every few seconds the generation kind of resets as if a new seed is generated, but this is still something that blew my mind.

The Reality portal is here, and you can test it yourself by downloading Decart XR from SideQuest 👇 It works in 3 steps: 1- Decart #XR streams the #MetaQuest camera feed to its AI models over WebRTC 2- MirageLSD the world transformation model by Decart, transforms the video in real time based on the prompt, 3- The processed feed is sent back into Unity for in-headset display. There is some latency, and every few seconds the generation kind of resets as if a new seed is generated, but this is still something that blew my mind.

Gabriele Romagnoli

10,993 Aufrufe • vor 10 Monaten