Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

🚀 Major Update for ML-Sharp WebUI on Pinokio! 🌟 Native Mac Video Export (Zero CUDA) 🎥 10 New Camera Trajectories 💾 Low VRAM Mode (8GB GPU Support) ⚡️ Real-Time Previews Create stunning 3D gaussian splats from a single image.

franzipol

3,191 subscribers

22,930 Aufrufe • vor 9 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

23 Kommentare

Profilbild von Soy Un Mono

Soy Un Monovor 9 Monaten

Great work! But still no gaussian splat preview. Fresh install on Pinokio. I have an Nvidia 4060 8gb vram and 32gb ram. Videos are generated, and .ply too (it works in SuperSplat), but preview window is still black. I tried checkin and unchecking low vram mode, and still no luck.

Profilbild von franzipol

franzipolvor 9 Monaten

uhmm… can you give more details about your system? Btw the video I used for the post was recorded with a RTX3070 Laptop Edition with 8GB Vram

Profilbild von franzipol

franzipolvor 9 Monaten

🍏 Apple Silicon Unlock For the first time in this WebUI, I've enabled MPS (Metal) Support for rendering! Owners of M1/M2/M3 chips can now generate AND render videos natively. I've included a custom MPS-Lite build of gsplat, so it works out-of-the-box. No compiling. Just magic. ✨

Profilbild von franzipol

franzipolvor 9 Monaten

⚡️ Experience Upgrades - Real-Time Preview: Watch videos generate frame-by-frame. - Low VRAM Mode: Now universal. Generate PLY models even on 8GB cards or via shared memory. - Library Integration: Refactored to a pure python library implementation for better stability and control.

Profilbild von franzipol

franzipolvor 9 Monaten

Give it a spin! One-click install via Pinokio Browser. Special thanks to @cocktailpeanut for the Pinokio ecosystem, and the teams behind ML-Sharp and gsplat for their incredible open-source work! #3DGS #AI #Mac #OpenSource #GaussianSplatting #Pinokio

Profilbild von Grizu

Grizuvor 9 Monaten

Awesome, been waiting for this 👻

Profilbild von Ian George

Ian Georgevor 9 Monaten

Nice one 👏🖖🏻 I’ll give it a go the next days.

Profilbild von franzipol

franzipolvor 9 Monaten

Thanks Ian

Profilbild von Ian George

Ian Georgevor 9 Monaten

You’re welcome. (Good to see you in here as well as TikTok btw.🍻)

Profilbild von franzipol

franzipolvor 9 Monaten

Yeah, I appear and disappear 😅

Profilbild von Ian George

Ian Georgevor 9 Monaten

Makes two of us then 😜

Profilbild von franzipol

franzipolvor 9 Monaten

haha

Profilbild von Esber

Esbervor 9 Monaten

Any idea how I can do this with 360 images? Thanks :)

Profilbild von franzipol

franzipolvor 9 Monaten

I don’t think it will work properly as the model trained by apple doesn’t take into account 360

Profilbild von Jithin Palepu

Jithin Palepuvor 9 Monaten

this looks awesome, the native Mac support is gonna open up a lot of possibilities for creators. real-time previews are huge too, can't wait to see what people come up with using those new camera trajectories. 3D gaussian splats sound wild, I’m all in for experimenting with that!

Profilbild von franzipol

franzipolvor 9 Monaten

thanks for your words 🙏

Profilbild von Joshua Poddoku

Joshua Poddokuvor 9 Monaten

Nice update, but the gaussian splat preview is still black on my setup as well

Profilbild von franzipol

franzipolvor 9 Monaten

there can be 2 reasons (I had some feedback): - 1 guy realized he had an older version of Pinokio (still on 3 something) and after updating it to the latest 5.3.5 everything worked correctly - another person reported me the gradio 6.3.0 was messing with the preview so a few hours ago I updated the installer and the updater forcing 6.2.0 Anyway can you provide me more details about your system?

Profilbild von Fractality Dream

Fractality Dreamvor 9 Monaten

😍😍😍

Profilbild von bommer GG

bommer GGvor 9 Monaten

nice

Profilbild von Ananya Patelik

Ananya Patelikvor 9 Monaten

those new camera moves are like adding extra brushstrokes to a digital canvas. can’t wait to splat some 3d dreams from a single snapshot!

Profilbild von franzipol

franzipolvor 9 Monaten

❤️

Profilbild von Kevin Elliott

Kevin Elliottvor 9 Monaten

This is so freaking insane, I can't even believe this is possible now.

Ähnliche Videos

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

Daniel Skaale

74,512 Aufrufe • vor 10 Monaten

A 1-billion-parameter motion model trained on NVIDIA CUDA, requiring 8GB of VRAM for real-time operation. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, enabling rapid creation of 3D animation data.

A 1-billion-parameter motion model trained on NVIDIA CUDA, requiring 8GB of VRAM for real-time operation. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, enabling rapid creation of 3D animation data.

CYANPUPPETS

103,481 Aufrufe • vor 1 Jahr

Released Splatline v2.0 🚀 Video → 3D Gaussian splats in seconds.

Released Splatline v2.0 🚀 Video → 3D Gaussian splats in seconds.

Jaskirat Singh

30,967 Aufrufe • vor 3 Monaten

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

M. Ali Kapadia

26,886 Aufrufe • vor 8 Monaten

Free Blender AI motion capture plugin: Connects to 1080P camera, runs on a local computer with a 10-billion-parameter model, and requires 8GB VRAM for real-time processing. Supports both real-time capture and video uploads.

Free Blender AI motion capture plugin: Connects to 1080P camera, runs on a local computer with a 10-billion-parameter model, and requires 8GB VRAM for real-time processing. Supports both real-time capture and video uploads.

CYANPUPPETS

235,045 Aufrufe • vor 1 Jahr

Gaussian splats in Blender 5.3! Had to take it for a quick spin ofc - here with a scene I did using a generated image, Minimax H3-Max camera control through - converted to Gaussian splats with KIRI Engine - 3D Scanner App. It is possible to relight scenes with Gaussian Splats too, but it was pretty sloggish for me, even on a 5090. Could probably get better results with some optimization. It is kinda crazy to see this unfold - from image, to video, to 3d to dynamic generative worlds.

Gaussian splats in Blender 5.3! Had to take it for a quick spin ofc - here with a scene I did using a generated image, Minimax H3-Max camera control through - converted to Gaussian splats with KIRI Engine - 3D Scanner App. It is possible to relight scenes with Gaussian Splats too, but it was pretty sloggish for me, even on a 5090. Could probably get better results with some optimization. It is kinda crazy to see this unfold - from image, to video, to 3d to dynamic generative worlds.

Martin Nebelong

22,942 Aufrufe • vor 1 Monat

🚀 Alpha Launch: Insta360 Integration is NOW LIVE on OVER! We're building the world's largest 3D dataset, and you can help! 🛠️ Turn your Insta360 camera into a powerful 3D mapping tool. Create navigable Mega Gaussian Splats & stunning, scalable 3D maps up to 30x faster! With your Insta360, you can map over 60 OVRLands in just 10 minutes!

🚀 Alpha Launch: Insta360 Integration is NOW LIVE on OVER! We're building the world's largest 3D dataset, and you can help! 🛠️ Turn your Insta360 camera into a powerful 3D mapping tool. Create navigable Mega Gaussian Splats & stunning, scalable 3D maps up to 30x faster! With your Insta360, you can map over 60 OVRLands in just 10 minutes!

Over the Reality 🌐

65,122 Aufrufe • vor 1 Jahr

Blender AI Motion Capture Plugin — Connects to a 1080P webcam and runs locally on your computer. Powered by a 1-billion-parameter model, it requires an 8GB VRAM GPU for real-time processing. Supports both real-time capture and video upload. The full-featured version currently supports NVIDIA CUDA only, and requires DX11 or above.

Blender AI Motion Capture Plugin — Connects to a 1080P webcam and runs locally on your computer. Powered by a 1-billion-parameter model, it requires an 8GB VRAM GPU for real-time processing. Supports both real-time capture and video upload. The full-featured version currently supports NVIDIA CUDA only, and requires DX11 or above.

CYANPUPPETS

58,611 Aufrufe • vor 1 Jahr

Generate Songs with HeartMuLa, with 8GB VRAM! HeartMuLa is the latest open source song generation AI model everyone's raving about. But the default model couldn't run on low VRAM machines. Then WanGP just made it work with just 8GB VRAM! 1-Click Install on Pinokio.

Generate Songs with HeartMuLa, with 8GB VRAM! HeartMuLa is the latest open source song generation AI model everyone's raving about. But the default model couldn't run on low VRAM machines. Then WanGP just made it work with just 8GB VRAM! 1-Click Install on Pinokio.

cocktail peanut

27,989 Aufrufe • vor 9 Monaten

Excited to announce 🚀gsplat v1.0🚀: a ⏩efficient⏩ CUDA backend for 3D Gaussian Splatting! A drop-in replacement of the official impl. with: - Up to 2x faster training; - Up to 4x less GPU memory; - Render millions of GSs in real-time; - And more;

Excited to announce 🚀gsplat v1.0🚀: a ⏩efficient⏩ CUDA backend for 3D Gaussian Splatting! A drop-in replacement of the official impl. with: - Up to 2x faster training; - Up to 4x less GPU memory; - Render millions of GSs in real-time; - And more;

Ruilong Li

88,325 Aufrufe • vor 2 Jahren

Generate 3D from just one image, on your computer. franzipol has built a gradio web ui for Apple's Sharp, which infers an entire 3D view from just one image. You can run it on any computer with 1-click: Mac, Linux, Windows. Just need 10GB VRAM (16GB memory on Macs).

Generate 3D from just one image, on your computer. franzipol has built a gradio web ui for Apple's Sharp, which infers an entire 3D view from just one image. You can run it on any computer with 1-click: Mac, Linux, Windows. Just need 10GB VRAM (16GB memory on Macs).

cocktail peanut

157,863 Aufrufe • vor 9 Monaten

Blender AI Real-Time Motion Capture Plugin — connect a 1080P camera or upload videos. It runs locally with a 1-billion-parameter model and requires 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads. The full-parameter version currently supports NVIDIA CUDA and requires DX11 or higher.

Blender AI Real-Time Motion Capture Plugin — connect a 1080P camera or upload videos. It runs locally with a 1-billion-parameter model and requires 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads. The full-parameter version currently supports NVIDIA CUDA and requires DX11 or higher.

CYANPUPPETS

54,568 Aufrufe • vor 7 Monaten

Blender AI Real-Time Motion Capture Plugin — connect a 1080P camera or upload videos. It runs locally with a 1-billion-parameter model and requires 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads. The full-parameter version currently supports NVIDIA CUDA and requires DX11 or higher.

Blender AI Real-Time Motion Capture Plugin — connect a 1080P camera or upload videos. It runs locally with a 1-billion-parameter model and requires 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads. The full-parameter version currently supports NVIDIA CUDA and requires DX11 or higher.

CYANPUPPETS

26,492 Aufrufe • vor 8 Monaten

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.

Dreaming Tulpa 🥓👑

79,033 Aufrufe • vor 2 Jahren

⚡️Generating 3DGS scenes in 5 seconds on a single GPU⚡️ #FlashWorld enables ⚡️*fast*⚡️ (10~100x faster than previous methods) and 🔥*high-quality*🔥 3D world generation, from a single image or text prompt. Code: Page:

⚡️Generating 3DGS scenes in 5 seconds on a single GPU⚡️ #FlashWorld enables ⚡️fast⚡️ (10~100x faster than previous methods) and 🔥high-quality🔥 3D world generation, from a single image or text prompt. Code: Page:

Tengfei Wang

119,877 Aufrufe • vor 1 Jahr

Gaussian Splats can now be animated in Blender New 3DGS Render addon update: - Blender 5.1 support - 4DGS / .ply sequence export - Experimental rigging tools - Experimental light baking Check below for links 👇

Gaussian Splats can now be animated in Blender New 3DGS Render addon update: - Blender 5.1 support - 4DGS / .ply sequence export - Experimental rigging tools - Experimental light baking Check below for links 👇

KIRI Engine - 3D Scanner App

15,666 Aufrufe • vor 4 Monaten

🚀 Omnia Splat Builder is close to launch. 🧽 🎥 Video or a single still → trained 3D Gaussian splat, fully local on one consumer GPU. Newly added: - Custom MCMC+ SIFT Splat solver - H3 Max 360 Camera control from one image, - Dynamic 4D, and an orbit guard for AI clips. - Depth Anything V3 prior, seeded background. 🛠️ COLMAP + GLOMAP fallback, SIFT + LightGlue , Crop box, PLY / Postshot / 4D NPZ export. #GaussianSplatting #3DGS #NeRF #Photogrammetry #ComputerVision #IndieDev #3DReconstruction

🚀 Omnia Splat Builder is close to launch. 🧽 🎥 Video or a single still → trained 3D Gaussian splat, fully local on one consumer GPU. Newly added: - Custom MCMC+ SIFT Splat solver - H3 Max 360 Camera control from one image, - Dynamic 4D, and an orbit guard for AI clips. - Depth Anything V3 prior, seeded background. 🛠️ COLMAP + GLOMAP fallback, SIFT + LightGlue , Crop box, PLY / Postshot / 4D NPZ export. #GaussianSplatting #3DGS #NeRF #Photogrammetry #ComputerVision #IndieDev #3DReconstruction

Daniel Skaale

12,023 Aufrufe • vor 1 Monat

Run Hy-Nomas World Model with 8GB VRAM WanGP has added Hy-Nomas, a world model you can control with WASD and text prompt. Should run realtime on 24GB+ VRAM machines, but probably not realtime on 8GB VRAM. 1-click launch on pinokio (thread)

Run Hy-Nomas World Model with 8GB VRAM WanGP has added Hy-Nomas, a world model you can control with WASD and text prompt. Should run realtime on 24GB+ VRAM machines, but probably not realtime on 8GB VRAM. 1-click launch on pinokio (thread)

cocktail peanut

14,659 Aufrufe • vor 5 Tagen