正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

🚀 Major Update for ML-Sharp WebUI on Pinokio! 🌟 Native Mac Video Export (Zero CUDA) 🎥 10 New Camera Trajectories 💾 Low VRAM Mode (8GB GPU Support) ⚡️ Real-Time Previews Create stunning 3D gaussian splats from a single image.

franzipol

3,191 subscribers

22,930 次观看 • 9 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

23 条评论

Soy Un Mono 的头像

Soy Un Mono9 个月前

Great work! But still no gaussian splat preview. Fresh install on Pinokio. I have an Nvidia 4060 8gb vram and 32gb ram. Videos are generated, and .ply too (it works in SuperSplat), but preview window is still black. I tried checkin and unchecking low vram mode, and still no luck.

franzipol 的头像

franzipol9 个月前

uhmm… can you give more details about your system? Btw the video I used for the post was recorded with a RTX3070 Laptop Edition with 8GB Vram

franzipol 的头像

franzipol9 个月前

🍏 Apple Silicon Unlock For the first time in this WebUI, I've enabled MPS (Metal) Support for rendering! Owners of M1/M2/M3 chips can now generate AND render videos natively. I've included a custom MPS-Lite build of gsplat, so it works out-of-the-box. No compiling. Just magic. ✨

franzipol 的头像

franzipol9 个月前

⚡️ Experience Upgrades - Real-Time Preview: Watch videos generate frame-by-frame. - Low VRAM Mode: Now universal. Generate PLY models even on 8GB cards or via shared memory. - Library Integration: Refactored to a pure python library implementation for better stability and control.

franzipol 的头像

franzipol9 个月前

Give it a spin! One-click install via Pinokio Browser. Special thanks to @cocktailpeanut for the Pinokio ecosystem, and the teams behind ML-Sharp and gsplat for their incredible open-source work! #3DGS #AI #Mac #OpenSource #GaussianSplatting #Pinokio

Grizu 的头像

Grizu9 个月前

Awesome, been waiting for this 👻

Ian George 的头像

Ian George9 个月前

Nice one 👏🖖🏻 I’ll give it a go the next days.

franzipol 的头像

franzipol9 个月前

Thanks Ian

Ian George 的头像

Ian George9 个月前

You’re welcome. (Good to see you in here as well as TikTok btw.🍻)

franzipol 的头像

franzipol9 个月前

Yeah, I appear and disappear 😅

Ian George 的头像

Ian George9 个月前

Makes two of us then 😜

franzipol 的头像

franzipol9 个月前

haha

Esber 的头像

Esber9 个月前

Any idea how I can do this with 360 images? Thanks :)

franzipol 的头像

franzipol9 个月前

I don’t think it will work properly as the model trained by apple doesn’t take into account 360

Jithin Palepu 的头像

Jithin Palepu9 个月前

this looks awesome, the native Mac support is gonna open up a lot of possibilities for creators. real-time previews are huge too, can't wait to see what people come up with using those new camera trajectories. 3D gaussian splats sound wild, I’m all in for experimenting with that!

franzipol 的头像

franzipol9 个月前

thanks for your words 🙏

Joshua Poddoku 的头像

Joshua Poddoku9 个月前

Nice update, but the gaussian splat preview is still black on my setup as well

franzipol 的头像

franzipol9 个月前

there can be 2 reasons (I had some feedback): - 1 guy realized he had an older version of Pinokio (still on 3 something) and after updating it to the latest 5.3.5 everything worked correctly - another person reported me the gradio 6.3.0 was messing with the preview so a few hours ago I updated the installer and the updater forcing 6.2.0 Anyway can you provide me more details about your system?

Fractality Dream 的头像

Fractality Dream9 个月前

😍😍😍

bommer GG 的头像

bommer GG9 个月前

nice

Ananya Patelik 的头像

Ananya Patelik9 个月前

those new camera moves are like adding extra brushstrokes to a digital canvas. can’t wait to splat some 3d dreams from a single snapshot!

franzipol 的头像

franzipol9 个月前

❤️

Kevin Elliott 的头像

Kevin Elliott9 个月前

This is so freaking insane, I can't even believe this is possible now.

相关视频

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

Daniel Skaale

74,512 次观看 • 10 个月前

A 1-billion-parameter motion model trained on NVIDIA CUDA, requiring 8GB of VRAM for real-time operation. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, enabling rapid creation of 3D animation data.

A 1-billion-parameter motion model trained on NVIDIA CUDA, requiring 8GB of VRAM for real-time operation. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, enabling rapid creation of 3D animation data.

CYANPUPPETS

103,481 次观看 • 1 年前

Released Splatline v2.0 🚀 Video → 3D Gaussian splats in seconds.

Released Splatline v2.0 🚀 Video → 3D Gaussian splats in seconds.

Jaskirat Singh

30,967 次观看 • 3 个月前

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

M. Ali Kapadia

26,886 次观看 • 8 个月前

Free Blender AI motion capture plugin: Connects to 1080P camera, runs on a local computer with a 10-billion-parameter model, and requires 8GB VRAM for real-time processing. Supports both real-time capture and video uploads.

Free Blender AI motion capture plugin: Connects to 1080P camera, runs on a local computer with a 10-billion-parameter model, and requires 8GB VRAM for real-time processing. Supports both real-time capture and video uploads.

CYANPUPPETS

235,045 次观看 • 1 年前

Gaussian splats in Blender 5.3! Had to take it for a quick spin ofc - here with a scene I did using a generated image, Minimax H3-Max camera control through - converted to Gaussian splats with KIRI Engine - 3D Scanner App. It is possible to relight scenes with Gaussian Splats too, but it was pretty sloggish for me, even on a 5090. Could probably get better results with some optimization. It is kinda crazy to see this unfold - from image, to video, to 3d to dynamic generative worlds.

Gaussian splats in Blender 5.3! Had to take it for a quick spin ofc - here with a scene I did using a generated image, Minimax H3-Max camera control through - converted to Gaussian splats with KIRI Engine - 3D Scanner App. It is possible to relight scenes with Gaussian Splats too, but it was pretty sloggish for me, even on a 5090. Could probably get better results with some optimization. It is kinda crazy to see this unfold - from image, to video, to 3d to dynamic generative worlds.

Martin Nebelong

22,942 次观看 • 1 个月前

🚀 Alpha Launch: Insta360 Integration is NOW LIVE on OVER! We're building the world's largest 3D dataset, and you can help! 🛠️ Turn your Insta360 camera into a powerful 3D mapping tool. Create navigable Mega Gaussian Splats & stunning, scalable 3D maps up to 30x faster! With your Insta360, you can map over 60 OVRLands in just 10 minutes!

🚀 Alpha Launch: Insta360 Integration is NOW LIVE on OVER! We're building the world's largest 3D dataset, and you can help! 🛠️ Turn your Insta360 camera into a powerful 3D mapping tool. Create navigable Mega Gaussian Splats & stunning, scalable 3D maps up to 30x faster! With your Insta360, you can map over 60 OVRLands in just 10 minutes!

Over the Reality 🌐

65,122 次观看 • 1 年前

Blender AI Motion Capture Plugin — Connects to a 1080P webcam and runs locally on your computer. Powered by a 1-billion-parameter model, it requires an 8GB VRAM GPU for real-time processing. Supports both real-time capture and video upload. The full-featured version currently supports NVIDIA CUDA only, and requires DX11 or above.

Blender AI Motion Capture Plugin — Connects to a 1080P webcam and runs locally on your computer. Powered by a 1-billion-parameter model, it requires an 8GB VRAM GPU for real-time processing. Supports both real-time capture and video upload. The full-featured version currently supports NVIDIA CUDA only, and requires DX11 or above.

CYANPUPPETS

58,611 次观看 • 1 年前

Generate Songs with HeartMuLa, with 8GB VRAM! HeartMuLa is the latest open source song generation AI model everyone's raving about. But the default model couldn't run on low VRAM machines. Then WanGP just made it work with just 8GB VRAM! 1-Click Install on Pinokio.

Generate Songs with HeartMuLa, with 8GB VRAM! HeartMuLa is the latest open source song generation AI model everyone's raving about. But the default model couldn't run on low VRAM machines. Then WanGP just made it work with just 8GB VRAM! 1-Click Install on Pinokio.

cocktail peanut

27,989 次观看 • 9 个月前

Excited to announce 🚀gsplat v1.0🚀: a ⏩efficient⏩ CUDA backend for 3D Gaussian Splatting! A drop-in replacement of the official impl. with: - Up to 2x faster training; - Up to 4x less GPU memory; - Render millions of GSs in real-time; - And more;

Excited to announce 🚀gsplat v1.0🚀: a ⏩efficient⏩ CUDA backend for 3D Gaussian Splatting! A drop-in replacement of the official impl. with: - Up to 2x faster training; - Up to 4x less GPU memory; - Render millions of GSs in real-time; - And more;

Ruilong Li

88,325 次观看 • 2 年前

Generate 3D from just one image, on your computer. franzipol has built a gradio web ui for Apple's Sharp, which infers an entire 3D view from just one image. You can run it on any computer with 1-click: Mac, Linux, Windows. Just need 10GB VRAM (16GB memory on Macs).

Generate 3D from just one image, on your computer. franzipol has built a gradio web ui for Apple's Sharp, which infers an entire 3D view from just one image. You can run it on any computer with 1-click: Mac, Linux, Windows. Just need 10GB VRAM (16GB memory on Macs).

cocktail peanut

157,863 次观看 • 10 个月前

Blender AI Real-Time Motion Capture Plugin — connect a 1080P camera or upload videos. It runs locally with a 1-billion-parameter model and requires 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads. The full-parameter version currently supports NVIDIA CUDA and requires DX11 or higher.

Blender AI Real-Time Motion Capture Plugin — connect a 1080P camera or upload videos. It runs locally with a 1-billion-parameter model and requires 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads. The full-parameter version currently supports NVIDIA CUDA and requires DX11 or higher.

CYANPUPPETS

54,568 次观看 • 7 个月前

Blender AI Real-Time Motion Capture Plugin — connect a 1080P camera or upload videos. It runs locally with a 1-billion-parameter model and requires 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads. The full-parameter version currently supports NVIDIA CUDA and requires DX11 or higher.

Blender AI Real-Time Motion Capture Plugin — connect a 1080P camera or upload videos. It runs locally with a 1-billion-parameter model and requires 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads. The full-parameter version currently supports NVIDIA CUDA and requires DX11 or higher.

CYANPUPPETS

26,492 次观看 • 9 个月前

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.

Dreaming Tulpa 🥓👑

79,033 次观看 • 2 年前

⚡️Generating 3DGS scenes in 5 seconds on a single GPU⚡️ #FlashWorld enables ⚡️*fast*⚡️ (10~100x faster than previous methods) and 🔥*high-quality*🔥 3D world generation, from a single image or text prompt. Code: Page:

⚡️Generating 3DGS scenes in 5 seconds on a single GPU⚡️ #FlashWorld enables ⚡️fast⚡️ (10~100x faster than previous methods) and 🔥high-quality🔥 3D world generation, from a single image or text prompt. Code: Page:

Tengfei Wang

119,877 次观看 • 1 年前

Gaussian Splats can now be animated in Blender New 3DGS Render addon update: - Blender 5.1 support - 4DGS / .ply sequence export - Experimental rigging tools - Experimental light baking Check below for links 👇

Gaussian Splats can now be animated in Blender New 3DGS Render addon update: - Blender 5.1 support - 4DGS / .ply sequence export - Experimental rigging tools - Experimental light baking Check below for links 👇

KIRI Engine - 3D Scanner App

15,666 次观看 • 5 个月前

🚀 Omnia Splat Builder is close to launch. 🧽 🎥 Video or a single still → trained 3D Gaussian splat, fully local on one consumer GPU. Newly added: - Custom MCMC+ SIFT Splat solver - H3 Max 360 Camera control from one image, - Dynamic 4D, and an orbit guard for AI clips. - Depth Anything V3 prior, seeded background. 🛠️ COLMAP + GLOMAP fallback, SIFT + LightGlue , Crop box, PLY / Postshot / 4D NPZ export. #GaussianSplatting #3DGS #NeRF #Photogrammetry #ComputerVision #IndieDev #3DReconstruction

🚀 Omnia Splat Builder is close to launch. 🧽 🎥 Video or a single still → trained 3D Gaussian splat, fully local on one consumer GPU. Newly added: - Custom MCMC+ SIFT Splat solver - H3 Max 360 Camera control from one image, - Dynamic 4D, and an orbit guard for AI clips. - Depth Anything V3 prior, seeded background. 🛠️ COLMAP + GLOMAP fallback, SIFT + LightGlue , Crop box, PLY / Postshot / 4D NPZ export. #GaussianSplatting #3DGS #NeRF #Photogrammetry #ComputerVision #IndieDev #3DReconstruction

Daniel Skaale

12,023 次观看 • 1 个月前

Run Hy-Nomas World Model with 8GB VRAM WanGP has added Hy-Nomas, a world model you can control with WASD and text prompt. Should run realtime on 24GB+ VRAM machines, but probably not realtime on 8GB VRAM. 1-click launch on pinokio (thread)

Run Hy-Nomas World Model with 8GB VRAM WanGP has added Hy-Nomas, a world model you can control with WASD and text prompt. Should run realtime on 24GB+ VRAM machines, but probably not realtime on 8GB VRAM. 1-click launch on pinokio (thread)

cocktail peanut

14,755 次观看 • 7 天前