Loading video...

Video Failed to Load

Go Home

My 3DGS tool [Extract Sharpest Frame] will support to generate masks by free text with SAM3 in next version. Now final testing. The flexible masking improves the result of SfM and 3DGS.😀 #3DGS #SAM3 #Meta

kotohibi_3d's profile picture

kotohibi

2,963 subscribers

21,624 views • 5 months ago •via X (Twitter)

#3DGS#SAM3#Meta
LIVE

Anya Rossi• Live Now

Private livecam show

6 Comments

Gaussian Mermaid's profile picture
Gaussian Mermaid5 months ago

Hi I am using your software. Can you please add the possibility to add a fixed predefined mask over the detected mask. Now I have to do this using a separate script

kotohibi's profile picture
kotohibi5 months ago

Hi, the binary edition in BOOTH has already supported custom mask.

Dan's profile picture
Dan5 months ago

Great work, thank you!

GY's profile picture
GY5 months ago

Sam3 is massive!

kotohibi's profile picture
kotohibi5 months ago

Yes, SAM3 lib will separated from the base app. only those who want is to download and use this.

Akira Tanaka's profile picture
Akira Tanaka5 months ago

SAM3でマスク生成がとても楽になりました。

Related Videos

With DJI AVATA360 and 3DGS, let's be a bird😀. (4K) Tools : * AVATA360 : 10min fly, DLog * my 3DGS tools : frame extraction, SAM3 masking, cubemap conversion (now on sale) * Metashape std : SfM * LFS : 3DGS train with MRNF (no cleaning) * Postshot : Camera work
1:17

With DJI AVATA360 and 3DGS, let's be a bird😀. (4K) Tools : * AVATA360 : 10min fly, DLog * my 3DGS tools : frame extraction, SAM3 masking, cubemap conversion (now on sale) * Metashape std : SfM * LFS : 3DGS train with MRNF (no cleaning) * Postshot : Camera work

kotohibi

16,473 views • 5 months ago

The result of reprocessing an old OSMO360 data with the latest my workflow (Dual SAM3 + Seam mask + Cubemap reduction). See in 4K 😀 (The lower shrine in previous post leads to the upper shrine on the summit in Oyama) ---Steps--- 1. DJI OSMO360 10min walk ("RockSteady off") 2. Frame extraction and masking in my 3DGS tool : 851images 3. Spherical SfM in Metashape std. with the masks 4. Cubemap conversion with the mask and cubemap reduction (17% cutoff) in my 3DGS tool 5. 3DGS train by LFS, RTX 4090, 15M, SH2, PPISP 6. Cam work by LFS ----------- Of course, my tools and workflow are available for Insta360 X6. If you try longer 3DGS than 2 min limitation of Insta360 3DGS, please let's try this(See comment).😊
0:59

The result of reprocessing an old OSMO360 data with the latest my workflow (Dual SAM3 + Seam mask + Cubemap reduction). See in 4K 😀 (The lower shrine in previous post leads to the upper shrine on the summit in Oyama) ---Steps--- 1. DJI OSMO360 10min walk ("RockSteady off") 2. Frame extraction and masking in my 3DGS tool : 851images 3. Spherical SfM in Metashape std. with the masks 4. Cubemap conversion with the mask and cubemap reduction (17% cutoff) in my 3DGS tool 5. 3DGS train by LFS, RTX 4090, 15M, SH2, PPISP 6. Cam work by LFS ----------- Of course, my tools and workflow are available for Insta360 X6. If you try longer 3DGS than 2 min limitation of Insta360 3DGS, please let's try this(See comment).😊

kotohibi

23,560 views • 2 months ago

I re-processed this 3DGS with dense splats and seam mask. (See in 4K) * Seam mask is to reduce errors around stitch line of dual fisheye for SfM and 3DGS train.(See comment) ---Steps--- 1. DJI OSMO360 10min walk 2. Frame extraction and SAM3 + seam masking : 774 images by my 3DGS tools 3. Spherical SfM by Metashape std with the mask 5. Cubemap conversion with the seam mask by my 3DGS tools 6. 3DGS train by LichtFeld Studio : 15M, SH2, MRNF, PPISP, RTX4090 10hours 7. Cam work by LichtFeld Studio ---------- #LFS #OSMO360
1:00

I re-processed this 3DGS with dense splats and seam mask. (See in 4K) * Seam mask is to reduce errors around stitch line of dual fisheye for SfM and 3DGS train.(See comment) ---Steps--- 1. DJI OSMO360 10min walk 2. Frame extraction and SAM3 + seam masking : 774 images by my 3DGS tools 3. Spherical SfM by Metashape std with the mask 5. Cubemap conversion with the seam mask by my 3DGS tools 6. 3DGS train by LichtFeld Studio : 15M, SH2, MRNF, PPISP, RTX4090 10hours 7. Cam work by LichtFeld Studio ---------- #LFS #OSMO360

kotohibi

20,472 views • 3 months ago

I'm again reprocessing an old OSMO360 data with the latest my workflow (Dual SAM3 + Seam mask). See in 4K. --Steps-- 1. OSMO 360 10min walk ("RockSteady off") 2. Frame extraction and masking in my 3DGS tool : 613 images 3. SfM in Metashape std. with the masks -------- The sparse point cloud looks better than previous my workflow.😀
0:50

I'm again reprocessing an old OSMO360 data with the latest my workflow (Dual SAM3 + Seam mask). See in 4K. --Steps-- 1. OSMO 360 10min walk ("RockSteady off") 2. Frame extraction and masking in my 3DGS tool : 613 images 3. SfM in Metashape std. with the masks -------- The sparse point cloud looks better than previous my workflow.😀

kotohibi

22,546 views • 3 months ago

An entire cape 3DGS by AVATA360 & AprilTag [workflow] 12min fly -> my tool (Frame extraction&SAM3 masking) -> Metashape std -> my tool(Cubemap&Size estimation) -> LFS (5M splats & no clean) I will check the accuracy of size later on. See my guide how to make this😀
0:47

An entire cape 3DGS by AVATA360 & AprilTag [workflow] 12min fly -> my tool (Frame extraction&SAM3 masking) -> Metashape std -> my tool(Cubemap&Size estimation) -> LFS (5M splats & no clean) I will check the accuracy of size later on. See my guide how to make this😀

kotohibi

22,471 views • 4 months ago

This is a result of spherical SfM by Metashape std. It is very stable, accurate, fast and even no failure. Best match with AVATA 360, I think😀 -------------- Location : Miho dam (See the comment) Video length : 14:34 flight by DJI AVATA360 Frame extraction and masking : 875 images by my 3DGS tools ------------- Move to 3DGS train.💪
0:45

This is a result of spherical SfM by Metashape std. It is very stable, accurate, fast and even no failure. Best match with AVATA 360, I think😀 -------------- Location : Miho dam (See the comment) Video length : 14:34 flight by DJI AVATA360 Frame extraction and masking : 875 images by my 3DGS tools ------------- Move to 3DGS train.💪

kotohibi

20,700 views • 3 months ago

A 3DGS of a dam in Japan by DJI AVATA 360 (See in 4K) ---steps--- 1. Location : Miho dam in Tanzawa lake 2. Video length : 14:34 8K DLog-M 3. Frame extraction and masking : 875 images by my 3DGS tools 4. Spherical SfM by Metashape std with mask 5. Cubemap conversion and parallax-based reduction by my 3DGS tools 6. 3DGS train by LichtFeld Studio : 15M, SH2, MRNF, PPISP 7. Cam work by LichtFeld Studio ------------- #LFS #丹沢湖 #三保ダム #AVATA360
0:59

A 3DGS of a dam in Japan by DJI AVATA 360 (See in 4K) ---steps--- 1. Location : Miho dam in Tanzawa lake 2. Video length : 14:34 8K DLog-M 3. Frame extraction and masking : 875 images by my 3DGS tools 4. Spherical SfM by Metashape std with mask 5. Cubemap conversion and parallax-based reduction by my 3DGS tools 6. 3DGS train by LichtFeld Studio : 15M, SH2, MRNF, PPISP 7. Cam work by LichtFeld Studio ------------- #LFS #丹沢湖 #三保ダム #AVATA360

kotohibi

23,780 views • 3 months ago

DJI OSMO360 with my tool is very easy and fast for 3DGS workflow. This 3DGS took only 5 min walk for capturing whole shrine :) Let's try 3DGS ! #OSMO360 #3DGS #Metashape #Postshot #Gaussian
1:27

DJI OSMO360 with my tool is very easy and fast for 3DGS workflow. This 3DGS took only 5 min walk for capturing whole shrine :) Let's try 3DGS ! #OSMO360 #3DGS #Metashape #Postshot #Gaussian

kotohibi

51,238 views • 7 months ago

A test of real-time transfer of images captured on Quest to a PC, where they are converted into 3D using Apple's SHARP. Currently, the final 3DGS output is displayed on the PC. The next step is to bring the result back into Quest for in-headset viewing. #3DGS #metaquest #AR
1:34

A test of real-time transfer of images captured on Quest to a PC, where they are converted into 3D using Apple's SHARP. Currently, the final 3DGS output is displayed on the PC. The next step is to bring the result back into Quest for in-headset viewing. #3DGS #metaquest #AR

Takashi Yoshinaga

11,575 views • 6 months ago

A 3DGS of 1.5km in round trip😀(See in 4K)
1:00

A 3DGS of 1.5km in round trip😀(See in 4K)

kotohibi

22,306 views • 3 months ago

This is my first trial of Colmap 360 SfM.(See in 4K) It's not bad, but it could be better🫤. Metashape is easier to use than it. Steps: 1. [DJI Studio]Develop raw data without RockSteady 2. [Extractor]Extract frames / Dual SAM3 and Seam mask 3. [Colmap(V4.2)] 360 SfM with mask 4. [CCConverter] Cubemap conversion 5. [LFS] 3DGS train, 7M/SH1/PPISP, No clean-up 6. [LFS] Cam work
0:59

This is my first trial of Colmap 360 SfM.(See in 4K) It's not bad, but it could be better🫤. Metashape is easier to use than it. Steps: 1. [DJI Studio]Develop raw data without RockSteady 2. [Extractor]Extract frames / Dual SAM3 and Seam mask 3. [Colmap(V4.2)] 360 SfM with mask 4. [CCConverter] Cubemap conversion 5. [LFS] 3DGS train, 7M/SH1/PPISP, No clean-up 6. [LFS] Cam work

kotohibi

12,620 views • 1 month ago

Real Scale 3DGS give additional value to your work. This video is just examples for it. Let's inspire from this. (The original data provided by イナダユウキ, Thanks😀) See comment #UnrealEngine #3DGS #AprilTag
1:33

Real Scale 3DGS give additional value to your work. This video is just examples for it. Let's inspire from this. (The original data provided by イナダユウキ, Thanks😀) See comment #UnrealEngine #3DGS #AprilTag

kotohibi

15,995 views • 5 months ago

3DGS AI slop is over. Training 3DGS is now faster than loading the whatever slop 3D model into to GPU, 1M Gaussians in 20s, low memory footprint, insane PSNR.
0:30

3DGS AI slop is over. Training 3DGS is now faster than loading the whatever slop 3D model into to GPU, 1M Gaussians in 20s, low memory footprint, insane PSNR.

ǝɥǝ⅄

22,926 views • 2 months ago

My next Gaussian splat: a seven spotted ladybug in flight! #3dgs #GaussianSplatting
0:25

My next Gaussian splat: a seven spotted ladybug in flight! #3dgs #GaussianSplatting

Dany Bittel

65,772 views • 9 months ago

3DGS Render Addon for Blender is out! New features include: - Paint and use image textures to edit colour - Mesh to 3DGS conversion - Transformations and edits are exportable - Lot's of other boosts and little features! Link for the addon and a Quick Guide tutorial below #b3d #blender #3dgs #gaussiansplatting
1:24

3DGS Render Addon for Blender is out! New features include: - Paint and use image textures to edit colour - Mesh to 3DGS conversion - Transformations and edits are exportable - Lot's of other boosts and little features! Link for the addon and a Quick Guide tutorial below #b3d #blender #3dgs #gaussiansplatting

KIRI Engine - 3D Scanner App

19,019 views • 1 year ago

#ComfyUI #Comfy3D Coming Soon: 3D UI for ComfyUI Support 3DGS and Mesh render, may support Nerf render in the future
0:25

#ComfyUI #Comfy3D Coming Soon: 3D UI for ComfyUI Support 3DGS and Mesh render, may support Nerf render in the future

Mr. For Example

26,227 views • 2 years ago

One more DJI AVATA360 3DGS is here ! (See in 4K video) The data was taken by イナダユウキ,too (*Skilled drone artist*) I'm horner to collaboration with him😀 "AVATA360->Metashape(Tie point clean)->my tools->(LFS)LichtFeld Studio(MRNF)" All around view is possible thank to drone. And I didn't even do any cleanup thank to LFS MRNF. #AVATA360 #3DGS #LFS #DJI
0:38

One more DJI AVATA360 3DGS is here ! (See in 4K video) The data was taken by イナダユウキ,too (*Skilled drone artist*) I'm horner to collaboration with him😀 "AVATA360->Metashape(Tie point clean)->my tools->(LFS)LichtFeld Studio(MRNF)" All around view is possible thank to drone. And I didn't even do any cleanup thank to LFS MRNF. #AVATA360 #3DGS #LFS #DJI

kotohibi

46,240 views • 7 months ago

Teaser: Something exciting is coming. I wonder if #3DGS will help to push self driving cars to the next level.
0:26

Teaser: Something exciting is coming. I wonder if #3DGS will help to push self driving cars to the next level.

MrNeRF

15,781 views • 2 years ago

Point cloud, 3D GS and portal mechanics to move between them, all in real time (Spark + #ThreeJS). Moving from point cloud to 3DGS changes the perception of the same space dramatically... the Westmount Greenhouse captured w/ the PortalCam. #3DGS #GaussianSplatting #PointCloud
1:56

Point cloud, 3D GS and portal mechanics to move between them, all in real time (Spark + #ThreeJS). Moving from point cloud to 3DGS changes the perception of the same space dramatically... the Westmount Greenhouse captured w/ the PortalCam. #3DGS #GaussianSplatting #PointCloud

Hugues Bruyère

31,401 views • 8 months ago