A full x86_64 Linux VM sandbox in WASM with host OS read-only folder mount, accessible via native tool calls by a WebGPU LLM. Video is real time. There is no server, no privacy concerns, no “escapes”. Comfortably in a browser tab. Sandboxes work. If they don’t: Not a sandbox.

Very cool, do you have any more details on how to set one up?

I’ll probably have a short writeup and code by the end of the week. I’ve been running this setup in wazero WASM runtime for several months, and to be completely honest it’s little more than some Make/Go/JSON. But I’m realizing that’s worth writing about now. 🫠

Yes please! Would love to read more about this and any different approaches you’ve tested!

I can definitely write about that (and any other questions or scrutiny you want answered)! Feel free to DM me anything you want covered, I treat my blogs like they’re public facing notes of personal projects, so anything is on the table even if it makes me look silly

Yo @ZackKorman Remy is a bad ass and you should both talk

@ZackKorman Always down for a chat!

This is so dope

The read-only mount is the detail I like. A sandbox is only as good as the host access it exposes.

Cool, are you limited by the 256mb max buffer? happy to pitch in the GPU code part to add cuda/vulkan support to raise it to 4gb

post the git or stfu

what is git

git is an old old wooden ship that was used in the civil war era (pre llm)

@_mattata it seems pretty fast inference for WebGPU no?

@maceip It’s just transformers.js with the typical kernel tuning. I’m not claiming to have done anything particularly novel here fwiw.

@maceip just curious because the only person I saw trying WebGPU was @maceip and it seemed slower but I guess he used a 3B

@_mattata vibethinker-3b still fundamentally misunderstood

Super cool!! This is what I wanted for (currently runs RISCV64 for speed - soon will switch to a new ARM64 emulator) But memory constrains for iOS is kinda deal breaker.

@0x6D6172636F Mmm so good to see virtualization done well

now, put it in an nsjail, just to be sure.

Read-only host mounts are the boring pass condition for sandbox demos 👀

This is brilliant.

Have you ever seen a children's sandbox that always managed to contain the sand? Not sure that term has been well thought out.

…yes? Plenty of times at amusement parks where critical thought went into the design. The purpose of a sandbox is a box to contain sand. Containing the sand is the entire purpose of the box. If the box doesn’t contain the sand: you have a pile of escaped sand and a bad sandbox.

Yes.

@chompie1337 whats the vm?