Loading video...
Video Failed to Load
Deekseek V4 Flash 0731 driving Kali Linux via Docker to reverse engineer Apples RDMA protocol to allow my Spark and MBP to talk to each other. Wild times.
80,284 views • 1 month ago •via X (Twitter)
52 Comments

Picked up a Spark today. With RDMA, Spark's going to be a hell of a prefill worker for the Mac.

That’s exactly the workload I’m targeting. The Spark is advertising Apple’s RDMA service; the remaining blocker is USB4/XDomain peer enumeration. Once I reach PORT_ACTIVE, disaggregated prefill is one of my first tests. Would you be interested in validating the setup on your Spark when it’s reproducible?

Absolutely, I'll be the first in line.

@ashxhart If you need another count me in

@repressionnap I'll be in touch 🚀

Please document your findings!

100%

It will be interesting where workload splits sit best and who orchestrates them. i currently think about an 'ADA' mode, agent defined architecture, to test out several options, but most likely someone will be faster than me.

Try randomized ram scrambling to reveal all hidden CPU registers. There's a project with code doing this. I wanted to use it to rev an UWB radar on a mini robot to flash it with my own firmware.

Try Sol xhigh, it is absolutely amazing for RE

@u1tra_instinct We are living in a cyberpunk anime world.

Do you think it's possible to reverse engineer the new spyware warning was just implemented?

Anything is possible.

Love what you doing…

Cheers mate. I’m close; I’ll post the proof when the link is actually live.

👀

I’m soo close 💪🏻🚀

Can’t wait to see this

Wild times indeed honestly

Freaking awesome!!

Is there a reason you couldn’t just run the reverse engineering tools like radare on macOS directly instead? This feels like using Kali just because it’s Kali rather than having a good reason.

I wanted to keep everything inside a container, especially with me using AI to do it.

🔥

OMG that is actually crazy. 2M5’s and 2GB10 are waiting 😬. Prefill is not that important for me , running bigger models without speed penalty is. (Prefill on M5 is OK and caching takes care of the rest)

🤔

We are almost here.

@u1tra_instinct Ummm, I am happy to help with this however I can.

dockerizing kali to break the apple walled garden. beautiful.

Any luck yet? Curious to see how this shakes out and compares to exo

Getting there, lots of hurdles but I’ve managed to decrypt the RDMA dylib which is moving in the right direction. I’ve got 10gbps working but I want the full 20 as well.

It’s a good model

@u1tra_instinct Followed 👀

Spark and MBP talking over an Apple RDMA stack reverse engineered by an AI. I knew AI and infosec tooling were converging but seeing it live? Wild times.

Give your local AI a red team skill, let it drive Kali Linux, and you have a formidable force.

Crazy 🙌🤞

我一直在想我的 kali 应该如何被 Ai 驱动,现在我得到了一个不错的方案。

Deepseek loves Kali

Indeed

@spyced First time learning about this seems incredible. Will you also look to expand coverage for Ryzen AI Max (Strix Halo) devices?

That is actually sick! While your at it, can you make macOS compatible with Valve's proton layer? I want to buy a Mac for AI but I want to be able to play CS2 😁

Excellent. Just curious, what's your machine config?

My Laptop or inference setup?

I mean laptop

@grok what is this about?

Why bothering yourself like that there’s too much easy way to do this 🤦🏾♂️

Another project that will not generate no revenue

I am not in it for revenue; I am here to unlock Metal and CUDA talking to each other via RDMA.

..apple and microsoft *still* won't accept the other's email signature as such both of them make the others sig an attachment

You will need something smarter than v4 Flash, probably GLM-5.3 or better can help you bridge. Will be shocked if v4 Flash did it

Would love to know your local setup to pull something like this

Honestly, I’m running Deepseek V4 0731 across two sparks. I have a few custom plugins for PI and also a red team skill I’ve created. Ultimately, any uncensored model will do it but it depends on the size for the quality.

Check out "hellas-ai/thunderbolt-ibverbs" before starting from scratch. They already reverse-engineered much of Apple’s AD/FA57 RDMA-over-Thunderbolt and built a Linux ibverbs implementation for Mac ↔ Linux.

