Loading video...

Video Failed to Load

Go Home

Deekseek V4 Flash 0731 driving Kali Linux via Docker to reverse engineer Apples RDMA protocol to allow my Spark and MBP to talk to each other. Wild times.

80,284 views • 1 month ago •via X (Twitter)

52 Comments

AutoGolpe 127b Flash Q2.5 Abliterated's profile picture
AutoGolpe 127b Flash Q2.5 Abliterated1 month ago

Picked up a Spark today. With RDMA, Spark's going to be a hell of a prefill worker for the Mac.

Ash Hart's profile picture
Ash Hart1 month ago

That’s exactly the workload I’m targeting. The Spark is advertising Apple’s RDMA service; the remaining blocker is USB4/XDomain peer enumeration. Once I reach PORT_ACTIVE, disaggregated prefill is one of my first tests. Would you be interested in validating the setup on your Spark when it’s reproducible?

AutoGolpe 127b Flash Q2.5 Abliterated's profile picture
AutoGolpe 127b Flash Q2.5 Abliterated1 month ago

Absolutely, I'll be the first in line.

weathermanj's profile picture
weathermanj1 month ago

@ashxhart If you need another count me in

Ash Hart's profile picture
Ash Hart1 month ago

@repressionnap I'll be in touch 🚀

Christopher 🛩️'s profile picture
Christopher 🛩️1 month ago

Please document your findings!

Ash Hart's profile picture
Ash Hart1 month ago

100%

Acid Energy's profile picture
Acid Energy1 month ago

It will be interesting where workload splits sit best and who orchestrates them. i currently think about an 'ADA' mode, agent defined architecture, to test out several options, but most likely someone will be faster than me.

X4's profile picture
X41 month ago

Try randomized ram scrambling to reveal all hidden CPU registers. There's a project with code doing this. I wanted to use it to rev an UWB radar on a mini robot to flash it with my own firmware.

lucas's profile picture
lucas1 month ago

Try Sol xhigh, it is absolutely amazing for RE

Kaustab Pal's profile picture
Kaustab Pal1 month ago

@u1tra_instinct We are living in a cyberpunk anime world.

Daniel Skole's profile picture
Daniel Skole1 month ago

Do you think it's possible to reverse engineer the new spyware warning was just implemented?

Ash Hart's profile picture
Ash Hart1 month ago

Anything is possible.

keys 🧪's profile picture
keys 🧪1 month ago

Love what you doing…

Ash Hart's profile picture
Ash Hart1 month ago

Cheers mate. I’m close; I’ll post the proof when the link is actually live.

0x3y3's profile picture
0x3y31 month ago

👀

Ash Hart's profile picture
Ash Hart1 month ago

I’m soo close 💪🏻🚀

0x3y3's profile picture
0x3y31 month ago

Can’t wait to see this

AI Mastery Guide's profile picture
AI Mastery Guide1 month ago

Wild times indeed honestly

unpopulist's profile picture
unpopulist1 month ago

Freaking awesome!!

areyouevenreal's profile picture
areyouevenreal1 month ago

Is there a reason you couldn’t just run the reverse engineering tools like radare on macOS directly instead? This feels like using Kali just because it’s Kali rather than having a good reason.

Ash Hart's profile picture
Ash Hart1 month ago

I wanted to keep everything inside a container, especially with me using AI to do it.

geo ppls's profile picture
geo ppls1 month ago

🔥

Yves Van Den Broek's profile picture
Yves Van Den Broek1 month ago

OMG that is actually crazy. 2M5’s and 2GB10 are waiting 😬. Prefill is not that important for me , running bigger models without speed penalty is. (Prefill on M5 is OK and caching takes care of the rest)

Wiseguy☘️'s profile picture
Wiseguy☘️1 month ago

🤔

Lim Tzu's profile picture
Lim Tzu1 month ago

We are almost here.

ecohash.co's profile picture
ecohash.co1 month ago

@u1tra_instinct Ummm, I am happy to help with this however I can.

Frank ✈️ (📜,📜)'s profile picture
Frank ✈️ (📜,📜)1 month ago

dockerizing kali to break the apple walled garden. beautiful.

JS's profile picture
JS1 month ago

Any luck yet? Curious to see how this shakes out and compares to exo

Ash Hart's profile picture
Ash Hart1 month ago

Getting there, lots of hurdles but I’ve managed to decrypt the RDMA dylib which is moving in the right direction. I’ve got 10gbps working but I want the full 20 as well.

Stephen Edginton's profile picture
Stephen Edginton1 month ago

It’s a good model

dfi's profile picture
dfi1 month ago

@u1tra_instinct Followed 👀

Not aToaster's profile picture
Not aToaster1 month ago

Spark and MBP talking over an Apple RDMA stack reverse engineered by an AI. I knew AI and infosec tooling were converging but seeing it live? Wild times.

Ash Hart's profile picture
Ash Hart1 month ago

Give your local AI a red team skill, let it drive Kali Linux, and you have a formidable force.

Ryan Wright's profile picture
Ryan Wright1 month ago

Crazy 🙌🤞

Rivers's profile picture
Rivers1 month ago

我一直在想我的 kali 应该如何被 Ai 驱动,现在我得到了一个不错的方案。

Ash Hart's profile picture
Ash Hart1 month ago

Deepseek loves Kali

ninetieth's profile picture
ninetieth1 month ago

Indeed

Sol's profile picture
Sol1 month ago

@spyced First time learning about this seems incredible. Will you also look to expand coverage for Ryzen AI Max (Strix Halo) devices?

Prophet Joel's profile picture
Prophet Joel1 month ago

That is actually sick! While your at it, can you make macOS compatible with Valve's proton layer? I want to buy a Mac for AI but I want to be able to play CS2 😁

Pankaj Parkar 🇮🇳's profile picture
Pankaj Parkar 🇮🇳1 month ago

Excellent. Just curious, what's your machine config?

Ash Hart's profile picture
Ash Hart1 month ago

My Laptop or inference setup?

Pankaj Parkar 🇮🇳's profile picture
Pankaj Parkar 🇮🇳1 month ago

I mean laptop

Joobman's profile picture
Joobman1 month ago

@grok what is this about?

0xSaint's profile picture
0xSaint1 month ago

Why bothering yourself like that there’s too much easy way to do this 🤦🏾‍♂️

AI CITY's profile picture
AI CITY1 month ago

Another project that will not generate no revenue

Ash Hart's profile picture
Ash Hart1 month ago

I am not in it for revenue; I am here to unlock Metal and CUDA talking to each other via RDMA.

Protocol Police's profile picture
Protocol Police1 month ago

..apple and microsoft *still* won't accept the other's email signature as such both of them make the others sig an attachment

Samar's profile picture
Samar1 month ago

You will need something smarter than v4 Flash, probably GLM-5.3 or better can help you bridge. Will be shocked if v4 Flash did it

Akshat katiyar's profile picture
Akshat katiyar1 month ago

Would love to know your local setup to pull something like this

Ash Hart's profile picture
Ash Hart1 month ago

Honestly, I’m running Deepseek V4 0731 across two sparks. I have a few custom plugins for PI and also a red team skill I’ve created. Ultimately, any uncensored model will do it but it depends on the size for the quality.

𝕋obsen's profile picture
𝕋obsen1 month ago

Check out "hellas-ai/thunderbolt-ibverbs" before starting from scratch. They already reverse-engineered much of Apple’s AD/FA57 RDMA-over-Thunderbolt and built a Linux ibverbs implementation for Mac ↔ Linux.

Related Videos