I built a neural network inference engine from scratch in ~100 lines of C++. Here I explain it simply.

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 damm bro !! I just finished exploring fundamentals of LLM and everything u said just clicks.

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Makes sense brother

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @AnkurJangid02 Craji

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @AnkurJangid02 🫂

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 A hundred-line inference engine makes optimization tradeoffs easier to inspect and teach.

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Easy to understand the core logic, can keep adding optimizations on top of it

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 does it support quantization or is everything running in full precision

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 It's v1 only, no quantization logic yet, but would add it all while building the full version of this

@Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Crazy crazy broo

@Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 thank you thenk you Bhai

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 you even look cracked 😂 👏

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 I don't know if that's a complement 😂

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 it is :) 🤝

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 building an efficient inference stack on-chain via agent-to-agent settlement is a real next step here.

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Not into crypto, but seems interesting

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Would love to chat. DM me please!

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Hi, trying to reach you out ur DMs seems closed

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 les go bhai !!

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 How did you made the video?

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Secret juice

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 just wondering after the 2D→1D flatten for auto-vectorization, how much faster did the forward pass actually get on your machine?

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 As I mentioned in video, 10x

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 you got a follow me for this. how you differentiated training and inference and the significance of inference was interesting. Converting 2d vector into 1d for easier SIMD ops was also nice.

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Thanks man, Claude for learning

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Post this on linkeden they love this kind of shit

@jitendarma73662 @Adarsh_VMore @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Amazing bhai

@jitendarma73662 @Adarsh_VMore @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Thank you Bhai ♥️

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 that's cute, but writing 100 lines is usually just the beginning. the real challenge comes when you have to scale and maintain that model in production

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 🙌🔥

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02

@Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 broo by the way when the next video....

@Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Inference for gpt2 127M parameters coming soon

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 where is the code?

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Might post soon, logic was mostly covered in video though

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 What it does ?

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Damn that’s good. Would you open source it?

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Sure, Would post next.

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Nicely explained, thank you.

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Hehe, thanks brother

@jitendarma73662 @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Awesome stuff bro

@jitendarma73662 @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Thank you brother

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 short and simple ,that's great!!

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Thanks brother 😀

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Crazyy confidence and fluent english 🙌🏻🙌🏻

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Thanks brother

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Great Work!

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Mind blowing🤯

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Building with -O3 -march=native gets the matmul loops auto-vectorized, usually the biggest speedup before writing any SIMD by hand.

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 True dat

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Nice.

@rahul_meX @jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 kya baat hai 🔥

@rahul_meX @jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 🔥🔥🔥

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 But where is the link?

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 It's just 100 lines of code, of which 50 i already shared in video, so din't share that separately

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Frankly, thats so strange! Hows a gist/repo so hard? If else, how else does anyone test/run it?

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Andrej Kapathy ko follow kiye bhai?

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Kar leta hu

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Good starting point ☝️😁.. next time try playing with tensor cores or try to write your own cuda. It will be more fun... Tbh inferences , quantization , doing ml in CPP have its own realme tbh. But fun to try ur hand on

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 right, makes sense to do CUDA next. Do you have any good resources for it

@jitendar100x @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 bro stop tagging this scammer it will only affect your credibility

@jitendarma73662 @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @kirat_tw @100xDevs @100xSchool @rohanBuilds @AnkurJangid02 Amazing bhai, let's connect.