Skip navigation
I wrote GPU kernels for GPT2 124M inference engine from scratch in ~1500 lines of CUDA.
0:00 / 3:45

I wrote GPU kernels for GPT2 124M inference engine from scratch in ~1500 lines of CUDA.

ninjaHattori1

@Sahil100X2.7K followers

Visit on X
930 likesDownloadOriginal post

160,092 views

I wrote GPU kernels for GPT2 124M inference engine from scratch in ~1500 lines of CUDA. Here I explain it simply.

41 Comments

Comments from the original post on X (Twitter)

  • Cosmos's profile picture

    @luvp_21

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Dude... Again a great bomber Btw which tool do you use to edit / create vdos

    3 likes

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Thanks brother, there are paid ai video editors

    2 likes

  • Hassan's profile picture

    @hassan_dev31

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode any resource you're using to learn esp gpu programming?

    2 likes

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Claude OP

    5 likes

  • Hassan's profile picture

    @hassan_dev31

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode thnx mate

    1 like

  • Deepanshu Saini's profile picture

    @deepanshuliv

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Again a bomber is dropped

    2 likes

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Thankyou Brother ❤️

    1 like

  • Adarsh V. More's profile picture

    @Adarsh_VMore

    @kirat_tw @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Damnn bro this stuff sounds soo cool and learning a lot for youu Looking forward for more such content

    2 likes

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Will keep posting the whole inference stack as I keep learning, will try to get cracked in this asap

    1 like

  • Satoru Gojo's profile picture

    @jitendar100x

    @kirat_tw @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode never stoping engine

    2 likes

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @Adarsh_VMore @ashutosh_sao @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Inference all the way

    1 like

  • Ayush's profile picture

    @ayushp81

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Love cuda , worked in isro and built image processing pipe line for synthetic aperture radar

    2 likes

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Woah, you are cracked dude

    1 like

  • Ayush's profile picture

    @ayushp81

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Appreciate it man. 1500 lines of hand written CUDA is no joke, most people never go below the library layer. Drop the repo if it's open, want to see your attention kernel

    2 likes

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Yes, video end has the repo link

    1 like

  • Himanshu's profile picture

    @himanxu0

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Bhai this is not tough i mean it when i say , if you how this works then you can literally do it

    1 like

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Who said It's tough

  • Himanshu's profile picture

    @himanxu0

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @rohanBuilds @boskykode Read the comments

  • Rohan Singla (solana summit & devcon)'s profile picture

    @rohanBuilds

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @boskykode bhai aap @nvidia mai apply kro

    1 like

  • ninjaHattori1's profile picture

    @Sahil100X

    @kirat_tw @Adarsh_VMore @ashutosh_sao @jitendar100x @deepanshuliv @Deepjyoti100x @100xSchool @ashu_463 @boskykode @nvidia 😂😂 bhai thoda halka chlte hai, time hai abhi

    1 like