Loading video...

Video Failed to Load

Go Home

gradient descent..it's not just an algorithm..it's a lifestyle

687,790 views • 3 months ago •via X (Twitter)

62 Comments

Nikita Bier's profile picture
Nikita Bier3 months ago

Thank you for the good, original content

ashe's profile picture
ashe3 months ago

wow Nikita, thank you so much 🤍

Imran Khan's profile picture
Imran Khan3 months ago

@nikitabier Good job so far 👏

ashe's profile picture
ashe3 months ago

@nikitabier thanks Imran!

Patricia's profile picture
Patricia3 months ago

this way of seeing life - and the way you explain it - is so, so resonant for me. much more fresh and interesting than the usual fortune cookie style life advice one sees on social media.

ashe's profile picture
ashe3 months ago

ty Patricia that's great to hear

Mathelirium's profile picture
Mathelirium3 months ago

We need more content like this. Thank you!

ashe's profile picture
ashe3 months ago

thank you!

albina's profile picture
albina3 months ago

I love this both as a CS person and as an introspective person

ashe's profile picture
ashe3 months ago

:)

J's profile picture
J3 months ago

Can you do a video on the expectation - maximization algorithm now? This got my juices flowing 🔥🔥🔥

ashe's profile picture
ashe3 months ago

👀

Ray Fernando's profile picture
Ray Fernando3 months ago

Crushing it!! Love the drawings.

ashe's profile picture
ashe3 months ago

thanks Ray!

Tom Rush's profile picture
Tom Rush3 months ago

Great explainer, more please @ashebytes this was valuable, thank you 🙏🤯😎

ashe's profile picture
ashe3 months ago

thanks Tom!! I appreciate the encouragement.. I am not sure how many reels to do on X

Tom Rush's profile picture
Tom Rush3 months ago

I think more is best. You're great. Do more. Gradient descent it!!!!

ashe's profile picture
ashe3 months ago

:)

CMarie's profile picture
CMarie3 months ago

it’s the old analogy- you may strike the rock a hundred times without seeing progress, but the hundred and first hit succeeds because of the first hundred 🤍 it’s the compounding of persistence that pays off

Nick Schmidt's profile picture
Nick Schmidt3 months ago

optimize for feedback before depth/direction is what im picking up

ashe's profile picture
ashe3 months ago

maximize for learnings to update your "weights"! can even be your own reaction to what feels good to put out vs external reception importantly, in the beginning of your optimization process as you start out on approaching the goal state.. take big bold steps in many directions. narrow and refine after you've gleaned the learnings

Gonzalo Marsilli's profile picture
Gonzalo Marsilli3 months ago

I am impressed how many good content creators use headphones for convenience, somebody should invent a plugin clip to make it prettier and easier to hold it

ashe's profile picture
ashe3 months ago

the audio for quick app upload is actually more normalized than dji

Naman Katyal's profile picture
Naman Katyal3 months ago

I guess it’s a perspective to perceive gradient descent as looking in all directions. Gradient descent find the steepest slope and goes in that direction and more often that is the closest minimum to the starting point. Contrary to life, you can start gradient descent at random points and get to different minimums but it’s difficult to start life at a random point simultaneously.

ashe's profile picture
ashe3 months ago

this is why I say "optimization process" or "goal you're looking to achieve"

Dr. Disclosure's profile picture
Dr. Disclosure3 months ago

This was actually really useful 🙏

ashe's profile picture
ashe3 months ago

:)

Alex Caswen's profile picture
Alex Caswen3 months ago

Followed immediately

himanshu's profile picture
himanshu3 months ago

this is so cool!

ashe's profile picture
ashe3 months ago

ty himanshu!

Fito Prolog's profile picture
Fito Prolog3 months ago

I would prefer to take the path of the stochastic gradient descent sometimes you need to try radically new things or you can be in the risk of getting stuck in a local.

Priyaa's profile picture
Priyaa3 months ago

what is your tech stack for editing videos? love them!

Mr.Elbaz's profile picture
Mr.Elbaz3 months ago

LOVE IT

Lily, Duchess of X🎗️'s profile picture
Lily, Duchess of X🎗️3 months ago

REAL ! Love this !

Sara Knurowska's profile picture
Sara Knurowska3 months ago

@SynbioUnsiloed Saw this and thought of you.

Manav's profile picture
Manav3 months ago

this is nice content on my timeline.

Nick DeJesus 🛒🎉 - Former Unpaid CTO @BTPipeline's profile picture
Nick DeJesus 🛒🎉 - Former Unpaid CTO @BTPipeline3 months ago

I've always said "doing it for the lols" but doing it for the plot sounds so much cooler lol

ashe's profile picture
ashe3 months ago

if you listen closely you can hear women everywhere in manhattan whispering to each other "do it for the plot"

Nick DeJesus 🛒🎉 - Former Unpaid CTO @BTPipeline's profile picture
Nick DeJesus 🛒🎉 - Former Unpaid CTO @BTPipeline3 months ago

New York is probably the greatest place on earth to be plot maxxing

daciojss's profile picture
daciojss3 months ago

Love the content, there is a lot of elons in this, how he takes larges steps. I tend to do this since was I child, or at least think about it, but encouteres tremendous resistence and 99% failure. Really ejoyed and hopefully this video hits to all ppl here! 🙏🙏

ashe's profile picture
ashe3 months ago

thank you!

Thermodrift's profile picture
Thermodrift3 months ago

and searching for the right mental equilibrium for stressless creativity

Saul Flores Jr.'s profile picture
Saul Flores Jr.3 months ago

I have no idea what gradient descent is lol. Never heard of that term before.

ashe's profile picture
ashe3 months ago

now ya know!

Saul Flores Jr.'s profile picture
Saul Flores Jr.3 months ago

I have been enlightened lol.

Julian𝕏 - e/acc & eu/acc's profile picture
Julian𝕏 - e/acc & eu/acc3 months ago

Very refreshing. So inspiring. Thank you from Germany👋❤️

ashe's profile picture
ashe3 months ago

ty Julian!

Julian𝕏 - e/acc & eu/acc's profile picture
Julian𝕏 - e/acc & eu/acc3 months ago

❤️

Brinel Smith's profile picture
Brinel Smith3 months ago

Nice gradient decesent and what about leakyRelu or Relu?? Could you make video on this topics.

ashe's profile picture
ashe3 months ago

interesting

Pitchfork & Torch ♞'s profile picture
Pitchfork & Torch ♞3 months ago

Might have to write a song about this, how’s that for relational

glis's profile picture
glis3 months ago

this is amazing, ashe! i love it

ashe's profile picture
ashe3 months ago

thank you! :)

Prescott Paulin's profile picture
Prescott Paulin3 months ago

New favorite follow on X. Great content!

ashe's profile picture
ashe3 months ago

wow ty Prescott! much appreciated

Ken Warner's profile picture
Ken Warner3 months ago

love it

cyepler's profile picture
cyepler3 months ago

This fits with what we have learned about psychology and success. Keep trying new things. Learn from the things that don’t work but don’t get discouraged by the things that didn’t work. Those are lessons, not failures. Failure only happens when you give up.

Strange Attractor's profile picture
Strange Attractor3 months ago

when a wave peaks, it descends, and on its descent, it catches a reflection of itself just long enough to be genuinely surprised its you.

Rob's profile picture
Rob3 months ago

Great advice! thank you for sharing!

ashe's profile picture
ashe3 months ago

ty for watching!

stefanix's profile picture
stefanix3 months ago

Nice simple straightforward advice. I like it.

AdamKadmon91's profile picture
AdamKadmon913 months ago

In the beginning you take small steps to avoid instabilities caused by mismatch between initial conditions and the distribution.

Related Videos