Loading video...

Video Failed to Load

Go Home

Sundar Pichai: “Sergey is spending more time in the office. He's literally coding, and some of my fondest memories over the last year is sitting with Sergey on large screen looking at loss curves as we train these models.” When Sergey is back to coding and watching training loss...

2,347,849 views • 9 months ago •via X (Twitter)

39 Comments

Sumit's profile picture
Sumit9 months ago

The TPU timeline is key. Built hardware before the model breakthroughs even happened. That's the kind of conviction that pays off. Now he's back in code while everyone else is still debating compute economics.

Yuchen Jin's profile picture
Yuchen Jin9 months ago

TPU was Jeff Dean’s idea. Back in 2013, he found that if users spoke to Google’s voice recognition model for just 3 minutes/day, Google needs 2x the data centers. The choice: A) Go bankrupt buying CPUs. B) Invent a new type of processor. Jeff Dean chose B.

EL's profile picture
EL9 months ago

this is what it means to be passionate about something

Yuchen Jin's profile picture
Yuchen Jin9 months ago

@lalitmadan The OpenAI guy Dan sparked his passion. Sergey is always passionate about computer science and winning the game.

EL's profile picture
EL9 months ago

yeah I saw this. Funny how google has done so much after this. Btw did you try Antigravity? I tried it the first day it launched and I kept rate limits and I tried it again yesterday. I loved it. The experience was much better. Google products are really coming through

Capx AI's profile picture
Capx AI9 months ago

Founder mode >>>

R's profile picture
R9 months ago

Companies where the suits can also code are something else

BrianMcGrath's profile picture
BrianMcGrath9 months ago

The fact that Google's co-founder is personally coding on AI models tells you everything about where the real leverage is right now. What other companies have founder-level attention on AI like this?

ar0cket1's profile picture
ar0cket19 months ago

i must know, why are they so vigilantly watching train curves.

Yuchen Jin's profile picture
Yuchen Jin9 months ago

Watching training loss curve is the most addictive thing in training.

ar0cket1's profile picture
ar0cket19 months ago

true, but sundar makes it sound like watching the curves is improving training. Sundar and Sergey: oh look it went down, AGI AGI oh no it went up, what happening (loop)

Jack Soh's profile picture
Jack Soh9 months ago

The current CEO seems quite redundant then

Algomizer | LLM Optimization's profile picture
Algomizer | LLM Optimization9 months ago

this sounds super simple but likely works primarily because "founder mode" collapses decision latency to near zero so when Sergey sits in front of loss curves, the feedback loop between observation and strategic pivot has no translation overhead. no reports → summaries → presentations → meetings → decisions

Bagade's profile picture
Bagade9 months ago

The only way for Google to make a comeback was to, get in the Founder mode. And they did it. But there is a harmless lie to it. - The Tensor Processing Units (TPUs) were already built. - DeepMind was acquired in 2014. - The Attention Is All You Need paper was published by Google Brain in 2017. Sergey's return was the signal to turn the direction from research to product. The latent capability was always there. They just needed the political will to risk their own search moat.

Sadok's profile picture
Sadok9 months ago

Founders diving back into code always signal the next big leap.

gary IH fung's profile picture
gary IH fung9 months ago

So what is Midchai doing then. Calmly supervising in manager mode?

Allen Chambers's profile picture
Allen Chambers9 months ago

Gemini’s human physiology knowledge is often fiction. Spews out remarkable rubbish that could be dangerous to someone that neglects to verify.

Atulya Rai's profile picture
Atulya Rai9 months ago

This makes sense this was the reason why this year google felt so different with its model releases

Astronomad's profile picture
Astronomad9 months ago

This is what Gemini had to say

Dave Mellish's profile picture
Dave Mellish9 months ago

I’m just not entirely convinced Sundar loves having the company’s largest shareholder on prem, weighing in on decisions day-to-day. Open to being wrong, but guessing I’m right.

Chidhambararajan R (a.k.a Chidha)'s profile picture
Chidhambararajan R (a.k.a Chidha)9 months ago

Bro is literally the thanos of Google corporate .

TeaChaiLa टीचायला ಟೀಚಾಯ್‌ಲಾ ٹیچائےلا ટીચાઇલા's profile picture
TeaChaiLa टीचायला ಟೀಚಾಯ್‌ಲಾ ٹیچائےلا ટીચાઇલા9 months ago

So a Russian born IT entrepreneur is a founding member of Google, nobody bats an eye. But Indian CEO who is just an employee gets the hate. Americans are truly inexplicable. Maybe it is indeed about the skin colour.

Richy D's profile picture
Richy D9 months ago

sergey is a tag-along, larry runs the company from his yacht off NZ

MeusterMint's profile picture
MeusterMint9 months ago

Based af

Alican's profile picture
Alican9 months ago

hard not to respect leaders who still want to be in the weeds when it matters

freeadventures's profile picture
freeadventures9 months ago

He let H-1B grifters damage the company and turned it into an importation scam.

Youssef El Manssouri's profile picture
Youssef El Manssouri9 months ago

The best leaders stay close to the craft. Titles mean less than knowing what's actually happening in the build.

Vintage Vinay's profile picture
Vintage Vinay9 months ago

it's like a Steve job's return moment for google for AI.

deepa 🏴‍☠️'s profile picture
deepa 🏴‍☠️9 months ago

founders never quit

Himanshu Kumar's profile picture
Himanshu Kumar9 months ago

Observe loss curves; avoid unsupervised model training changes.

Rotimi Best's profile picture
Rotimi Best9 months ago

Where is Larry?? I miss him so much

Sapan Shah's profile picture
Sapan Shah9 months ago

Where has Larry been!?!?

BS's profile picture
BS9 months ago

What a loser mentality. Bro is saying that he didn't do a good job and Sergey had to jump in

Phily8020's profile picture
Phily80209 months ago

If Sundar was a good ceo, this would not be necessary. He's not visionary enough

Amit Sharma's profile picture
Amit Sharma9 months ago

One has to say- google for most part has had mature, gracious messaging at the top. With big guns like Jeff dean, Demis, Sergey, Sundar himself as CEO - another company might have seen a lot more politicking and spats. Everyone at the top in Google has been mature and gracious. No one tries to run with the credit or play one upsmanship. The signal that comes through is- we are all mission focused and not here to play credit games. Kudos all of you. Need more of this.

MD Fazal Mustafa's profile picture
MD Fazal Mustafa9 months ago

Respect to Sergey coding again. When founders return to the basics, it sends a signal. Less talk, more work. That energy can wake up teams if leadership lets it spread.

𝙰𝚛𝚢 𝙷𝙷's profile picture
𝙰𝚛𝚢 𝙷𝙷9 months ago

Sergey Brin's return to "founder mode" at Google AI was a good move. Sundar Pichai quoted Brin as saying he coded frequently and together they observed the loss curve of AI models. According to Jin, this "saved" Google, thanks to early vision like TPU (2013), the DeepMind acquisition, and the OpenAI competition. The response emphasized the founder's passion as key to Google's long-term innovation in AI.

Dhan's profile picture
Dhan9 months ago

Damn

Ali Sherief's profile picture
Ali Sherief9 months ago

It’s fascinating how leadership + deep technical involvement can accelerate a company that was previously ‘behind’ into a clear frontrunner

Related Videos