Yuchen Jin
@Yuchenj_UW • 146,392 subscribers
Cooking fun AI systems & products @databricks. Prev: co-founder & CTO @ Hyperbolic, OctoAI (acquired by @nvidia) Apache TVM, PhD @ University of Washington.
Shorts
Videos
Sam Altman says Meta is offering $100M signing bonuses to OpenAI staff. Not $100M annual compensation, just the signing bonus! He clowned Meta: “that’s not how you build a great culture.” Also said none of OpenAI’s best people are leaving. This AI talent war is crazy.
Yuchen Jin6,196,285 Aufrufe • vor 11 Monaten
Sundar Pichai: “Sergey is spending more time in the office. He's literally coding, and some of my fondest memories over the last year is sitting with Sergey on large screen looking at loss curves as we train these models.” When Sergey is back to coding and watching training loss curves, you know he is in founder mode. That’s how Sergey Brin saved Google.
Yuchen Jin2,346,714 Aufrufe • vor 5 Monaten
Jensen Huang: “We (Nvidia) are 100% out of China. We went from 95% market share to 0%. I can’t imagine any policymaker thinking that’s a good idea.” Chinese AI labs like DeepSeek now have to use Chinese chips for both inference and training. Chinese chips will inevitably rise if this Nvidia chip ban continues.
Yuchen Jin2,361,732 Aufrufe • vor 7 Monaten
Sergey used Gemini in a surprisingly creative way. He asked it inside an internal Google chat, “who should be promoted in this chat space?” AI picked up a young woman engineer who is not vocal, and she was promoted. AI can reveal value that human systems overlook. AI can help CEOs of Big Corps spot true talent rather than people who are just loud or political, and it's probably more objective than the middle managers. How far are we from an AI CEO? Sergey Brin in founder mode using AI to cut through bureaucracy is just fascinating.
Yuchen Jin1,782,694 Aufrufe • vor 6 Monaten
Funny how OpenAI might have saved Google. At a party, an OpenAI guy named Dan challenged Sergey: “What are you doing? This is the greatest transformative moment in computer science,” and Sergey went right back into founder mode. Googlers probably love Dan. Sam probably not lol.
Yuchen Jin1,633,103 Aufrufe • vor 6 Monaten
Ilya Sutskever, in his speech at UToronto 2 days ago: "The day will come when AI will do all the things we can do." "The reason is the brain is a biological computer, so why can't the digital computer do the same things?" It's funny that we are debating if AI can "truly think" or give "the illusion of thinking", as if our biological brain is superior or fundamentally different from a digital brain.
Yuchen Jin3,093,835 Aufrufe • vor 1 Jahr
Sam Altman was asked how he felt about Zuck and Meta poaching OpenAI’s top talent. “Fine... good...” he said. Behind Jony Ive–designed glasses, I couldn’t see his eyes. But I could feel the pain. It's not hard for Zuck to poach OpenAI talent, not just because he has the money, but because open-source AI is fulfilling the original OpenAI mission.
Yuchen Jin2,516,854 Aufrufe • vor 11 Monaten
Sergey Brin in founder mode actually saved Google. He had a big tiff inside Google, because Gemini wasn’t allowed to be used for coding. He told Sundar, “I can’t deal with these people. You have to deal with this.” Big companies always build bureaucracy. Sergey (and Larry) still have super voting power, and he used it to cut through the BS. Suddenly Google is moving like a startup again. Their AI went from “way behind” to “easily #1” across domains in a year.
Yuchen Jin1,257,352 Aufrufe • vor 6 Monaten
Linus's views on AI: - “AI is clearly a bubble, but it will change how most skilled jobs get done.” - “Vibe coding is great for getting into programming, but it's a horrible thing to maintain.” - “I'm a huge believer in AI. I'm not a huge believer in the things around AI. I find the market and marketing to be sick. There is going to be a crash.”
Yuchen Jin1,129,419 Aufrufe • vor 5 Monaten
Sergey has a new habit. He talks to Gemini Live while driving, discussing things like data center power and cost. It’s classic Google dogfooding — obsessively testing your own product. It reminds me of Bill Gates removing his car radio so he could think about Microsoft nonstop. Every founder should have this level of obsession. Sergey also says the Gemini model he’s using in the car is way better than what’s available now. My guess is that Gemini 3 Flash is coming soon!
Yuchen Jin652,435 Aufrufe • vor 5 Monaten
OpenAI’s Mark Chen: - “Meta went after half of my direct reports and they all declined.” - “Meta has $10 billion of capital per year to deploy towards talent.” - “Zuck hand-cooked and hand-delivered soup to people he was trying to hire from OpenAI.” Insane AI talent war.
Yuchen Jin583,658 Aufrufe • vor 6 Monaten
Sergey on why he returned to Google: He retired in 2020 with a simple plan: sit in cafes and study physics. Then COVID hit, the cafes closed, and he felt his mind “spiraling”. So he returned to build Gemini, back in founder mode. For top minds, happiness is not leisure; it is being intellectually challenged. My view of the meaning of life is simply finding your passion and relentlessly working on it. If you are working in AI, feel lucky. This is the most exciting time in human history.
Yuchen Jin529,546 Aufrufe • vor 5 Monaten
Sergey Brin on the genius of Jeff Dean. He credits Jeff’s early obsession with neural networks, back when they were “telling cats from dogs”, as the spark for everything. TPU was Jeff’s idea. He calculated that if users spoke to Google for just three minutes a day, Google would have to double its CPU data centers. Instead of buying more CPUs, Jeff decided to build a new chip for AI. What’s fascinating is that when AI was not as big as today, when it can only “tell cats from dogs,” Larry and Sergey were like, “Cool, let’s make a custom chip for it.” That’s a huge show of confidence in deep tech and top-tier technical talent. It makes Google the only AI company that has the top models, top chips, and top data centers.
Yuchen Jin473,372 Aufrufe • vor 5 Monaten
Demis confirmed DeepMind hasn’t cracked continual learning. There were rumors on X that Google DeepMind had solved it. Not true. They’re experimenting with blending AlphaZero with large foundation models to see if it can scale and generalize to the real world, not just games.
Yuchen Jin75,633 Aufrufe • vor 4 Monaten
Sergey Brin on Scaling Laws vs. algorithms: “Compute is the dessert. Algorithms are the main course. Algorithmic progress has outpaced compute and data scaling over the last decade.” This echoes Ilya’s view: scaling what we have will keep leading to improvements, but some key algorithmic breakthrough is still missing for AGI/ASI.
Yuchen Jin90,818 Aufrufe • vor 5 Monaten
GPU tradeoff series: A100 is not much more powerful than 4090 🫠 GPU Perf and Price: - 4090: 330 fp16 TFLOPs, $1,749 - A100 (80GB): 312 fp16 TFLOPs, $20,000 > A100 is 11.4X more pricy Training speed for GPT-2(124M) with llm.c: - 4090: 153K tokens/s - A100 (80GB): 195K tokens/s > A100 is only 1.3X faster (both trained using a single card, A100 llm.c training is shown in the video, 4090 video is in the quoted tweet) Conclusion: 4090 has a much better cost vs performance ratio Why: As in the H100 vs. 4090 comparison, the biggest difference between A100 and 4090 is their GPU memory size/bandwidth and cross-GPU communication bandwidth, which does not matter too much if your model can fit into a single 4090. Specs: 4090: - GPU memory size: 24GB - memory bandwidth: 1 TB/s - communication bandwidth: 64 GB/s A100: - GPU memory size: 80GB - memory bandwidth: 2 TB/s - communication bandwidth: 900 GB/s Nvidia killed off NVLink (a high-speed communication link that connects GPUs) on 4090. (Jensen Huang smiling face) If multiple 4090s could be interconnected via NVLink, their performance would be closer to datacenter-grade A100 GPUs, even for training larger models. Additionally, 4090 isn't allowed in datacenters, that's how Nvidia makes 💰💰💰
Yuchen Jin234,951 Aufrufe • vor 1 Jahr