Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

General-purpose AI models source answers from the web, a weak fit for chip design, where accuracy has to be 100%. Synopsys’s Thomas Andersen tells Brendan Burke and Matthew Kimball how pre- and post-training with expert knowledge closes the gap. $SNPS

Six Five Media

4,550 subscribers

23,136 görüntüleme • 8 gün önce •via X (Twitter)

Bilim & Teknoloji

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Our AI for chip design method AlphaChip has transformed the way we design microchips. ⚡ From helping to design state-of-the-art TPUs for building AI models to CPUs in data centers - its widespread impact can be seen across Alphabet and beyond. Find out more →

Our AI for chip design method AlphaChip has transformed the way we design microchips. ⚡ From helping to design state-of-the-art TPUs for building AI models to CPUs in data centers - its widespread impact can be seen across Alphabet and beyond. Find out more →

Google DeepMind

771,722 görüntüleme • 2 yıl önce

Chips are the foundation of every AI experience. That's why understanding the hardware behind the software has never mattered more. When you ask a chatbot a question or generate an image, there's a physical chip somewhere doing the heavy lifting. For most of computing history, that was a CPU—the "brain" of a computer—great for general tasks needed to run software and operating systems. AI is more complex: for workloads called training and inference, AI needs to perform trillions of calculations in parallel. That's where AI accelerators come in. Purpose-built accelerators can deliver significantly better performance and efficiency than general-purpose chips. Amazon Web Services Trainium chips are an example—purpose-built for AI training and inference. New chips for a new era. ⬇️

Chips are the foundation of every AI experience. That's why understanding the hardware behind the software has never mattered more. When you ask a chatbot a question or generate an image, there's a physical chip somewhere doing the heavy lifting. For most of computing history, that was a CPU—the "brain" of a computer—great for general tasks needed to run software and operating systems. AI is more complex: for workloads called training and inference, AI needs to perform trillions of calculations in parallel. That's where AI accelerators come in. Purpose-built accelerators can deliver significantly better performance and efficiency than general-purpose chips. Amazon Web Services Trainium chips are an example—purpose-built for AI training and inference. New chips for a new era. ⬇️

Amazon

27,151 görüntüleme • 5 ay önce

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike

Harry Stebbings

63,738 görüntüleme • 4 ay önce

For many people, money sits idle. The knowledge gap isn't a personal failure — it's a design problem. Automated finance closes the gap. The full stack for markets and machines provides the rails. Inception Capital's Founder & GP, 𝗗𝗮𝘃𝗶𝗱 𝗚𝗮𝗻 with Aptos Foundation's Alix.

For many people, money sits idle. The knowledge gap isn't a personal failure — it's a design problem. Automated finance closes the gap. The full stack for markets and machines provides the rails. Inception Capital's Founder & GP, 𝗗𝗮𝘃𝗶𝗱 𝗚𝗮𝗻 with Aptos Foundation's Alix.

Aptos

21,059 görüntüleme • 4 ay önce

New Course: Post-training of LLMs Learn to post-train and customize an LLM in this short course, taught by Banghua Zhu, Assistant Professor at the University of Washington University of Washington, and co-founder of @NexusflowX. Training an LLM to follow instructions or answer questions has two key stages: pre-training and post-training. In pre-training, it learns to predict the next word or token from large amounts of unlabeled text. In post-training, it learns useful behaviors such as following instructions, tool use, and reasoning. Post-training transforms a general-purpose token predictor—trained on trillions of unlabeled text tokens—into an assistant that follows instructions and performs specific tasks. Because it is much cheaper than pre-training, it is practical for many more teams to incorporate post-training methods into their workflows than pre-training. In this course, you’ll learn three common post-training methods—Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL)—and how to use each one effectively. With SFT, you train the model on pairs of input and ideal output responses. With DPO, you provide both a preferred (chosen) and a less preferred (rejected) response and train the model to favor the preferred output. With RL, the model generates an output, receives a reward score based on human or automated feedback, and updates the model to improve performance. You’ll learn the basic concepts, common use cases, and principles for curating high-quality data for effective training. Through hands-on labs, you’ll download a pre-trained model from Hugging Face and post-train it using SFT, DPO, and RL to see how each technique shapes model behavior. In detail, you’ll: - Understand what post-training is, when to use it, and how it differs from pre-training. - Build an SFT pipeline to turn a base model into an instruct model. - Explore how DPO reshapes behavior by minimizing contrastive loss—penalizing poor responses and reinforcing preferred ones. - Implement a DPO pipeline to change the identity of a chat assistant. - Learn online RL methods such as Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO), and how to design reward functions. - Train a model with GRPO to improve its math capabilities using a verifiable reward. Post-training is one of the most rapidly developing areas of LLM training. Whether you’re building a high-accuracy context-specific assistant, fine-tuning a model's tone, or improving task-specific accuracy, this course will give you experience with the most important techniques shaping how LLMs are post-trained today. Please sign up here:

New Course: Post-training of LLMs Learn to post-train and customize an LLM in this short course, taught by Banghua Zhu, Assistant Professor at the University of Washington University of Washington, and co-founder of @NexusflowX. Training an LLM to follow instructions or answer questions has two key stages: pre-training and post-training. In pre-training, it learns to predict the next word or token from large amounts of unlabeled text. In post-training, it learns useful behaviors such as following instructions, tool use, and reasoning. Post-training transforms a general-purpose token predictor—trained on trillions of unlabeled text tokens—into an assistant that follows instructions and performs specific tasks. Because it is much cheaper than pre-training, it is practical for many more teams to incorporate post-training methods into their workflows than pre-training. In this course, you’ll learn three common post-training methods—Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL)—and how to use each one effectively. With SFT, you train the model on pairs of input and ideal output responses. With DPO, you provide both a preferred (chosen) and a less preferred (rejected) response and train the model to favor the preferred output. With RL, the model generates an output, receives a reward score based on human or automated feedback, and updates the model to improve performance. You’ll learn the basic concepts, common use cases, and principles for curating high-quality data for effective training. Through hands-on labs, you’ll download a pre-trained model from Hugging Face and post-train it using SFT, DPO, and RL to see how each technique shapes model behavior. In detail, you’ll: - Understand what post-training is, when to use it, and how it differs from pre-training. - Build an SFT pipeline to turn a base model into an instruct model. - Explore how DPO reshapes behavior by minimizing contrastive loss—penalizing poor responses and reinforcing preferred ones. - Implement a DPO pipeline to change the identity of a chat assistant. - Learn online RL methods such as Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO), and how to design reward functions. - Train a model with GRPO to improve its math capabilities using a verifiable reward. Post-training is one of the most rapidly developing areas of LLM training. Whether you’re building a high-accuracy context-specific assistant, fine-tuning a model's tone, or improving task-specific accuracy, this course will give you experience with the most important techniques shaping how LLMs are post-trained today. Please sign up here:

Andrew Ng

126,309 görüntüleme • 1 yıl önce

Get unlimited access to premium trading signals and expert education—boost your accuracy and knowledge, 100% FREE with 8 Figures Club!

Get unlimited access to premium trading signals and expert education—boost your accuracy and knowledge, 100% FREE with 8 Figures Club!

TMM trader

625,453 görüntüleme • 1 yıl önce

Simon Holmstrom drives to the net and tucks the overtime winner for New York Islanders! Brendan Burke | Thomas Hickey | Butch Goring

Simon Holmstrom drives to the net and tucks the overtime winner for New York Islanders! Brendan Burke | Thomas Hickey | Butch Goring

Isles on MSGSN

16,615 görüntüleme • 8 ay önce

Scale CEO Alexandr Wang says AI has "genuinely hit a wall" in terms of pre-training, but there is still progress in AI with evals climbing and models getting smarter due to post-training and test-time compute

Scale CEO Alexandr Wang says AI has "genuinely hit a wall" in terms of pre-training, but there is still progress in AI with evals climbing and models getting smarter due to post-training and test-time compute

Tsarathustra

193,824 görüntüleme • 1 yıl önce

Why General AI Fails Tax Professionals — and What Makes TaxGPT State-of-the-Art Tax LLM Every tax professional using general-purpose AI tools like ChatGPT or Claude for research is one hallucinated source away from costly damage to their clients and professional career. So we ran a head-to-head benchmark: TaxGPT vs. OpenAI, Anthropic, and Gemini. Our methodology: 1️⃣ Quantitative testing on CPA + EA tax-specific exam questions 2️⃣ Qualitative testing complex, real-world scenarios across trust & estate, direct and indirect taxes, payroll, multi-state nexus, advisory, and compliance Results (Accuracy): TaxGPT: 96% Gemini 2.5 Pro: 89% Claude Sonnet 4: 87% GPT-4o: 80% GPT5: 92% But here’s the real story 👇 The Source Quality Gap General LLMs are great test takers. But tax research isn’t a trivia game — it’s a liability-driven profession where every position must be defensible. When we examined the sources behind their answers, the gap became a canyon: 🔍 OpenAI included citations only 9% of the time. 🔍 91% of answers had no verifiable source trail. 🔍 When citations did appear, they averaged 3.78 sources — many from Wikipedia, CNBC, AP News, Time, NerdWallet, etc. TaxGPT averages 14 authoritative sources per answer, all from primary/secondary tax law — IRC, Treasury Regs, court cases, IRS rulings, and our proprietary tax knowledge library. More details in our official blog post in the following post.

Why General AI Fails Tax Professionals — and What Makes TaxGPT State-of-the-Art Tax LLM Every tax professional using general-purpose AI tools like ChatGPT or Claude for research is one hallucinated source away from costly damage to their clients and professional career. So we ran a head-to-head benchmark: TaxGPT vs. OpenAI, Anthropic, and Gemini. Our methodology: 1️⃣ Quantitative testing on CPA + EA tax-specific exam questions 2️⃣ Qualitative testing complex, real-world scenarios across trust & estate, direct and indirect taxes, payroll, multi-state nexus, advisory, and compliance Results (Accuracy): TaxGPT: 96% Gemini 2.5 Pro: 89% Claude Sonnet 4: 87% GPT-4o: 80% GPT5: 92% But here’s the real story 👇 The Source Quality Gap General LLMs are great test takers. But tax research isn’t a trivia game — it’s a liability-driven profession where every position must be defensible. When we examined the sources behind their answers, the gap became a canyon: 🔍 OpenAI included citations only 9% of the time. 🔍 91% of answers had no verifiable source trail. 🔍 When citations did appear, they averaged 3.78 sources — many from Wikipedia, CNBC, AP News, Time, NerdWallet, etc. TaxGPT averages 14 authoritative sources per answer, all from primary/secondary tax law — IRC, Treasury Regs, court cases, IRS rulings, and our proprietary tax knowledge library. More details in our official blog post in the following post.

Kash from TaxGPT.com

59,282 görüntüleme • 11 ay önce

Rixon Wingrove ANSWERS. 🇦🇺 A 2-run shot closes the gap for Australia! 📺: FS2 and the FOX Sports App

Rixon Wingrove ANSWERS. 🇦🇺 A 2-run shot closes the gap for Australia! 📺: FS2 and the FOX Sports App

FOX Sports: MLB

203,240 görüntüleme • 3 yıl önce

Meet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications.

Meet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications.

Databricks

327,800 görüntüleme • 2 yıl önce

Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI. We believe in a healthy, open frontier model ecosystem. To enable this, we are working on: - Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly. - The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on. - Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence. - Making models cheaper and more performant through our model performance research. This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open. We’re hiring engineers, researchers, and research fellows to advance this mission.

Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI. We believe in a healthy, open frontier model ecosystem. To enable this, we are working on: - Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly. - The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on. - Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence. - Making models cheaper and more performant through our model performance research. This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open. We’re hiring engineers, researchers, and research fellows to advance this mission.

Base Labs

248,511 görüntüleme • 1 ay önce

China unveils a new brain for humanoids. The Beijing Academy of Artificial Intelligence (BAAI) has announced RoboBrain 2.0, an open-source general-purpose AI model designed to power humanoids and other general-purpose robots. BAAI is already collaborating with 20 Chinese robotics companies to ramp up embodied intelligence.

China unveils a new brain for humanoids. The Beijing Academy of Artificial Intelligence (BAAI) has announced RoboBrain 2.0, an open-source general-purpose AI model designed to power humanoids and other general-purpose robots. BAAI is already collaborating with 20 Chinese robotics companies to ramp up embodied intelligence.

The Humanoid Hub

43,139 görüntüleme • 1 yıl önce

Everyday questions can be answered by any AI model. The complex, token-heavy work is where the competition lives. Tasha Keeney discusses with Brett Winton how much knowledge work is actually up for grabs to cheaper Chinese or open-source models on "The Brainstorm."

Everyday questions can be answered by any AI model. The complex, token-heavy work is where the competition lives. Tasha Keeney discusses with Brett Winton how much knowledge work is actually up for grabs to cheaper Chinese or open-source models on "The Brainstorm."

ARK Invest

23,642 görüntüleme • 2 ay önce

New open source project: Easel, a macOS workspace for AI-assisted product design and frontend iteration powered by the Codex SDK. Think of it as "Claude Design for Codex." It brings together a local project library, design-system setup, Codex chat, and a live web preview with a point-and-click inspector. Set up your design system however you like. Import one from Figma , bring your own, or have the agent generate it as a design.md. Then use it to build prototypes and slide decks. Codex-first, with Claude and other AI providers and local models planned for future releases. OpenAI Developers

New open source project: Easel, a macOS workspace for AI-assisted product design and frontend iteration powered by the Codex SDK. Think of it as "Claude Design for Codex." It brings together a local project library, design-system setup, Codex chat, and a live web preview with a point-and-click inspector. Set up your design system however you like. Import one from Figma , bring your own, or have the agent generate it as a design.md. Then use it to build prototypes and slide decks. Codex-first, with Claude and other AI providers and local models planned for future releases. OpenAI Developers

James Rochabrun

61,608 görüntüleme • 4 ay önce

GLM 5.3’s biggest leap came from post-training alone. “GLM 5.3 was built entirely by post-training the previous model. For me, that was a wake-up call.” “Post-training is far more GPU-efficient than pre-training from scratch. Plenty of companies can’t afford to train a model from scratch, but they have proprietary data. They can post-train themselves and beat some of the closed models.” “There’s still so much juice left to squeeze from post-training. We compared GLM 5.3’s cyber capabilities with 5.2, and it’s a night and day difference. That’s all just post-training.”

GLM 5.3’s biggest leap came from post-training alone. “GLM 5.3 was built entirely by post-training the previous model. For me, that was a wake-up call.” “Post-training is far more GPU-efficient than pre-training from scratch. Plenty of companies can’t afford to train a model from scratch, but they have proprietary data. They can post-train themselves and beat some of the closed models.” “There’s still so much juice left to squeeze from post-training. We compared GLM 5.3’s cyber capabilities with 5.2, and it’s a night and day difference. That’s all just post-training.”

SemiAnalysis

213,831 görüntüleme • 13 gün önce

General purpose AI got us here but it won’t take us where we’re going. When everyone is using the same models, there’s no edge. The shift is clear from renting AI to owning AI and that's what Manos Koukoumidis is pushing forward with Oumi. This is where AI gets real.

General purpose AI got us here but it won’t take us where we’re going. When everyone is using the same models, there’s no edge. The shift is clear from renting AI to owning AI and that's what Manos Koukoumidis is pushing forward with Oumi. This is where AI gets real.

Farlane

50,334 görüntüleme • 7 ay önce