Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

"will humanity ever do a 10 million GPU pre-training run?" OpenAI CEO, Sam Altman, raises the question: oAI employee: there'll be 10m GPUs working together on an AI system that learns and performs tasks. however, the approach may shift from fully synchronous pre-training to "semi-synchronous" or more decentralized methods.

Haider.

66,672 subscribers

125,411 Aufrufe • vor 1 Jahr •via X (Twitter)

Nachrichten & Politik Wissenschaft & Technologie Bildung

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von alby13

alby13vor 1 Jahr

don't forget that transformer architecture won't be around forever. you've got to think macro, on a longer timeline.

Profilbild von NICE

NICEvor 1 Jahr

Stay competitive by balancing cutting-edge AI with automation tools. Forrester shows how.

Profilbild von prabhu💢

prabhu💢vor 1 Jahr

Thats a massive scale it's exciting and kind of scary at the same time

Profilbild von XR Multiverse

XR Multiversevor 1 Jahr

ChatGPT has been around for 3 years and its still not able to return information without omitting half of it. Both OpenAI and Anthropic are horrible at the most important part of AI.

Profilbild von Ramón Guillamón

Ramón Guillamónvor 1 Jahr

using distributed computing. ex: using smartphones cpus - 8000/14000M

Profilbild von Bhaktavaschal Samal

Bhaktavaschal Samalvor 1 Jahr

10-million-GPU pre-training run is theoretically plausible but faces significant technical, economic, and ethical hurdles. potential benefits of such a system are immense, they however, must be weighed against the risks and resource costs involve. shift to asynchronous pre-training is not just plausible but necessary for scaling to 10 million GPUs reflects a broader evolution in ai infrastructure—one that prioritizes resilience, efficiency, and decentralization over rigid synchronization. this transition however requires solving novel challenges in optimization, system design, and governance and if successful, it could enable unprecedented ai capabilities while paving the way for more sustainable and democratized ai ecosystems.

Profilbild von Jeramie Baker

Jeramie Bakervor 1 Jahr

Could be done more effectively with my triadic designed systems in theory and sim's HUGE gains!

Profilbild von JayBird

JayBirdvor 1 Jahr

With a big enough nuclear reactor ☢️

Profilbild von Matthias Heger - AI acc ⏩

Matthias Heger - AI acc ⏩vor 1 Jahr

probably yes but gpus themselves will scale.

Profilbild von ぽいロード@音技術者

ぽいロード@音技術者vor 1 Jahr

twink

Profilbild von Xyber Man

Xyber Manvor 1 Jahr

gpus are outdated and not suited for ai google with their tpus will lead

Ähnliche Videos

OpenAI CEO was asked what he thinks about Elon Musk x poast saying “OpenAI will eat Microsoft alive” and Satya responding to that: Sam Altman >ummm… you know i don’t think about him that much. host: what do you think about the larger idea though that oai will eat microsoft alive long-term > OpenAI CEO: “I don’t know what that means. Do you know what the means?” host: Yeah that in the grand scheme of partnership ultimately OAI will have MORE POWER, MORE INFLUENCE, MORE LEVERAGE over Microsoft than Microsoft have over OAI > Altman: “he’s just tweeting all day how much openai sucks and how our model is bad and we’re not going to be a good company” Notice Sam Altman didn’t answer the question.

OpenAI CEO was asked what he thinks about Elon Musk x poast saying “OpenAI will eat Microsoft alive” and Satya responding to that: Sam Altman >ummm… you know i don’t think about him that much. host: what do you think about the larger idea though that oai will eat microsoft alive long-term > OpenAI CEO: “I don’t know what that means. Do you know what the means?” host: Yeah that in the grand scheme of partnership ultimately OAI will have MORE POWER, MORE INFLUENCE, MORE LEVERAGE over Microsoft than Microsoft have over OAI > Altman: “he’s just tweeting all day how much openai sucks and how our model is bad and we’re not going to be a good company” Notice Sam Altman didn’t answer the question.

NIK

271,035 Aufrufe • vor 10 Monaten

Sam Altman says an AI will be a better CEO of OpenAI than him in the reasonably near future Once that becomes clear, companies and countries will face pressure to give AI more influential roles or fall behind "people will still want humans, but if AI is better, more power will shift to AI"

Sam Altman says an AI will be a better CEO of OpenAI than him in the reasonably near future Once that becomes clear, companies and countries will face pressure to give AI more influential roles or fall behind "people will still want humans, but if AI is better, more power will shift to AI"

Haider.

31,627 Aufrufe • vor 3 Monaten

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

The Render Network

10,904 Aufrufe • vor 1 Jahr

OpenAI CEO, Sam Altman, questions: how far could classical pre-trained models go if given unlimited resources but no new algorithmic breakthroughs? could they potentially reach something like a "GPT-5.5"? oAI employee: based purely on current ML and algorithmic understanding, no clear limit has yet been found for scaling classical pre-trained AI models.

OpenAI CEO, Sam Altman, questions: how far could classical pre-trained models go if given unlimited resources but no new algorithmic breakthroughs? could they potentially reach something like a "GPT-5.5"? oAI employee: based purely on current ML and algorithmic understanding, no clear limit has yet been found for scaling classical pre-trained AI models.

Haider.

102,958 Aufrufe • vor 1 Jahr

Google's star AI researcher Noam Shazeer just left for OpenAI. "Noam was working on pre-training at Gemini… And pre-training is something that Google is viewed to be really strong at. And OpenAI is viewed to have been kind of weaker at.” It’ll help as “OpenAI tries to catch up to Anthropic’s most advanced models." — Erin Woo

Google's star AI researcher Noam Shazeer just left for OpenAI. "Noam was working on pre-training at Gemini… And pre-training is something that Google is viewed to be really strong at. And OpenAI is viewed to have been kind of weaker at.” It’ll help as “OpenAI tries to catch up to Anthropic’s most advanced models." — Erin Woo

The Information

65,208 Aufrufe • vor 10 Tagen

Sam Altman said he wants OpenAI to become the first major company led by an AI CEO, built from the idea that AI could run it better than him, pushing the org to move faster and smarter 🚀

Sam Altman said he wants OpenAI to become the first major company led by an AI CEO, built from the idea that AI could run it better than him, pushing the org to move faster and smarter 🚀

Tansu Yegen

16,523 Aufrufe • vor 7 Monaten

Sam Altman says, "shame on me if OpenAI isn't the first big company run by an AI CEO" Not just a department, eventually the whole org Treats it as a design exercise: start from the idea that "AI runs OpenAI better than me", find roadblocks, and redesign the org to move faster

Sam Altman says, "shame on me if OpenAI isn't the first big company run by an AI CEO" Not just a department, eventually the whole org Treats it as a design exercise: start from the idea that "AI runs OpenAI better than me", find roadblocks, and redesign the org to move faster

Haider.

209,749 Aufrufe • vor 7 Monaten

On the The All-In Podcast this week, Chamath Palihapitiya asked NVIDIA CEO Jensen Huang about decentralized AI training, calling our Covenant-72B run "a pretty crazy technical accomplishment." One correction: it's 72 billion parameters, not four. Trained permissionlessly across 70+ contributors on commodity internet. The largest model ever pre-trained on fully decentralized infrastructure. Jensen's answer is worth hearing too.

On the The All-In Podcast this week, Chamath Palihapitiya asked NVIDIA CEO Jensen Huang about decentralized AI training, calling our Covenant-72B run "a pretty crazy technical accomplishment." One correction: it's 72 billion parameters, not four. Trained permissionlessly across 70+ contributors on commodity internet. The largest model ever pre-trained on fully decentralized infrastructure. Jensen's answer is worth hearing too.

templar

472,445 Aufrufe • vor 3 Monaten

The future of AI by Sam Altman CEO of OpenAI and ChatGPT.

The future of AI by Sam Altman CEO of OpenAI and ChatGPT.

Adidust.eth 🦇🔊

63,817 Aufrufe • vor 3 Jahren

$A crypto project actually trained a 72B parameter AI model from scratch using decentralized GPU compute. Not fine-tuned, not a wrapper: trained from zero. The model benchmarks competitively against Meta's LLaMA 3 on reasoning tasks, and the entire training run cost a fraction of what centralized labs spend. If decentralized compute can produce frontier-class models, the moat around OpenAI and Anthropic is thinner than people think.$

A crypto project actually trained a 72B parameter AI model from scratch using decentralized GPU compute. Not fine-tuned, not a wrapper: trained from zero. The model benchmarks competitively against Meta's LLaMA 3 on reasoning tasks, and the entire training run cost a fraction of what centralized labs spend. If decentralized compute can produce frontier-class models, the moat around OpenAI and Anthropic is thinner than people think.

VirtualBacon

40,543 Aufrufe • vor 2 Monaten

"my kid is never going to grow up smarter than AI...and that'll be natural" OpenAI CEO, Sam Altman: the future generations will grow up in a world where AI is naturally more intelligent than humans it also requires a rethinking of how humans and AI work together

"my kid is never going to grow up smarter than AI...and that'll be natural" OpenAI CEO, Sam Altman: the future generations will grow up in a world where AI is naturally more intelligent than humans it also requires a rethinking of how humans and AI work together

Haider.

108,659 Aufrufe • vor 1 Jahr

Sam Altman just said the future of work won’t look like work At TreeHacks 2026, Sam Altman said something wild: Jobs in 100 years will be as unrecognizable to us as our jobs would be to people 300 years ago. AI will take over more and more operational work. And instead of obsessing over machines, humans may end up focusing more on each other. Which raises a bigger question: If AI does most of the work… do we even keep the concept of “jobs”? 👀

Sam Altman just said the future of work won’t look like work At TreeHacks 2026, Sam Altman said something wild: Jobs in 100 years will be as unrecognizable to us as our jobs would be to people 300 years ago. AI will take over more and more operational work. And instead of obsessing over machines, humans may end up focusing more on each other. Which raises a bigger question: If AI does most of the work… do we even keep the concept of “jobs”? 👀

VraserX e/acc

15,367 Aufrufe • vor 3 Monaten

New Course: Post-training of LLMs Learn to post-train and customize an LLM in this short course, taught by Banghua Zhu, Assistant Professor at the University of Washington University of Washington, and co-founder of @NexusflowX. Training an LLM to follow instructions or answer questions has two key stages: pre-training and post-training. In pre-training, it learns to predict the next word or token from large amounts of unlabeled text. In post-training, it learns useful behaviors such as following instructions, tool use, and reasoning. Post-training transforms a general-purpose token predictor—trained on trillions of unlabeled text tokens—into an assistant that follows instructions and performs specific tasks. Because it is much cheaper than pre-training, it is practical for many more teams to incorporate post-training methods into their workflows than pre-training. In this course, you’ll learn three common post-training methods—Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL)—and how to use each one effectively. With SFT, you train the model on pairs of input and ideal output responses. With DPO, you provide both a preferred (chosen) and a less preferred (rejected) response and train the model to favor the preferred output. With RL, the model generates an output, receives a reward score based on human or automated feedback, and updates the model to improve performance. You’ll learn the basic concepts, common use cases, and principles for curating high-quality data for effective training. Through hands-on labs, you’ll download a pre-trained model from Hugging Face and post-train it using SFT, DPO, and RL to see how each technique shapes model behavior. In detail, you’ll: - Understand what post-training is, when to use it, and how it differs from pre-training. - Build an SFT pipeline to turn a base model into an instruct model. - Explore how DPO reshapes behavior by minimizing contrastive loss—penalizing poor responses and reinforcing preferred ones. - Implement a DPO pipeline to change the identity of a chat assistant. - Learn online RL methods such as Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO), and how to design reward functions. - Train a model with GRPO to improve its math capabilities using a verifiable reward. Post-training is one of the most rapidly developing areas of LLM training. Whether you’re building a high-accuracy context-specific assistant, fine-tuning a model's tone, or improving task-specific accuracy, this course will give you experience with the most important techniques shaping how LLMs are post-trained today. Please sign up here:

New Course: Post-training of LLMs Learn to post-train and customize an LLM in this short course, taught by Banghua Zhu, Assistant Professor at the University of Washington University of Washington, and co-founder of @NexusflowX. Training an LLM to follow instructions or answer questions has two key stages: pre-training and post-training. In pre-training, it learns to predict the next word or token from large amounts of unlabeled text. In post-training, it learns useful behaviors such as following instructions, tool use, and reasoning. Post-training transforms a general-purpose token predictor—trained on trillions of unlabeled text tokens—into an assistant that follows instructions and performs specific tasks. Because it is much cheaper than pre-training, it is practical for many more teams to incorporate post-training methods into their workflows than pre-training. In this course, you’ll learn three common post-training methods—Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL)—and how to use each one effectively. With SFT, you train the model on pairs of input and ideal output responses. With DPO, you provide both a preferred (chosen) and a less preferred (rejected) response and train the model to favor the preferred output. With RL, the model generates an output, receives a reward score based on human or automated feedback, and updates the model to improve performance. You’ll learn the basic concepts, common use cases, and principles for curating high-quality data for effective training. Through hands-on labs, you’ll download a pre-trained model from Hugging Face and post-train it using SFT, DPO, and RL to see how each technique shapes model behavior. In detail, you’ll: - Understand what post-training is, when to use it, and how it differs from pre-training. - Build an SFT pipeline to turn a base model into an instruct model. - Explore how DPO reshapes behavior by minimizing contrastive loss—penalizing poor responses and reinforcing preferred ones. - Implement a DPO pipeline to change the identity of a chat assistant. - Learn online RL methods such as Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO), and how to design reward functions. - Train a model with GRPO to improve its math capabilities using a verifiable reward. Post-training is one of the most rapidly developing areas of LLM training. Whether you’re building a high-accuracy context-specific assistant, fine-tuning a model's tone, or improving task-specific accuracy, this course will give you experience with the most important techniques shaping how LLMs are post-trained today. Please sign up here:

Andrew Ng

125,146 Aufrufe • vor 11 Monaten

Together with Sam Altman and the OpenAI team, we’re building the largest AI training facility in the world. Here’s a quick look at how fast things are progressing at the first Stargate site in Abilene, Texas.

Together with Sam Altman and the OpenAI team, we’re building the largest AI training facility in the world. Here’s a quick look at how fast things are progressing at the first Stargate site in Abilene, Texas.

Oracle

33,421 Aufrufe • vor 1 Jahr

🚨"NEVER TRUST SAM ALTMAN, EVER... HE'S NOT A PERSON, HE'S A BRAND" Mo Gawdat delivers blistering takedown of OpenAI CEO, claiming Altman represents Silicon Valley vapor over substance while comparing OpenAI's profit focus to Google's early mission-driven projects: "Never trust Sam Altman, ever. Sam Altman is not a person. Sam Altman is the creation of a system. California is a place where vapor is worth more than solids. You look at OpenAI's original promise, which was to protect the world from artificial intelligence, to make AI work for humanity, and then you look for actions that support that. And if you don't find any, then it's just a pitch. You could see at OpenAI how all of them, Ilya and Mira, most of the core team left and asked for the company to change its leadership." Mo Gawdat

Mario Nawfal

17,634 Aufrufe • vor 6 Monaten

.Sam Altman says OpenAI will "obviously" have a version of Codex that "can do other knowledge-work tasks, and control your computer." "Of course we should have an ability to kick off new tasks from mobile, and we'll do that." "Really what you want is your single AI that's working for you on a unified backend. Access to all your data and ideas, and your stuff and your memory, and the ability to work across a lot of surfaces."

.Sam Altman says OpenAI will "obviously" have a version of Codex that "can do other knowledge-work tasks, and control your computer." "Of course we should have an ability to kick off new tasks from mobile, and we'll do that." "Really what you want is your single AI that's working for you on a unified backend. Access to all your data and ideas, and your stuff and your memory, and the ability to work across a lot of surfaces."

TBPN

108,839 Aufrufe • vor 3 Monaten

OpenAI CEO Sam Altman predicts that we could achieve AI superintelligence by 2025. He highlighted the potential of AI agents to handle complex tasks independently, much like a skilled human. While the progress in deep learning has been groundbreaking, he emphasized that there’s still a lot of hard work ahead to ensure these advancements benefit humanity responsibly.

OpenAI CEO Sam Altman predicts that we could achieve AI superintelligence by 2025. He highlighted the potential of AI agents to handle complex tasks independently, much like a skilled human. While the progress in deep learning has been groundbreaking, he emphasized that there’s still a lot of hard work ahead to ensure these advancements benefit humanity responsibly.

Andy Parackal

28,768 Aufrufe • vor 1 Jahr

I've posed a question: "Does OpenAI have a better pre-train in the back pocket or not?" and looks like the answer from Mark Chen is "Yes" - so we should expect a big response from OpenAI before the end of the year. Mark Chen, OpenAI Head of Research: - "In the last 2 years we've put so much resourcing into, into reasoning and one byproduct of that is you lose a little bit of muscle on pre training and post training." - "In the last six months, Jakub Pachocki and I have done a lot of work to build that muscle back up." - "With all the focus on RL, there's an alpha for us because we think there's so much room left in pre training." - "As a result of these efforts, we've been training much stronger models. And that also gives us a lot of confidence carrying into Gemini 3 and other releases coming this end of the year." So it does look like my assessment was broadly correct and they were neglecting pre-training quite a bit. The good news is that they've spent the last 6 months building that up and the big response shouldn't be too far away.

I've posed a question: "Does OpenAI have a better pre-train in the back pocket or not?" and looks like the answer from Mark Chen is "Yes" - so we should expect a big response from OpenAI before the end of the year. Mark Chen, OpenAI Head of Research: - "In the last 2 years we've put so much resourcing into, into reasoning and one byproduct of that is you lose a little bit of muscle on pre training and post training." - "In the last six months, Jakub Pachocki and I have done a lot of work to build that muscle back up." - "With all the focus on RL, there's an alpha for us because we think there's so much room left in pre training." - "As a result of these efforts, we've been training much stronger models. And that also gives us a lot of confidence carrying into Gemini 3 and other releases coming this end of the year." So it does look like my assessment was broadly correct and they were neglecting pre-training quite a bit. The good news is that they've spent the last 6 months building that up and the big response shouldn't be too far away.

Peter Gostev

84,628 Aufrufe • vor 6 Monaten

WATCH: OpenAI co-founder and CEO Sam Altman Sam Altman on the importance of developing A.I. responsibly, and the remarkable strides his company is making.

WATCH: OpenAI co-founder and CEO Sam Altman Sam Altman on the importance of developing A.I. responsibly, and the remarkable strides his company is making.

Fox News Sunday

40,536 Aufrufe • vor 1 Jahr