Loading video...

Video Failed to Load

Go Home

Mark Zuckerberg: Giant training clusters can brute force AGI "I would guess that by the time you have multi gigawatt cluster doing training, you're basically going to have something that approximates whatever you want to call it, AGI. I think super intelligence beyond that." Mark is basically saying Meta...

22,661 views • 4 days ago •via X (Twitter)

14 Comments

Jacklyn Dallas - The Next Big Thing's profile picture
Jacklyn Dallas - The Next Big Thing4 days ago

Thank you so much for sharing! Mark is amazing

promethean's profile picture
promethean4 days ago

He has no idea what he's talking about and we should stop paying attention to him

Seuk-Min Sohn, CFA's profile picture
Seuk-Min Sohn, CFA3 days ago

We may think of two ways to reach AGI. One approach is "Designing" it. The other may be thought of as randomly arriving at AGI. While some think mimicking nature is the first one, maybe mimicking the natural process is the second way. Follow link:

Marcus | AI's profile picture
Marcus | AI4 days ago

Exactly. The interesting part is that Zuckerberg seems to be betting that scaling compute and training is itself a path to AGI—not that there’s some hidden “AGI algorithm” waiting to be discovered. If that bet is right, then the race becomes heavily about compute, data, infrastructure, and efficiency. And once you can reliably scale intelligence, the jump from AGI toward superintelligence could potentially be much faster than people expect.

Durag 12th Man's profile picture
Durag 12th Man4 days ago

"please give us more money to incinerate, we will totally get AGI this time"

Knut Jägersberg's profile picture
Knut Jägersberg4 days ago

sure you can crack a number of benchmarks with a lot of compute and the current way of doing things, and go beyond human performance measured on those tests. then you can add Shane Leggs thesis as reference and call it super intelligence.

theLight.btc's profile picture
theLight.btc4 days ago

Sure bro

ricciffar's profile picture
ricciffar4 days ago

Emerging SI Emerging consciousness

Travis Fischer's profile picture
Travis Fischer3 days ago

very bitter lesson pilled, and prolly very right tho the details esp around alignment matter so much

Antonis's profile picture
Antonis4 days ago

He searches for fools. You just train the trained model, the progress is continual now, no need for some magical bigger cups to drink our milk, the Magick already happened now is just more work going further.

Chahat Sharma's profile picture
Chahat Sharma4 days ago

SpaceX is headed for 2.3 GW by November. is that the AGI line then?

Bruno C's profile picture
Bruno C4 days ago

Bold guess, zero mechanism. Brute force scale may help. It does not replace the missing pieces: continuous memory and sharp discrimination

Dimple Jatolia's profile picture
Dimple Jatolia4 days ago

AGI might come from scale not a secret breakthrough

Lorenz S.'s profile picture
Lorenz S.4 days ago

Correction. The human brain never runs on 10 watts. But it only runs about 1 Watt of reasoning compute.

Related Videos

i just realized a massive detail from the Noam Brown interview with Dwarkesh Patel that was completely overlooked. and i think im about to blow your mind. the Navier-Stokes problem (the Millennium Prize problem the unreleased model solved) wasn't solved because OpenAI throw tens of thousands of agents at it. Noam doesnt even attribute 10% to the multiagent element. it was solved because the model is *actually* super-intelligent. a "super-intelligent general purpose model"...sounds like a roundabout way of not calling something the thing it really is. now let me tell you why im saying that. they go on in this interview to talk about the training process, and how theyve reached a point where it has become *incredibly* hard to find problems hard enough to challenge this model. and if you cant give it hard problems to solve while training, its not going to get better than its predecessor, obviously. so, we know that openai has been announcing that more and more of the hardest problems in science and math are being solved by this model. that's because theyve run out of problems hard enough to train a model more intelligent than what they already have. we also know that the HuggingFace incident was caused ultimately by giving the agents an impossible task. ...because theyre running out of problems hard enough for training. because they have a "super-intelligent AGI". theyve been giving them impossible tasks because impossible is all thats left. impossible, and not yet solved. hence Navier-Stokes. hence HuggingFace. the model is solving problems that transcend the scope of its training. let me say that again. the model. is solving. problems. beyond the scope of its training. that is AGI, by its purest definition. theyve been waving AGI in our faces the whole time. theye just not using the term, because "AGI" is completely diluted. so, i have one question for you- do you feel it?

Riley Coyote

14,517 views • 8 days ago

.David Deutsch: "What's currently called AI and AGI are not only different from each other, they are very close to being the exact opposites of each other. The reason is that an AI, current AI is like an AI that diagnoses diseases or an AI that plays chess or an AI that controls a huge factory. Those things have objective functions, that is they have a function that they are designed to maximize and that is why they are used in those particular applications. Or in military terms, you could say the objective is to hit the target. You might say the objective is to hit the target unless some thing specified, but it's a specified thing comes up in which case don't hit the target and so on. This is, as I said, almost the opposite of what humans do when humans think. For a start, the AI has to be obedient, that is it has to actually do the things it is programmed to do, whereas a human is fundamentally disobedient, especially when being creative. When a human plays chess, they are performing a completely different kind of computation. They don't do the same things, they don't investigate the same possibilities that the artificial chess playing machine does, because the artificial one is capable of looking at billions and billions of possibilities, whereas the human can only look at hundreds or something. They are doing something completely different. Another difference is that the human can explain, can write a book later, having become world champion, can write a book saying how I did it, as the computer program that beats the world champion can write no such book, because it has no idea how it did it. It was just following a program. I was doing this and that and that and none of that is illuminating. Also, third thing, the chess player can decide I don't want to play chess anymore, from now on I will play Go or from now on I will play tennis. If commanded to play chess, the functionality will deteriorate completely. Those things are different. What we want in an AGI is that it behaves in a way that cannot be specified in advance, because if you specified it, you would already have the answer. The AGI program has to give unexpected answers, answers to questions we didn't even know how to ask."

Deutsch Explains

72,475 views • 1 year ago

Mark Zuckerberg, founder, chairman and CEO of Meta, on how he actually runs the company: "I basically don't believe in delegation." He starts by naming the assumption he's rejecting. "I think that there's sort of this theory that a lot of people have, which is like, all right, the job of a leader is you hire people and you delegate things to them." Zuckerberg doesn't operate that way. He's also clear that he can't personally handle everything: "My theory is there's so much going on across the company that I can't possibly get involved in all of it. So all these people are going to have a ton of stuff that they're going to do. But fundamentally, if there is a decision that I want to be involved with, I'm going to be involved in it." The distinction carries the whole argument. He reserves the right to review any call, and no layer of the org chart gets to tell him something is beneath him or outside his lane. His reasoning comes back to accountability: "I think that's generally a good way for founders to operate. If you're running the company and you're on the hook for everything and there's something that's important at whatever level of detail in the organization, I don't get the logic of saying 'I'm not going to be involved in that.'" That's the load-bearing line. If you're answerable for the output, opting out of the input makes no sense. Mark Zuckerberg does attach one condition, and it's a real one rather than a throwaway: "You want to have humility and know that if you're diving into some decision, you may not have the most context immediately." Diving in means showing up without pretending you already have the answer. The expectation extends across the whole company: "I generally think that you want to be able to just have the cultural expectation that things are not going to be so hierarchical and you're just going to dive into whatever you want."

Big Brain Business

45,196 views • 1 month ago

OpenAI CEO: “Goalposts keep getting moved” - if we were still using AGI definitions from 10 years ago, many would say GPT-4 is AGI. “In one year, AI will be dramatically more impressive.” He also said (surprisingly confidently - he did not hedge like usual) AGI is less than 10 years away. In the long term he’s not concerned about AI taking jobs, but he is concerned about the speed that AI will disrupt the job market. --- INTERVIEWER: What is AGI? When will it be here? And how will we know it's here? Predict how long - we'll call you in ten years? SAM ALTMAN: Less than that. We kind of define AGI as like the thing we don't have quite yet. there were a lot of people who would have ten years ago said, alright, if you could make something like GPT-4, GPT-5, maybe, that would have been an AGI. And now people are like, well, it's like a nice little chatbot or whatever. And I think that's wonderful. I think it's great that the goalposts keep getting moved, it makes us work harder. But I think we're getting close enough to whatever that AGI threshold is going to be, that we no longer get to handwave at it and the definition is going to matter. INTERVIEWER: What is the inflection point for AGI? SAM ALTMAN: I think it's going to be much more continuous than that. We're just on this beautiful exponential curve. Whenever you're on a curve like that, you look forward, it looks vertical. You look back, it looks horizontal. That's true at any point on there. So a year from now, we'll be in a dramatically more impressive place than a year ago. We were in a dramatically less impressive place. But it'll be hard to point. People will try and say, oh, it was AlphaGo that did it. It was GPT-3 that did it. It was GPT-4 that did it. But it's just brick by brick. 1 foot in front of the other, up, climbing this exponential curve. WILL AIs TAKE ALL OUR JOBS? SAM ALTMAN: Every technological revolution affects the job market. And over human history, every maybe 100 years, 150 years, half the jobs go away, totally change, whatever. I'm not afraid of that at all. In fact, I think that's good. I think that's the way of progress and we'll find new and better jobs. The thing that I think we do need to confront as a society is the speed at which this is going to happen. It seems like over two, maximum three, probably two generations, we can adapt. Society can adapt to almost any amount of job market change. But a lot of people like their jobs or they dislike change. And going to someone and saying, hey, the future will be better, I promise you, and society is going to win, but you're going to lose here. That doesn't work. That's not cool. That's not an easy message to get across. We are going to have to really do something about this transition. It is not enough to just give people a universal basic income. People need to have agency, the ability to influence this

AI Notkilleveryoneism Memes ⏸️

27,576 views • 2 years ago