Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Less than two weeks before he left Google to co-found Discovery Loop, Jeff Dean described the automated research loop the new company is named for, giving no hint he was about to leave to go do it. "There's this sort of the foundation of the scientific method of you...

14,495 Aufrufe • vor 1 Tag •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

OpenAI member of product staff Alexander Embiricos describes the evolution of "Lord Bottleneck," an internal Codex loop developed by a single staff member that ultimately ended up creating a tight feedback and improvement loop for new user experiences: "This person on the growth team needed to figure out what experiments to run. And they needed to write code to run the experiment. Then they needed to analyze the experiment." "They started using Codex for each separate thing. So they had it run a bunch of analyses, interrogate the data, talk to Codex about the data. Then they would pick an experiment, and ask Codex to write the code. Then they would run the experiment, then ask Codex what the results of the experiment were. Then they would produce a deck." "All steps they were doing individually. They didn't start by saying, 'I'm going to automate this entire thing,' because that's hard and scary. They just started with using Codex to accelerate themselves." "Then, they started connecting all these things together into a giant skill. And one day, they just said [to Codex], 'Why don't you do this every morning?'" "They gave it a name: 'Lord Bottleneck.' Because it's solving the bottlenecks of friction for new users." "Now, every morning, Lord Bottleneck evaluates past experiments, looks at data, proposes some [new] experiments, and offers to the team to run the experiments. The team picks [what experiments to do]. Then Lord Bottleneck is like, 'Ok cool. Here's some code or whatever config that needs to be done,' runs the experiment, and they go and do the same loop the next day." "It's really serious value. I forget the numbers, but it's produced significant company value automatically through Codex."

TBPN

80,403 Aufrufe • vor 3 Monaten

Why did so many languages copy async/await from C#? Anders Hejlsberg(Anders Hejlsberg) - creator of TypeScript, C# & Turbo Pascal - on what they got right with the design: #1 - async/await was designed to solve a common problem in the event-loop model: "A lot of languages are built around cooperative multitasking in the sense that they have an event loop that sits and dispatches events. Then you handle the event and then you yield back to the event handler loop. And it all runs in a single thread cooperatively. The problem with that is if you then want to do some long running work: how do I stop in the middle of this piece of long running work and yield back to the event loop cooperatively? And then when my result is ready, I can come back and continue executing here." #2 - state machines are the solution, but hard to build: "Well, in order to do that in an inverted architecture like that, you have to build a state machine. State machines are notoriously hard for people to implement because you've got to move all of your state off of the stack into objects. And then you have this big case statement that envelopes your entire logic. It's a nightmare to figure out. But, the transformation from serially executing code into a state machine, its continuation-passing-style translation is actually one that you can do in a machine-based fashion." #3 - compilers are good at writing state machines: "You can have the compiler write the state machine if you introduce syntax that allows you to indicate where you want to yield. And that's what await is. Await is basically saying, I want to yield here, and I want to yield this promise, and then when the promise completes, I want you to come back here and continue executing. Then the compiler writes a state machine around it and it actually turns it into this big switch statement and moves all of the state that survives across the await into something that's heap allocated. So it can be brought back. And doing all of that work is something that compilers are great at. And so that was sort of the idea that we have this new style of programming where we're using promises or the equivalent of promises and the ability to yield and then we have callbacks. But trying to write your program in that style, that's also what JavaScript suffered from a lot. It's like all this callback style stuff. With Async and Await, you get the illusion that you're just writing normal sequential code and then the compiler does the painful transformation for you. That turns out to be really useful."

The Pragmatic Engineer

13,258 Aufrufe • vor 1 Monat

Don’t Scroll—God Is Calling You to Submit and Move Praise the Lord that He has given us such a commission and such a call and we should be humbled by that and we should want to go out for His kingdom and do that. All of you are usable by God. There is not one of you that is not usable if you're only willing to submit. We all fall short. It's a matter of who is willing. Here I am, Lord, send me. That's what Isaiah said. Here I am. Send me. You are all usable. When a lot of you out there go, well, what can I do for God in my life? There's a lot you can do. If you're only willing to be picked up as an instrument in his Hands and implemented the way you were created to move. Many of you are operating outside the realm of what you were created to be. And in this season, that's going to be reconciled. And many of you are going to change course in this season drastically. Because you're in jobs, you're in areas, you're doing things, you were not created to do. You have gifts for it, but you weren’t created to do it. And there's going to be massive shifts in many of your lives and a sudden turn. And the Lord is going to realign. And this is going to be quick when He does it. Realign you into the position, redirect you and put you on that course because time is short and He needs you operating in what you were created to do. He needs that right now. And many of you are going to enter that process in this season. So praise the Lord because you are. You will enter that process and you will be redirected. And you will do what is written about you in the books of heaven, what you were created to do on this earth. Because many of you know and feel uncomfortable and know you're not in your call. You know you are just trying to try to endure, you're trying to survive. And it's because you're not in your call. Surrender to God, allow Him to redirect you into your call and your purpose that you were beautifully created to do. Because it's needed in this season and we cannot dilly dally anymore and go dabbling in things we are not created to do. It's time for us to go to work and it's time for us to be willing to go there.

Amanda Grace

12,379 Aufrufe • vor 2 Monaten

Airtable's Howie Liu says that basically everyone will need to graduate from being ICs to ICs that manage teams of 20-30 agents: "The best developers today don't just sit there in front of their IDEs and synchronously talk to their agent." "[Instead], you have like 30 separate branches that are each being worked on by a different agent. And you can have the agents continue to update the branches based on human and other agent feedback." "And I think this whole idea of it taking hours for that entire loop to complete — agent pushes some changes, the changes get feedback from other agents or humans, the agent responds to that — that whole loop could be hours, not just minutes. So you're not going to just sit there and watch it one at a time." "But the powerful thing about this is, each one is still actually operating faster than a human engineer. One agent on one branch can do the work of maybe three humans, operating 3x as fast. So it's like a 10x leverage factor just for one agent." "But the best engineers are now able to multitask and say, 'I'm going to oversee my own little team of 20-30 agents working concurrently.'" "Everyone needs to graduate from being an IC to an IC manager of agents. Meaning, if you're a VC analyst, your job should no longer be to go synchronously research one company. You need to go and research like 30 companies, and do them all faster, better, and higher quality than you could before." "That's the greatest leap that is going to be challenging for a lot of people in a lot of roles. Because it's a totally different mentality in how you operate, and what your role is."

TBPN

35,595 Aufrufe • vor 3 Monaten

Lightspeed's Bucky Moore says the real opportunity in the AI app layer is in large industries far enough afield from where the model providers are today — and where the context engineering to get customer data into the model is extremely nuanced and messy. "I think this is kind of the elephant in the room right now — whether post-training open-source models combined with the unique user feedback you get from being an application provider is defensible enough." "That is going to be an inevitable challenge for any of these industries that hit a maturation point of AI adoption, like legal and software engineering have." "But on the other hand, there are some industries where they're very large, they're far enough afield from where the model providers are today — and probably will continue to be — and the context engineering to actually get the customer data into the model is just so messy. It requires going across different business functions, it requires a lot of hands-on forward-deployed engineering." "Those are the kind of companies that we get really excited about. Because I think being really good at that is not only defensible, but it also allows you to generate a feedback loop with your customers, where you hear a lot of their secrets. And those secrets allow you to feed that back into how you make your product better at the expense of anyone else playing in the space. Because if you're serving the customer, they're only serving you those secrets." "I think Palantir is a good example of this in the pre-AI era, and I think we're going to see many companies ascend in that same way."

TBPN

46,862 Aufrufe • vor 4 Monaten

Pavel Durov on why he hasn't had depression in 20 years: "I normally never have depression. I don't remember having depression in the last 20 years, at least maybe when I was a teenager." Pavel's approach to difficult emotions is completely counterintuitive. As he puts it: "I'm a human being like everybody else. I do get to experience emotions and some of them are not very pleasant. But I believe that it's the responsibility of every one of us to cope with these emotions and to learn to work through them." On what creates depression: "Self-discipline is particularly important because without it, how can you overcome this seemingly endless loop of negativity or despair that ultimately leads to depression for some people?" His method: "One of the reasons I don't have depression is I start doing things. I identify the problem, I can see a solution, and I start executing the strategy. If you are stuck in this loop of being worried about something, nothing's ever going to change." The mistake people make: "People often make this mistake thinking 'Oh, I should just have some rest and then regain energy.' This is not how it works. You gain energy by doing something. So you start doing something, then it happens. You feel motivated, you feel inspired, and then ultimately you do something else a little bit more." He continues: "The whole point is to do first and then feel, not feel and then do. Going to the gym is a good example. There are many days when you don't want to start working out. But you have to overcome this initial reluctance and then you get to a point that you enjoy it and you think 'Oh my god, it was such a good idea to come to gym today.'" Action creates energy, not the other way around.

Jaynit

547,435 Aufrufe • vor 6 Monaten

.Naval: Epistemology, which is a fancy word for the theory of how knowledge grows or how knowledge growth occurs. And we've all been told since we're young that there's a scientific method and that scientists sort of do this stuff in white lab coats and we're supposed to accept it because of this thing called the scientific method. And then they give us true beliefs that we can then say, well the science is settled and we take that we move on. And we all only have a very, very vague understanding of how this works. And people say, well maybe you go out in the real world, you look at what's happening, you make all these observations, and then based on that you form a theory, you test the theory against more observations, and the more observations you get the closer you get to the truth. And once you have enough observation it's true and then you call it a scientific theory or a law and it's settled and you move on. And this is the popular conception of how science works. And as Popper pointed out and as you take even further, this is completely wrong. And so I'd love for you to get into that, which is what is knowledge? How does it grow? What is the real scientific method? And how do we figure things out? David Deutsch: I love the way you just stated the prevailing view there and laced every aspect of it with the contempt that it deserves. So you just went through touching every base. It's amazing that this series of misconceptions is still common sense. I mean, that it was common sense at a time when we didn't really have science or when science was just starting up, when the main issue in science was freeing itself from dogmatism, freeing itself from religion, freeing itself from authority, and so on. There it was understandable that people would look for an alternative source of authority and they would think, oh, it's sense impressions. We can see the world and you know, these religious people, they can't even see God and so on. And so we are confined to what we can see. That's where we get our ideas from. And as you say, that is completely false. Sense impressions, like all observation, even the most careful scientific observation is all theory laden. And theories are inherently fallible. I mean, we actually want to replace our best theories. Everybody who does a PhD is technically anyway, working to overturn something in the existing body of knowledge. You're not turned away at the door if you say, I don't believe this stuff, I'm going to produce something better. Whereas for most of human history, that was exactly what you were forbidden to do. The idea was that we already had all the important knowledge. If you want to discover something new, what you had to make sure of was that it didn't contradict the existing knowledge. Now, you have to make sure that it does contradict existing knowledge. So more or less. Naval: Yeah, it's this tradition of criticism that you've talked about in the West, that the Enlightenment really ushered in the Enlightenment era. David Deutsch: It has been institutionalized. So in many ways, our institutions are wiser than we are. So the institutions of science, for instance, have this built in, even if scientists actually don't always act that way. In fact, they often don't act that way, and act in a dogmatic way and try to preserve the status quo and are resistant to new ideas and so on. But the institutions, the way the procedures of science work, makes the right thing happen in the end anyway, regardless of what the people are trying to do. Naval: So you're saying the knowledge of the true scientific method is embedded in the institutions of science in the PhD process? David Deutsch: Well, the best scientific method that we know of, and one shouldn't really think of it as a method, you know, there's this wonderful lecture by Popper when he first was made a professor at the London School of Economics. He was made a professor of scientific method, and his first six lectures, I wish the rest of them were, the first six lectures are on the internet somewhere. And he starts the first one by saying, I am the first professor of scientific method in the British Empire. The British Empire still existed at the time, more or less. And so the first thing I want to say to you is that there is no such thing as the scientific method. And then he goes on from there. So this subject does not exist. So if any of you have come here to learn the handle that you have to turn in order to make scientific knowledge come out the other end, you're going to be disappointed.

Deutsch Explains

114,992 Aufrufe • vor 1 Jahr

HOW TO USE AI LOOPS TO RUN YOUR BUSINESS 24/7 A lot has been written about loop engineering for building products. Almost nothing about using loops to run the business itself. That's the bigger idea. A loop is when you give an agent a goal, a way to check its own work, and permission to keep trying until it hits that goal. Build. Verify. Repeat. Stop when the condition is met. Here's what it looks like in practice: 1/SEO loop You're position 30 for a term you want. The loop runs once a month, makes changes, checks where you rank, and keeps pushing until you're on page one. This is running in production right now on Inbox Zero. 2/Ads loop You're spending $100 a day and losing money. The loop tests creative, checks profitability, kills what fails, and keeps going until the account is in the black. 3/Eval loop Your AI feature is only 88% accurate. The loop keeps adjusting the prompt and swapping the model until it passes 90%. 4/LLM visibility loop People search in ChatGPT now, not just Google. Same loop, new scoreboard. Are we the answer or not? The whole thing hinges on one thing: a metric that comes back black and white. Where do I rank? Did it hit profitability? Did the evals pass? Give an agent that scoreboard and it runs for months. Loops used to run for 30 minutes. These run for a year. Take a step, sleep, wake up next month, take another one. You're basically hiring an agency that never sleeps, gets paid in tokens instead of invoices, and undoes its own mistakes when the number goes down. Full episode on The Startup Ideas Podcast (SIP) 🧃 watch

GREG ISENBERG

82,335 Aufrufe • vor 24 Tagen

Demis Hassabis confirmed every frontier AI lab is working on recursive self-improvement and in the same sentence said the safety risk of removing humans from the loop entirely keeps him up at night. That combination should stop you. The CEO of Google DeepMind just confirmed that the thing most people treat as a theoretical future risk is already the active focus of every serious lab on earth right now. He explained why it works in coding and math. The feedback loop is fast. You can verify whether an answer is correct almost instantly. You can generate synthetic training data from it. The loop closes quickly and cleanly. Then he said where it breaks down. In biology, chemistry and physics. Any domain where verifying a hypothesis requires a physical experiment in the real world. The loop does not close in seconds. It closes in weeks or months. Geoffrey Hinton said in his Nobel lecture that recursive self-improvement is the development he fears most and that once started it may not be possible to stop. Hassabis is not pushing back on that. He is describing the guardrails labs are building around a process they are already running. Every lab has to think carefully about the safety of a process where no human is in the loop. He said that as a constraint they are navigating right now. The question they are sitting with is how much of it to let run without a human watching. (Watch the full interview on YouTube at Two Minute Papers channel)

Ihtesham Ali

68,231 Aufrufe • vor 1 Monat