Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

So I think I've found another pretty incredible example of the generalisability of neural network potentials: this is a problem I've been dreaming of tackling for a decade but never felt I had the the tools to get at until now: How do potassium ion channels work. 1/n These...

95,181 Aufrufe • vor 1 Jahr •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

As I sit here in DC this week, we are closer to something I was not sure I would ever see. I have been working in this industry since 2015. For most of those years, the defining feature of crypto in Washington was not policy. It was the absence of it. A gray zone where serious people built serious things under a constant cloud, never quite sure which rules applied or whether the ground would move beneath them. This week the CLARITY Act sits on the Senate calendar. A federal framework for digital asset market structure, the thing this industry has wanted for the better part of a decade, is closer than it has ever been. It is not law yet, and there are real hurdles left. But the distance between where we stood a few years ago and where we are sitting today is hard to put into words. I keep thinking about the work that got us here. Over the past year I watched Chainlink move from outside these conversations to inside them. Sergey at the White House for the signing of the GENIUS Act. The Department of Commerce putting government economic data onchain. Meetings with the SEC that became real interpretive guidance. Conversations with the lawmakers now writing the rules. None of that happens by accident. It happens because people keep showing up, year after year, and make the case in rooms where it is not yet obvious. And there is something fitting in it. The entire premise of what we build is verification. Making truth provable. Removing the question of what is real. The work here in DC is the same thing in a different form. Trading a decade of ambiguity for something the industry has never actually had. We are not at the finish line. But sitting here, it is hard not to feel the weight of it. The gray zone is ending. What comes next is something this industry has never had. Clarity.

Chris Barrett

14,798 Aufrufe • vor 2 Monaten

HTML Artifacts are a big part of how I work with agents now. Artifacts can be more than just static files. When combined with agents, they can take action or help you take action. This unlocks all kinds of interesting ways to work with agents. This is clearly the future. Check out this writing and scheduler artifact I built in a few minutes. It uses a bit of HTML and JS. All the data is in markdown (Obsidian vaults), so the agent can access and modify it at any time. No DB needed. No sophisticated functionalities. The agent decides all that for me based on the skills, context, and memory it has access to. The best part about this simple stack is that all the important information stays with me. This has allowed me to build a recursive self-improving system and automations that can better tap into coding agents like Codex or Claude Code. I could have paid or built an entire app for scheduling posts, and there are so many of them out there. But I don't need to. I've realized a simple artifact does the job. And the simplicity of it is actually an advantage. Very little maintenance for very high returns on personalization, time, and efficiency. The other benefit of this is that I can add features as I please. That level of personalization feels magical, and we should all be pursuing more of it. All of this just keeps compounding. Of course, this example is just about writing. But I have similar artifacts for research, design, experimentation, evaluation, and so much more. And no, I didn't actually publish the post example I shared in the clip. It was just for demonstration purposes. I actually spend more time than this when writing together with agents. Lastly, having built my own agent orchestrator tool has made me realize that simplifying the tool stack is a superpower. If you are curious about how all this works, I will do a live session next week:

elvis

18,374 Aufrufe • vor 3 Monaten

I had the same thought so I've been playing with it in nanochat. E.g. here's 8 agents (4 claude, 4 codex), with 1 GPU each running nanochat experiments (trying to delete logit softcap without regression). The TLDR is that it doesn't work and it's a mess... but it's still very pretty to look at :) I tried a few setups: 8 independent solo researchers, 1 chief scientist giving work to 8 junior researchers, etc. Each research program is a git branch, each scientist forks it into a feature branch, git worktrees for isolation, simple files for comms, skip Docker/VMs for simplicity atm (I find that instructions are enough to prevent interference). Research org runs in tmux window grids of interactive sessions (like Teams) so that it's pretty to look at, see their individual work, and "take over" if needed, i.e. no -p. But ok the reason it doesn't work so far is that the agents' ideas are just pretty bad out of the box, even at highest intelligence. They don't think carefully though experiment design, they run a bit non-sensical variations, they don't create strong baselines and ablate things properly, they don't carefully control for runtime or flops. (just as an example, an agent yesterday "discovered" that increasing the hidden size of the network improves the validation loss, which is a totally spurious result given that a bigger network will have a lower validation loss in the infinite data regime, but then it also trains for a lot longer, it's not clear why I had to come in to point that out). They are very good at implementing any given well-scoped and described idea but they don't creatively generate them. But the goal is that you are now programming an organization (e.g. a "research org") and its individual agents, so the "source code" is the collection of prompts, skills, tools, etc. and processes that make it up. E.g. a daily standup in the morning is now part of the "org code". And optimizing nanochat pretraining is just one of the many tasks (almost like an eval). Then - given an arbitrary task, how quickly does your research org generate progress on it?

Andrej Karpathy

1,651,590 Aufrufe • vor 6 Monaten

Universities and High Schools have not moved rapidly enough to guide students to have skills for the next decade. THEY HAVE FAILED. It is a massive crisis that can be averted by understanding what AI and Robotics will bring about. Solutions are knowing how to use these tools and new industries that will rise. But this situation is also on ALL OF US. No “job” is safe from founder to entry level in most industries. You and I, by what we do, will be “replaced” ultimately. What to do? AI and Robotics are tools, the next decade is owned by those who know how to use them expertly, but this is also temporary. We have to understand that what we do for “work” will change giving ultimately a greater value to those that are: Creative Flexible Always learning Willing to be wrong Love being human Love being alive Know history Covet wisdom Knowing all tech has downsides Building strong family and friends Realize many institutions have failed The first four are required for you to be able to live through this period with your sanity intact. The rest will allow you to thrive. There are no true careers at this point anymore. There are advocation and vocations which will either earn you money or give life meaning. We will learn that we are not “what we do”, just like we knew for 99% of human existence. Let that sink in. — You and I are far, far ahead of knowing this and we can do two things: 1) Laugh at the “clueless” 2) Help people understand with grace Go to Reddit if you are 1, in fact don’t follow me because you will not like this next decade and what I post. You are 2 and thank you. Even if you and I have not solved this issue, we can help people understand what is ahead and with determination and creativity bound together to solve it locally. Or human family has done this millions of times. The evidence is: you are here. The Neo Luddite movement has not even begun and it will potentially rip apart society even more than all the fashionable moment in the recent past has. These Luddites will have a good point with the wrong answers cooked up by dying academics that cling to labels, “virtues” and victim hood. It will be readymade for some governments to enter in as “big daddy” to “help us”. You will not like what they do, but you will only know when it is too late. It will include YOU “volunteering” to “leave” by 60, to “help out” CanadaPod style. “Brian, I’m 24 what do I do?”. I hope to do much more here to help. But I do know this: 1) Learn a trade or vocation because it’s valuable. It may also be free to low cost if you do it right. 2) Learn everything you can about USING AI and TRAINING YOUR AI. Your expertise will be in the top 1% for a decade. But not forever. 3) Understand Bitcoin and how it will rise while other things sink. This is a short list for now. We will know more moving forward. When you see videos like this posted below, know one thing: Many of these folks had no real family of mental and physical support. Maybe no parent or one parent. Maybe only a broke system to prepare them for—nothing. This was not their doing. Now it is not your “job” to help them, it is your survival to help them if that is what you need. See some day after the dust settles these 20 year olds will be 40 year olds and running YOUR world. And at some point you may need them more than you think you do. You will need them, as they need you now. THIS IS WHAT PAST WISDOM KNEW. The elders of the past never found the need to piss on the youth and hope for the best. THE YOUTH ARE OUR BEST, let us all find ways to change it, even if every aspect of “the system” wants us to berate them into the ground.

Brian Roemmele

37,681 Aufrufe • vor 1 Jahr

I’m at the movies with my daughters and CPS called my phone. I answered and really let them have it. Since 2016 they have investigated me more times than I can count. People with an axe to grind are free to call CPS and make any accusations they want with complete anonymity and impunity. I have been the subject of targeted harassment for a decade now. The system is beyond broken. I’ve tried to escalate this to Frankfort Kentucky multiple times but they won’t answer the phone or return messages. Real hard working people, let me tell ya. Our tax dollars at work. The other day CPS pulled my two high schoolers out of class. This is more than ten times now in the last few years. Tilly cried so hard she had to leave school. Keep in mind I had to homeschool Tilly last year because of constant harassment from CPS. They pulled her out of class approximately 7 times her 8th grade year. She wanted to go back this year and I allowed it. and here we are, back to square one. All of my kids are A-B students. They have never been in a fight. Never had a referral or incident. Never busted with tobacco etc. CPS asked Marcy and Tilly: • ‘What was my relationship with Tori?’ (My gf of 4 years and mother to my youngest) • ‘Is Ritty delayed?’ • ‘Do I give my children tobacco products?’ I’m so over this fucking dumb shit. This will be the SECOND time I’ve had to retain an attorney to deal with these people. Every investigation has proven fruitless. They accomplish nothing more than scaring my kids and disrupting our quality of life. Bunch of fat fucking liberal women that clearly hate me. I’m a pretty open book and I think everyone can agree that I go above and beyond for my children. (My Cashapp is $amiriking if you would like to assist with legal fees. I’d really like to take these people to the ends of the Earth until there is REFORM.) Thanks for letting me vent. I’m going to exhaust every resource I have to expose these corrupt, biased, people and how incompetent the entire cabinet is. Will update A LOT.

Amiri King

27,165 Aufrufe • vor 11 Monaten