正在加载视频...

视频加载失败

Just read a neat AI paper called SAMURAI -- it takes SAM 2 (Meta's "segment anything" model) and makes it way better at tracking objects in videos. Basic problem is SAM 2 gets confused when things move fast or there's a crowd of similar objects (big problem for VFX...

47,246 次观看 • 1 年前 •via X (Twitter)

9 条评论

Bilawal Sidhu 的头像
Bilawal Sidhu1 年前

Project/paper here: If y'all enjoyed this post, you might also enjoy my writing on all things spatial ai and creative tech:

Min Choi 的头像
Min Choi1 年前

This is genius. I'm playing with SAM 2 and this was the exact limitation that I was running into for my use

Bilawal Sidhu 的头像
Bilawal Sidhu1 年前

Same! @BlacePlugins ya'll need to implement this paper for your after effects SAM 2 plugin

Kishen Patel 的头像
Kishen Patel1 年前

very cool! there’s definitely something satisfying when intuitive ways of solving ML problems work. like kalman filter to track noisy movement just makes sense - basically a signal processing problem. another might be SSMs for modeling a differential system.

Bilawal Sidhu 的头像
Bilawal Sidhu1 年前

Totally — sometimes the best solutions come from recognizing when an ML problem is actually a classical problem in disguise!

subnet Sam 的头像
subnet Sam1 年前

wow this is incredibly cool! i woudl use this for non nefarious purposes

Bilawal Sidhu 的头像
Bilawal Sidhu1 年前

Lol. VFX and surveillance about to get a nice boost 😂

Maskai 的头像
Maskai1 年前

Very interesting 🧐

Wit Of Gold 的头像
Wit Of Gold1 年前

Impressive

相关视频

Chamath: Two terms you need to pay attention to in AI are Prefill and Decode “There's two terms that I think you're going to hear a ton about over these next few years.” “The first term is prefill, and the next is decode.” “What prefill and decode are, are two very distinct ways of how models think, and how a model goes through the process of answering a question that you ask it.” “And so when you send a prompt to AI, what happens is that the model processes it. This is called the reading phase or prefill.” “It reads your entire prompt all at once. And then it does a bunch of math, calculates all these relationships between all the words, and it stores them in temporary memory.” “The problem is that this is really compute bound. So it requires massive brute force. And Nvidia GPUs crush here.” “And their architecture is designed for massive parallel processing, which makes them really amazing at digesting these long prompts.” “So the problem just gets bigger and bigger, Nvidia just completely dominates.” “But the next phase though, this critical phase, the decode phase, is the writing phase, right?” “So the model starts to generate a response, you ask it a question and its response, one token at a time.” “And then to pick the next token to pick the next word, it has to look back at everything it has said already so that it doesn't hallucinate.” “The problem is that this is incredibly memory bandwidth constrained.” “And in our architecture, a long time ago, we made these design decisions from day one.” “And so what we did was we took a very different architectural approach, we took a very conservative process technology. We weren't pushing the boundaries of physics.” “And we used a lot of what's called SRAM. So memory on the chip so that we could do this decode thing as well or better than everybody else.” “And so now when you put these two things together, I just think it's going to create a huge acceleration in the ability for this entire infrastructure layer to get much cheaper and much more valuable, which I suspect then it'll have a lot more developer pull, you'll get a lot more applications being built, billions and billions of more people using it.”

The All-In Podcast

567,546 次观看 • 7 个月前

I'm up late with the rest of you building AI agents with the new AI browser from Genspark. We can see where this is all going: a new kind of operating system -- one that is very different than the Microsoft centric way that I've been working for 20 years. There are several things that these new agentic browsers bring to you: 1. They let you change how you browse. With an old browser like Google Chrome, you go to your email, Facebook, or X. 2. With these new browsers, you tell it where to go and what to do for you. 3. It can even build software for you. At the end of this video, I have it building me a little YouTube uploading utility, which is very helpful. 4. They have a ton of "applications" built in. Think of it as a new kind of office suite. Docs. Spreadsheets. Slide decks. And much more. All built with AI, not bolted on the side like with Microsoft's Office. 5. They have AI models built "underneath" so you can work privately and cheaply. There’s a lot of new choices you have to make with browsers like this. I’ve been playing with a bunch of them. Some have better user interfaces than others. Some have different versions, slide components, or applications. The reason I like Genspark is because they ship so fast. I’ve been watching this company since its very beginnings, and every week they ship new things. Just yesterday, they shipped a new photo editing feature for my iPhone. I upload a photo and then I can just talk to it and edit it with my voice. It's really cool. I try to reward companies that ship at such a fast rate and that are shipping innovation that improves our lives. It's not that I'm going to stop using Google Chrome. My whole life has been there for, I don't know, almost 20 years now. This is a different way of working and it gives me a space to run my AI tasks that's different than Google Chrome. I run them side by side. One doing old stuff, one doing new stuff. I can keep using Google Chrome for my old stuff, like my email and my calendar. And I use GenSpark or one of the new AI browsers to do new AI-centric things. All sorts of new things that these new agentic browsers open up! Have you tried it, or one of the other new ones yet? How has it changed your work? It takes a little time to get used to AI-centric ways of doing things. Pretend your browser is a team of interns. Give them a task, in this case I said "help me upload my videos to YouTube." You might be shocked at what Genspark does to improve your life. I am everytime I use it. Give it a try and let me know what you think! Oh, and I used another little tool to "write" this post. Typeless -- I push a button and talk and it writes. With fewer typos than I usually type in, to boot. It works great with Genspark's new browser too. Download it here:

Robert Scoble

70,991 次观看 • 10 个月前

.Joe Lonsdale: AI Must Strengthen, Not Replace, Western Civilization "We still have a lot of our smartest friends working at DOGE. They're still cutting billions of dollars of nonsense. I'm really glad they're there. I don't want them to give it up. They're still fixing a lot of things with these different areas. I'm obviously supportive of everything Elon Musk overall did there. I was a little frustrated with the comment he made earlier this week, which was that there's a tidal wave of AI coming, and therefore, we don't need to worry about cleaning the beach of the government. I think that's actually the wrong conceptual model. The correct conceptual model is that AI is coming to our society, and it's really important that AI ends up lifting everyone up. And the way it's going to do that is through Western civilization's ways that work. We have this civilization that's built based on the enlightenment, property rights, Judeo-Christian values and classical virtues. It's a functional civilization. We don't want to give that all up for AI. We want to make healthcare and education work better, but we have to do it through the way it works. I think making government work better is really, really hard. It takes a lot of persistence. It takes a lot of time. On the margin, his time might be better spent building these amazing AI companies, and I think that's completely legit. I don't think we should discount the importance of fixing government, especially because of AI, because if we want to have everyone do better in health care and education and government itself, these things need to be functional. They need to work with it. They need to block crony capitalism. That means functional government. You need both."

Josh Caplan

20,833 次观看 • 1 年前

Interview from 5 months ago with “RA” the new UFO whistleblower Randy Anderson by Gerb Here he describes the sphere encounter and the possible consciousness connection and how his memories of the incident are strangely fuzzy Link to full interview in comments H/T wow RA - “Both the items they had under there, they said somehow interacted with consciousness and, and the way he said it, this is why it's so fuzzy, he said, I wouldn't quote these things 'cause I'm gonna try to just remember the, the, the context. And I, and I can again, like when I meditate and I think about this, I can usually get more back. But just, just like sitting here talking to you and remembering it, it's difficult sometimes. But I remember him saying, we don't understand quite how to operate the systems or how they, but they do interact with consciousness so certain and some people they interact with and some people they don't. So certain people will go up to the object and it will respond. And some people go up to the object and it does nothing. So certain types of, I don't know if that's related to DNA or to consciousness or what, whatever, but it's different. People will have a different response and they, they had us kind of walked closer to the, the window and nothing happened. So we didn't, I mean, I don't know if we got closer or something would've happened, but they, I don't know if they were even looking for that, but maybe, you know, that they, that's one thing he said that like certain people will go near the object and will react. And he didn't describe how it would react. He instead it would react,” RA - “There's a really weird component to this, and I don't know what this means, but when I think back to this particular memory and, and this never happens to me in any other thing, I, I get real fuzzy. It gets real fuzzy, like, like almost like something was purposely done to to, to make it that way. Because I have a very photographic memory and things I've done in the military. Like I can tell you the color of the buttons on a shirt of a guy that I sniped from, you know, 800 feet, 800 meters away. So I mean, I, there's for me to not remember this is really bothers me, but there's, there's some cloudiness when I try to access this part of my brain, you know, I can definitely, maybe it's, it could definitely be the, the objects itself that had, and it felt this, this is why it's difficult because it obviously, it felt weird being down there. Okay. There's, there's something like, there was just, it is an unnatural feeling we're doing. It felt like we were doing something that wasn't normal. I mean, the fact that we were so deep underground, me and the dude were kind of freaked out and, and, but we didn't display that outwardly because we're trained to not do that, you know? But internally, yeah, I was like, what the hell is going on? And when they talk about optimal stuff, they didn't say it like, by the way, aliens are real like you or anything like of that sort. It was just, oh yeah, this is the off world technology division, this is Chuck, this is whatever. And just started talking like everything was normal and we just went along with it because we acted like it was normal, but the first time I'd ever been exposed to it and it, it was a lot to take in. So that could be part of it too.”

neandrewthal

41,422 次观看 • 1 年前

From Eric Vishria on how the top AI founders are building products completely opposite of the SaaS era: "One of the things that is really different in the AI world versus the SaaS world, is that in the SaaS world, over and over again, you had people who really understood the customer. And the problem. And then they understood a domain. They understood what the technology was more or less capable of. But it wasn't a real question of if you could build something or not. For example, take Salesforce, Workday, and ServiceNow. CRM existed before Salesforce. HR management existed before Workday. Same thing with ServiceNow. So in every case, Salesforce followed Siebel. Workday followed Peoplesoft. ServiceNow followed Peregrine and Remedy, and others. So they were just kind of, cloud SaaS versions of the prior generation product. They just understood the customers. They understood the problem. And they were just like, here's a better version. And that evolved a little bit over time in SaaS land. But that's what it is. And so product development in that way was done by people who really understood the customer and the problems. And then just took advantage of the next wave. And this is almost diametrically opposite of product development in the AI era. When I look at the teams that are having the most success today, they have intimate knowledge of the models. They are right on the frontier of understanding which models are better at what, and why, and when. And what they're going to be good at and what they're not going to be good at. And what they're spending their time on, is figuring out how do I apply this capability of this model to this domain or to this user. So they're actually working inside out or technology out, versus customer problem in. And of course, they understand the customer problem. And a lot of times they have firsthand knowledge of it. But they're really close to the metal and capability, and they're applying it. And I think this is a really different way to develop products than in SaaS. I started my career as a product manager a long time ago, and it's almost the complete opposite of everything you learned. "Listen to the customer, understand it, then bring it back to the engineering and product teams." If you did that right now, ask a bunch of customers what they want out of AI, and you brought it back, for the most part, it may not be possible today with today's technology. Whereas the teams that are winning right now really understand the technology and are applying it out. And so I think this reversal matters. I think it's a big difference in terms of how companies are getting built. And maybe even the types of entrepreneurs that will be successful. I'm not sure. You're seeing some real change there. Look at the Bret Taylor's at Sierra. That's a super, super technical founder who really gets it. Brett and Clay really get it. You look at Michael and his co-founders at Cursor. They're super technical founders and they get it. They all really understand what these things can and can't do. And that's a pretty different dynamic relative to the way the best SaaS companies got built." Link in bio for the full conversation going deep on the current class of startups going from zero to $100m+ in ARR within 12 months.

The Peel

209,752 次观看 • 1 年前

How will we know if an AI take over is imminent? What are the warning signs? Connor Leahy: “Things will seem mostly normal, just… weird. Things will get weirder…and weirder… and then one day, we will just not be in control anymore. “There won't be a fight. There won't be a war. It won't be dramatic. It will just be that one day the machines are in control, and not us.” “The way I expect [AI take over] to feel is like, if you play chess against a grandmaster, it doesn’t feel like you're having a heroic battle against the Terminator…. it doesn’t feel like you're having this incredible back and forth, and then you lose... No, it feels more like you THINK you're playing well, you think everything is okay, and then suddenly… you lose… in one move, and you don't know why. This is what it feels like to play chess against a grandmaster, and this is what it's going to feel like for humanity to play against AGI. It won’t be some dramatic battle where the Terminators rise up and try to destroy humanity. No, it will be… things get more and more confusing. [Editor's note: Like Sam Altman, out of nowhere, raising up to 10% of world GDP?] More and more jobs get automated faster and faster... More and more technology gets built, which no one even quite knows how the technology works... There will be mass media movements that don't really make any sense... Like, do we really know the truth of what's going on in the world right now, even now with social media? Do you or I really know what's going on? How much of this is fake? How much of it is generated with AI or other methods? We don't know. And this will get much worse.” Imagine if you have extremely intelligent systems, much smarter than humans, that can generate any image, any video, anything, trying to manipulate you well...and being able to develop new technologies to interfere with politics.”

AI Notkilleveryoneism Memes ⏸️

183,443 次观看 • 2 年前