Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

John: why aren't LLMs caching answers to common questions to increase response time? "I've asked ChatGPT, ‘When was OpenAI founded?’ three different times. It's the exact same query." "It doesn't need to light the GPUs on fire for that question. So cache those results and give them to the...

301,136 Aufrufe • vor 7 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Pocket cofounder akshay found PMF in one of the most unintuitive ways. When customers didn't like his recording app, he made a hardware device to do what the app does. Now he has 300,000 users. "Convenience beats intentions. So if your users have the intention to record, and you don't make it convenient enough, they will not record." "But if you actually make it convenient enough to record, and they want to record even a little bit, they'll 100% record." He explains how he figured all this out: "We actually went and asked these people, 'Why are you using the device 10x more than the app?'" "One of the users was using a different phone that he bought specifically for recording conversations. And he had a battery attached to the phone, on top." "That's kind of what Pocket ended up being. By just watching how people use these recording apps on the phone, there are a lot of limiting factors for recording." "There are people who get incoming phone calls all the time. So if you're recording something, and you get an incoming phone call, it interrupts the recording. If you take the call, your recording stops essentially." "Apart from all of these technical reasons, the real reason is actually that the people who take 10, 15 meetings a day — doctors, consultants — a patient goes out, another comes in — the client goes out, the client comes in — and there's 10-15 back-to-back meetings, they feel awkward in the first few seconds to take out their phone and start recording. They have to unlock their iPhone, set up the recording, and hope the operating system doesn't kill apps running in the background." "So people just felt that, this is much more reliable. A quick-access thing that can immediately start recording. And I don't need to feel awkward placing it on a desk. So it doesn't take attention away from the meeting, like, 'Why is this guy looking at his phone? We just met.'"

TBPN

55,953 Aufrufe • vor 21 Tagen

ELON MUSK REVEALS WHY HE FOUNDED OPENAI "The reason I founded OpenAI was because I was concerned, based on my conversations with Larry Page, who used to be a close friend of mine, that he was not sufficiently concerned about the dangers of AI This really came to a head when at my birthday party, in front of a large group of people, called me a specist for favoring humanity over computers. I found that troubling I was like, 'Larry, what side are you on? It sounds like you're on the side of the computers, but you really need to be on team humanity here, you know.' After that, I was like, 'Okay, this is it. We’ve gotta have some counterbalance to Google because Larry doesn't seem to care if humans make it or not So, I thought, 'What’s the opposite of Google?' It would be an open-source non-profit. And that’s where the word 'open' in OpenAI comes from it means open source. I provided all the money beginning like, whatever, the series A, B, C rounds and recruited the key people and taught them everything I know I actually even got them the deal with Microsoft to donate some time from Azure. And for all that, I did not seek any financial reward whatsoever And the reason I actually turned down the offer for shares is because I felt like, 'What do you mean, shares in what?' Non-profits aren't supposed to have shares, at least last time I checked They’re not supposed to be vehicles for self-enrichment. So that's why I turned down the offer of shares, because it didn't seem morally or legally defensible"

X Freeze

53,613 Aufrufe • vor 7 Monaten