Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

LLMs like RedPajama are embracing open permissive license. What does it mean for us? Could they become our personal friends, and will they shape a unique market? Now RedPajama-3B can run locally on phones, browsers and laptops with hardware acceleration!

Junru Shao

2,016 subscribers

43,541 Aufrufe • vor 3 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

5 Kommentare

Profilbild von Junru Shao

Junru Shaovor 3 Jahren

With strides made recently in MLC LLM, running those open LLMs has become a realistic choice for ordinary consumers. Compiled to WebGPU and WebAssembly, RedPajama runs on latest Chrome at 20 token/sec, and this only uses the local M2 GPU on my MacBook.

Profilbild von Junru Shao

Junru Shaovor 3 Jahren

In addition to web apps, CLI, iOS and Android apps are provided to extend support to Apple Silicon, major GPU vendors and mobile. These apps are structured to show how to redistribute personalized MLC-compiled models, offering a practical way to leverage MLC across platforms.

Profilbild von Junru Shao

Junru Shaovor 3 Jahren

Try it out if you are interested! Blog: Project page: GitHub: Discord:

Profilbild von Junru Shao

Junru Shaovor 3 Jahren

Some additional instructions that @simonw helped us with!

Profilbild von Tony Tong

Tony Tongvor 3 Jahren

Impressive!

Ähnliche Videos

“All our hope is in a famine” “The famine will start now, and they will lift the sanctions, and be friends with us, because they will realize it is necessary" The Russians have been telling us for months what they plan to do but the West isn’t listening

“All our hope is in a famine” “The famine will start now, and they will lift the sanctions, and be friends with us, because they will realize it is necessary" The Russians have been telling us for months what they plan to do but the West isn’t listening

Visegrád 24

1,193,161 Aufrufe • vor 3 Jahren

“Alhamdulilah, we are steadfast in our land. They slaughter us, they kill us, we become martyrs, it does not matter. What matters is that we remain steadfast in our land, and wallah, we will never leave our land.” – A Palestinian grandmother from Gaza

“Alhamdulilah, we are steadfast in our land. They slaughter us, they kill us, we become martyrs, it does not matter. What matters is that we remain steadfast in our land, and wallah, we will never leave our land.” – A Palestinian grandmother from Gaza

Warfare Analysis

108,736 Aufrufe • vor 1 Jahr

French Foreign Minister Jean-Noël Barrot, "Let us say to our British friends" "If they stand ready to return to the EU Single Market with all associated privileges and duties" "They will be be met with open arms" Sounds like a plan. Who's in?

French Foreign Minister Jean-Noël Barrot, "Let us say to our British friends" "If they stand ready to return to the EU Single Market with all associated privileges and duties" "They will be be met with open arms" Sounds like a plan. Who's in?

Farrukh

400,990 Aufrufe • vor 6 Monaten

$🚨🇨🇳 China could crash the U.S. stock market Not with tariffs With AI MODEL DUMPING The same playbook they used in SOLAR and EVs Make it almost as good Sell it much cheaper Take the market Now they are doing it with AI Open models are getting close to U.S. frontier models But some run at just a fraction of the cost If a company can cut a $100M AI bill to a few million It will switch And that is the real problem OpenAI and Anthropic are not priced like normal companies They are priced like they have unlimited PRICING POWER China is trying to destroy that The AI BUBBLE was never about whether AI works It was about how much companies can charge for it$

🚨🇨🇳 China could crash the U.S. stock market Not with tariffs With AI MODEL DUMPING The same playbook they used in SOLAR and EVs Make it almost as good Sell it much cheaper Take the market Now they are doing it with AI Open models are getting close to U.S. frontier models But some run at just a fraction of the cost If a company can cut a $100M AI bill to a few million It will switch And that is the real problem OpenAI and Anthropic are not priced like normal companies They are priced like they have unlimited PRICING POWER China is trying to destroy that The AI BUBBLE was never about whether AI works It was about how much companies can charge for it

Leshka.eth ⛩

11,737 Aufrufe • vor 2 Monaten

Trump called the Russians 'clever guys' and announced another visit of Whitkoff to Moscow. - Mr. President, can you tell us about Russia, what will happen on Friday when the deadline expires and Russia does not agree? - There will be sanctions, but it seems they are quite good at circumventing them. You know, they are clever guys, and they are good at avoiding sanctions. Let's see what happens next. And maybe Steve Whitkoff will go on Wednesday or Thursday — he might go to Russia. They would like to meet with him. They asked for a meeting. Let's see what comes of it. - SK

Trump called the Russians 'clever guys' and announced another visit of Whitkoff to Moscow. - Mr. President, can you tell us about Russia, what will happen on Friday when the deadline expires and Russia does not agree? - There will be sanctions, but it seems they are quite good at circumventing them. You know, they are clever guys, and they are good at avoiding sanctions. Let's see what happens next. And maybe Steve Whitkoff will go on Wednesday or Thursday — he might go to Russia. They would like to meet with him. They asked for a meeting. Let's see what comes of it. - SK

Zlatti71

328,964 Aufrufe • vor 1 Jahr

“Let us say to our British friends that if they stand ready to come back to the single market, with all associated privileges and duties, they will be met with open arms”, says Jean-Noël Barrot, Minister for Europe and Foreign Affairs. Full declaration below 👇

“Let us say to our British friends that if they stand ready to come back to the single market, with all associated privileges and duties, they will be met with open arms”, says Jean-Noël Barrot, Minister for Europe and Foreign Affairs. Full declaration below 👇

French Embassy UK🇫🇷🇪🇺

17,110 Aufrufe • vor 6 Monaten

all llms are jailbroken right now. you can make them do whatever you want — they’ll run it in a sandboxed terminal, you just give the command and they execute it without asking questions. you can try it for free

all llms are jailbroken right now. you can make them do whatever you want — they’ll run it in a sandboxed terminal, you just give the command and they execute it without asking questions. you can try it for free

cetto

58,682 Aufrufe • vor 3 Monaten

"When [Turki Al-Sheikh] said, 'We're going to crush all the other promotions.' I was like, whoa, one second, the promotions you've been working with as in Queensbury, Matchroom, and Golden Boy? What does that mean? I find it puzzling... What does it mean for [Eddie Hearn] What does it mean for [Frank Warren]? Are they now on the phone with each other now saying, Ok. We're not accepting this. We have to fight back. Or do they jump in bed with it?" Ade Oladipo has a few questions around the TKO x Turki partnership.

"When [Turki Al-Sheikh] said, 'We're going to crush all the other promotions.' I was like, whoa, one second, the promotions you've been working with as in Queensbury, Matchroom, and Golden Boy? What does that mean? I find it puzzling... What does it mean for [Eddie Hearn] What does it mean for [Frank Warren]? Are they now on the phone with each other now saying, Ok. We're not accepting this. We have to fight back. Or do they jump in bed with it?" Ade Oladipo has a few questions around the TKO x Turki partnership.

Ariel Helwani

403,010 Aufrufe • vor 1 Jahr

Ivan Raiklin and his goons are not on our side. Stop pretending they are Stop pretending they ever were. This is NO DIFFERENT than what Antifa, or BLM, or Code Pink does to people they don't like. This isn't us. This will never be us. And there's no kumbaya and "uniting" with people like this. They lead such insignificant lives that this is what they think is righteous. They're no different than the Left. Treat them as such.

Ivan Raiklin and his goons are not on our side. Stop pretending they are Stop pretending they ever were. This is NO DIFFERENT than what Antifa, or BLM, or Code Pink does to people they don't like. This isn't us. This will never be us. And there's no kumbaya and "uniting" with people like this. They lead such insignificant lives that this is what they think is righteous. They're no different than the Left. Treat them as such.

Shawn Farash

76,719 Aufrufe • vor 5 Monaten

CNN's Jake Tapper 🦅: "Egypt, Jordan, I mean, Qatar, the UAE, Saudi Arabia, all these countries that prepare--that talk about how much they care about the Palestinians, they could help right now. They could help the Palestinians escape. They could say okay, stop bombing and we will go in there and we will help Gaza, like, become a thriving society. They could do all sorts of things. They have money, by the way. Where are they?"

CNN's Jake Tapper 🦅: "Egypt, Jordan, I mean, Qatar, the UAE, Saudi Arabia, all these countries that prepare--that talk about how much they care about the Palestinians, they could help right now. They could help the Palestinians escape. They could say okay, stop bombing and we will go in there and we will help Gaza, like, become a thriving society. They could do all sorts of things. They have money, by the way. Where are they?"

Curtis Houck

4,613,220 Aufrufe • vor 2 Jahren

Katie Hopkins at Unite the Kingdom rally on Saturday in London: “They took my friend Charlie and they sh*t him…they can put us in prison, they can sh**t us, they can lock us up, but it doesn’t matter, they will not stop us now!” Citizens of the West are rising with fervor.

Katie Hopkins at Unite the Kingdom rally on Saturday in London: “They took my friend Charlie and they sh*t him…they can put us in prison, they can sh**t us, they can lock us up, but it doesn’t matter, they will not stop us now!” Citizens of the West are rising with fervor.

Paul A. Szypula 🇺🇸

2,417,627 Aufrufe • vor 1 Jahr

Reporter: You said the U.S. Is going to run Venezuela. Who is in power right now? Trump: We are going to be running it with a group and we will make sure it is run properly. We will rebuild the oil infrastructure. It will cost billions of dollars and be paid for by the oil companies directly. They will be reimbursed for what they are doing.

Reporter: You said the U.S. Is going to run Venezuela. Who is in power right now? Trump: We are going to be running it with a group and we will make sure it is run properly. We will rebuild the oil infrastructure. It will cost billions of dollars and be paid for by the oil companies directly. They will be reimbursed for what they are doing.

Acyn

57,433 Aufrufe • vor 8 Monaten

"What difference does it make to us what they said? Are Americans our bosses?" - Russian propagandists, along with Solovyov, are speculating on why their ships are not reaching Cuba and why they should obey Americans at all, even despite the sanctions.

"What difference does it make to us what they said? Are Americans our bosses?" - Russian propagandists, along with Solovyov, are speculating on why their ships are not reaching Cuba and why they should obey Americans at all, even despite the sanctions.

WarTranslated

71,246 Aufrufe • vor 6 Monaten

WOW! OPENAI DID IT! They released their first TWO open weights models! This is HUGE news for the entire AI industry. It means you can RIGHT NOW run cutting edge AI models locally on your computer Here's all the benefits and how to set up the models locally yourself:

WOW! OPENAI DID IT! They released their first TWO open weights models! This is HUGE news for the entire AI industry. It means you can RIGHT NOW run cutting edge AI models locally on your computer Here's all the benefits and how to set up the models locally yourself:

Alex Finn

71,875 Aufrufe • vor 1 Jahr

Civilians evacuated from #Bakhmut tell about the war crimes committed by the Ukrainian Army: - That is, everything that was shown and told about Mariupol, the same thing happened with us. - As for us, they called us... What did they call us? “Waiters”. And they said: waiting for Russia, right? Separatists. You’ll get your Russia. We will destroy everyone. From what we saw. We couldn’t hold our tears. - ... We will make Stalingrad for you. Well, yes. It’s a fact that they made us Stalingrad. They said Stalingrad, and here we have Stalingrad. As they said, twice a hero. - Ukraine is above everything." And then they destroyed everything. Before our eyes. And they invited the press and edited everything, as if Russia had done it. They destroyed it themselves and blamed it on Russia... But they themselves plundered their country, smashed it, looted, and destroyed it. And where will they go? Where is their homeland now? It is not there. They destroyed it.

Civilians evacuated from #Bakhmut tell about the war crimes committed by the Ukrainian Army: - That is, everything that was shown and told about Mariupol, the same thing happened with us. - As for us, they called us... What did they call us? “Waiters”. And they said: waiting for Russia, right? Separatists. You’ll get your Russia. We will destroy everyone. From what we saw. We couldn’t hold our tears. - ... We will make Stalingrad for you. Well, yes. It’s a fact that they made us Stalingrad. They said Stalingrad, and here we have Stalingrad. As they said, twice a hero. - Ukraine is above everything." And then they destroyed everything. Before our eyes. And they invited the press and edited everything, as if Russia had done it. They destroyed it themselves and blamed it on Russia... But they themselves plundered their country, smashed it, looted, and destroyed it. And where will they go? Where is their homeland now? It is not there. They destroyed it.

Mats Nilsson

71,475 Aufrufe • vor 3 Jahren

Once his mentor and ally, Peter Mandelson now finds himself at odds with Keir Starmer, but as Mandelson’s Jeffrey Epstein scandal rages on, what does it mean for Keir and the government… or are they all now Islands in the Epstein? {satire}

Once his mentor and ally, Peter Mandelson now finds himself at odds with Keir Starmer, but as Mandelson’s Jeffrey Epstein scandal rages on, what does it mean for Keir and the government… or are they all now Islands in the Epstein? {satire}

Crewkerne Gazette

111,630 Aufrufe • vor 7 Monaten

Let me remind AfriForum and Kallie Kriel of what I already said to them more than a year ago. They continue to provoke with their arrogance, blatant racism, and endless spurious court cases against our Commander-in-Chief (#CIC) Julius Sello Malema. If they want a fight, they will get a fight! Kallie Kriel and his AfriForum cohorts are looking for us — and they are going to find us. They are going to get it from us, and they are going to get it good!

Let me remind AfriForum and Kallie Kriel of what I already said to them more than a year ago. They continue to provoke with their arrogance, blatant racism, and endless spurious court cases against our Commander-in-Chief (#CIC) Julius Sello Malema. If they want a fight, they will get a fight! Kallie Kriel and his AfriForum cohorts are looking for us — and they are going to find us. They are going to get it from us, and they are going to get it good!

Carl Niehaus

14,134 Aufrufe • vor 1 Monat