Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

1/🥇 For the first time ever... LLMs are running inside NVIDIA GPU TEEs — and accessible to everyone via OpenRouter 🧠 DeepSeek R1-70B & 🦙 LLaMA3.3 70B Instruct: Both models run inside secure enclaves on Phala’s TEE-powered infra.

Phala

143,073 subscribers

10,919 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji Haberler & Politika

Anya Rossi• Live Now

Private livecam show

12 Yorum

Phala Network profil fotoğrafı

Phala Network1 yıl önce

🚨 Major Milestone for AI Privacy 🚨 TEE-LLMs are first-ever live on @openrouterai — powered by Phala Network. We give you: 🔐 End-to-end privacy. ⚡️ Blazing speed. 📜 Verifiable LLM computation. Let's break it down.

Phala Network profil fotoğrafı

Phala Network1 yıl önce

2/ 🔍 What’s a TEE-LLM models? A Trusted Execution Environment is a secure hardware-based enclave. It ensures your prompts & model outputs are encrypted — even the operator can’t see them. More:

Phala Network profil fotoğrafı

Phala Network1 yıl önce

3/ Why does this matter? ✅ True privacy ✅ Remote attestation proves you're talking to the real TEE ✅ End-to-end encrypted model usage — even OpenRouter can’t snoop 🔗:

Phala Network profil fotoğrafı

Phala Network1 yıl önce

4/ 🖥️ OpenRouter + Phala = Seamless AI access You get the familiar OpenRouter experience, but backed by verifiable hardware privacy. A breakthrough: Web2-grade UX with Web3-grade security.

Phala Network profil fotoğrafı

Phala Network1 yıl önce

5/ 💰 Pricing: TEE-LLM models are not expensive! 🔹 LLaMA3.3-70B: $0.24 / 1m tokens 🔹 DeepSeek R1-70B: $0.46 / 1m tokens The costs of running your own AI models are also affordable & public:

Phala Network profil fotoğrafı

Phala Network1 yıl önce

6/ 🎮 This is just the beginning. The age of private, verifiable, decentralized AI is here. Phala’s infrastructure shows it’s possible — and live in production. 🔗 Explore:

Lab4crypto profil fotoğrafı

Lab4crypto1 yıl önce

🚀 Don't gamble with your portfolio! Use our advanced hybrid quant risk tool using on/off-chain data and make informed decisions. 📈 Acess to 1000+ charts for your crypto journey. 📚Join our Premium Telegram for daily alerts. 📊+21 projects supported. 🏗️ Beginners and experts.

pinetwork profil fotoğrafı

pinetwork1 yıl önce

@OpenRouterAI $pha at 10$

4rifmln profil fotoğrafı

4rifmln1 yıl önce

@OpenRouterAI when Claude 3.7 sonnet sir ? 🗿

crAAzy BTC 🎭 🇦🇪 profil fotoğrafı

crAAzy BTC 🎭 🇦🇪1 yıl önce

@OpenRouterAI LLMs in secure enclaves on @PhalaNetwork? What an absolute game changer. This is a whole new era for AI privacy and computation. 💯🚀

Floyd 🥷 profil fotoğrafı

Floyd 🥷1 yıl önce

@OpenRouterAI Props to @PhalaNetwork and @openrouterai — combining TEEs with top-tier open models like DeepSeek and LLaMA3 is a serious unlock 🔥

godon profil fotoğrafı

godon1 yıl önce

@OpenRouterAI Privacy is 4x the price? I guess it's good to put a number on privacy. However the avg. Person doesn't give 2 pennies

Benzer Videolar

deepseek-r1-distill-llama-70b on groq

deepseek-r1-distill-llama-70b on groq

Developers Digest

143,277 görüntüleme • 1 yıl önce

I bought the M4 Max 48GB RAM and first thing I did is to test local LLMs. It can barely run llama3.3 70b, but qwen2.5-coder 32b works very well. I'll test with MLX next ✌️

I bought the M4 Max 48GB RAM and first thing I did is to test local LLMs. It can barely run llama3.3 70b, but qwen2.5-coder 32b works very well. I'll test with MLX next ✌️

Daniel Nguyen

315,827 görüntüleme • 1 yıl önce

Llama 3.3 70B 4-bit running on a 128GB M4 Max with MLX LM (~12 toks/sec) with mactop on the right. "Good enough", local, private and open models are now more accessible than ever!

Llama 3.3 70B 4-bit running on a 128GB M4 Max with MLX LM (~12 toks/sec) with mactop on the right. "Good enough", local, private and open models are now more accessible than ever!

Ivan Fioravanti ᯅ

43,929 görüntüleme • 1 yıl önce

AkashChat provides access to 8 of the leading open-source AI models. Switch between models mid-conversation to leverage the strengths of each, while seamlessly maintaining the context. The chat below switches from Llama 3.3 70B to DeepSeek-R1.

AkashChat provides access to 8 of the leading open-source AI models. Switch between models mid-conversation to leverage the strengths of each, while seamlessly maintaining the context. The chat below switches from Llama 3.3 70B to DeepSeek-R1.

Akash Network

11,907 görüntüleme • 1 yıl önce

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁

Hatice Ozen

44,675 görüntüleme • 1 yıl önce

Deepseek 70B Distill is now on for those of you wanting to try it out and it's available in for developers!

Deepseek 70B Distill is now on for those of you wanting to try it out and it's available in for developers!

Groq Inc

40,817 görüntüleme • 1 yıl önce

With all the DeepSeek drama, here is a quick 1min explanation of Private AI we are building at Nillion You can run AI models inside a secure enclave / TEE where all the information is transferred and processed privately without it being exposed. Coming soon.

With all the DeepSeek drama, here is a quick 1min explanation of Private AI we are building at Nillion You can run AI models inside a secure enclave / TEE where all the information is transferred and processed privately without it being exposed. Coming soon.

Tom 👓

30,187 görüntüleme • 1 yıl önce

Running open source LLMs on Replit ⠕ feels like magic 🪄 Here's a demo of GPT4All 🦙 by Nomic running inside my Repl:

Running open source LLMs on Replit ⠕ feels like magic 🪄 Here's a demo of GPT4All 🦙 by Nomic running inside my Repl:

Zahid Khawaja

135,682 görüntüleme • 3 yıl önce

DeepSeek R1 on Groq is insanely fast Deepseek R1 70B Distill + Groq LPU its now available in ai-gradio pip install --upgrade "ai-gradio[groq]" import gradio as gr import ai_gradio gr.load( name='groq:deepseek-r1-distill-llama-70b', src=ai_gradio.registry, coder=True # remove coder for regular chat ).launch() prompt: write a script for a bouncing yellow ball within a square, make sure to handle collision detection properly. make the square slowly rotate. implement it in p5.js. make sure ball stays within the square

DeepSeek R1 on Groq is insanely fast Deepseek R1 70B Distill + Groq LPU its now available in ai-gradio pip install --upgrade "ai-gradio[groq]" import gradio as gr import ai_gradio gr.load( name='groq:deepseek-r1-distill-llama-70b', src=ai_gradio.registry, coder=True # remove coder for regular chat ).launch() prompt: write a script for a bouncing yellow ball within a square, make sure to handle collision detection properly. make the square slowly rotate. implement it in p5.js. make sure ball stays within the square

AK

69,829 görüntüleme • 1 yıl önce

HOLY FUNIONS! Groq makes DeepSeek R1 feel instant! Cooked up a chatbot using their Distill Llama 70B. Releasing the repo tomorrow. You control your data flow.

HOLY FUNIONS! Groq makes DeepSeek R1 feel instant! Cooked up a chatbot using their Distill Llama 70B. Releasing the repo tomorrow. You control your data flow.

Ray Fernando

54,028 görüntüleme • 1 yıl önce

DeepSeek R1 671B is ridiculously good, but running at 158 tokens per second is something out of this world. A model *this good* running *this fast* is 3 years ahead of this time. The secret: DeepSeek in this short video isn't running on GPUs. It's running on custom-made chips! This is running on SambaNova and their SN40L chips, which are designed and optimized for running AI workflows. SambaNova is sponsoring my work. We designed GPUs to run games and later realized we could use them for AI. This is very different from creating a chip specifically for AI from the ground up. Just think about this for a second: One single SNL40 chip can simultaneously hold 100+ models (trillions of parameters) in memory! An agentic workflow that uses multiple models simultaneously won't need to swap models from memory even once! By the way, the Llama family of models *screams* on the SambaNova Cloud. Here are some numbers from my latest tests: • Llama 3.3 70B: 367.32 t/s • Llama 3.2 1B: 2381.82 t/s • Llama 3.2 3B: 1335.71 t/s • Llama 3.1 8B: 929.58 t/s • Llama 3.1 70B: 369.16 t/s • Llama 3.1 405B: 103.37 t/s You can access all of these models for free!

DeepSeek R1 671B is ridiculously good, but running at 158 tokens per second is something out of this world. A model this good running this fast is 3 years ahead of this time. The secret: DeepSeek in this short video isn't running on GPUs. It's running on custom-made chips! This is running on SambaNova and their SN40L chips, which are designed and optimized for running AI workflows. SambaNova is sponsoring my work. We designed GPUs to run games and later realized we could use them for AI. This is very different from creating a chip specifically for AI from the ground up. Just think about this for a second: One single SNL40 chip can simultaneously hold 100+ models (trillions of parameters) in memory! An agentic workflow that uses multiple models simultaneously won't need to swap models from memory even once! By the way, the Llama family of models screams on the SambaNova Cloud. Here are some numbers from my latest tests: • Llama 3.3 70B: 367.32 t/s • Llama 3.2 1B: 2381.82 t/s • Llama 3.2 3B: 1335.71 t/s • Llama 3.1 8B: 929.58 t/s • Llama 3.1 70B: 369.16 t/s • Llama 3.1 405B: 103.37 t/s You can access all of these models for free!

Santiago

130,934 görüntüleme • 1 yıl önce

Check out Hermes 4 70b & 405b models from Nous Research. Now available for you through both the Nous Research and Cline providers. (Nous Research brand booklet linked below)

Cline

31,903 görüntüleme • 7 ay önce

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b

FlowiseAI

48,208 görüntüleme • 1 yıl önce

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

Hyperbolic

33,228 görüntüleme • 1 yıl önce

Introducing → CodecFlow @CodecOpenFlow offers agent first infra powered by vision language models, making robotics and desktop operators simple Agents spin up compute, run models, and build autonomously with payments via x402 on @Solana 🔗

Introducing → CodecFlow @CodecOpenFlow offers agent first infra powered by vision language models, making robotics and desktop operators simple Agents spin up compute, run models, and build autonomously with payments via x402 on @Solana 🔗

Superteam UAE

33,841 görüntüleme • 2 ay önce