Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Been experimenting with Apple's new Core AI framework over the past few days Built a mobile app that runs local AI models directly on device, exploring Core AI model deployment (.aimodel), model specialization, caching, and inference across Apple Silicon Also spent some time integrating with Apple's Foundation Models framework... show more

Sagar

1,413 subscribers

12,828 Aufrufe • vor 1 Monat •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

At Google I/O, I sat down with Omar Sanseviero and 👩‍💻 Paige Bailey from Google DeepMind to talk about Gemma, open models, AI Studio, on-device AI, sovereign AI and the future of AI development. A great conversation on how building with AI is becoming more open, local and accessible.

At Google I/O, I sat down with Omar Sanseviero and 👩‍💻 Paige Bailey from Google DeepMind to talk about Gemma, open models, AI Studio, on-device AI, sovereign AI and the future of AI development. A great conversation on how building with AI is becoming more open, local and accessible.

Chubby♨️

13,741 Aufrufe • vor 1 Monat

The dominant story in AI has been the growing cloud: bigger clusters, larger models, more gigawatts. We believe the future is in the opposite direction: on-device inference, smaller models, watts instead of gigawatts. Today we're releasing OpenJarvis v1.0: a personal AI assistant that lives, learns, and works on your device.

The dominant story in AI has been the growing cloud: bigger clusters, larger models, more gigawatts. We believe the future is in the opposite direction: on-device inference, smaller models, watts instead of gigawatts. Today we're releasing OpenJarvis v1.0: a personal AI assistant that lives, learns, and works on your device.

Jon Saad-Falcon

155,276 Aufrufe • vor 1 Monat

✨ Personal AI is the next computing platform. AI is shifting from something you access to something you build with, locally, at the edge, and across systems. We’re unlocking new possibilities for developers: • AMD Ryzen AI Halo, a local-first developer system, preorder starting in June, develop AI without limits on your desk • Gorgon Halo with up to 192GB unified memory, supporting 300B+ parameter models locally, run massive models locally We’re excited to partner with clem 🤗🤗, Co-founder and CEO of Hugging Face, to advance open-source AI for Ryzen AI. Our focus is seamless AI, from model to deployment. Cloud, edge, device. One continuum. Multi-agent systems, local inference at scale, open models as infrastructure. This is the next computing era 🚀

✨ Personal AI is the next computing platform. AI is shifting from something you access to something you build with, locally, at the edge, and across systems. We’re unlocking new possibilities for developers: • AMD Ryzen AI Halo, a local-first developer system, preorder starting in June, develop AI without limits on your desk • Gorgon Halo with up to 192GB unified memory, supporting 300B+ parameter models locally, run massive models locally We’re excited to partner with clem 🤗🤗, Co-founder and CEO of Hugging Face, to advance open-source AI for Ryzen AI. Our focus is seamless AI, from model to deployment. Cloud, edge, device. One continuum. Multi-agent systems, local inference at scale, open models as infrastructure. This is the next computing era 🚀

Jack Huynh

47,822 Aufrufe • vor 2 Monaten

⚡Why Edge Compute Matters for the Future of Agentic AI AI isn’t just about smarter models, it’s about where they run. Centralized clouds are costly, slow, and controlled by a few. That’s not the future. 👉Join the OptimAI Network: With OptimAI Edge Compute and the upcoming Core Node release, every device becomes part of a decentralized supercomputer: + AI models run directly on your devices (phones, desktops, IoT devices) + Data stays local, secure, and real-time + Compute scales with the community, not corporations This is how we power the next generation of Agentic AI - AI systems that don’t just think, but act like you. Lightweight, fast, everywhere, for everyone. Stay tuned. The Edge is coming.

⚡Why Edge Compute Matters for the Future of Agentic AI AI isn’t just about smarter models, it’s about where they run. Centralized clouds are costly, slow, and controlled by a few. That’s not the future. 👉Join the OptimAI Network: With OptimAI Edge Compute and the upcoming Core Node release, every device becomes part of a decentralized supercomputer: + AI models run directly on your devices (phones, desktops, IoT devices) + Data stays local, secure, and real-time + Compute scales with the community, not corporations This is how we power the next generation of Agentic AI - AI systems that don’t just think, but act like you. Lightweight, fast, everywhere, for everyone. Stay tuned. The Edge is coming.

OptimAI Network

43,596 Aufrufe • vor 10 Monaten

As Larry Ellison explains, there are two types of AI models: real-time models, also called AI on the edge, where you need ultra-low latency decisions (think autonomous driving or robotics), and models that don’t need an immediate response, like ChatGPT, where the system has time to reason. Real-time models require local compute inside the device, and these chips have nothing to do with the GPUs running in data centers. The AI-on-the-edge market is still largely untapped — and it’s going to be a multi-trillion-dollar opportunity. I believe $AMD will be one of the biggest beneficiaries

As Larry Ellison explains, there are two types of AI models: real-time models, also called AI on the edge, where you need ultra-low latency decisions (think autonomous driving or robotics), and models that don’t need an immediate response, like ChatGPT, where the system has time to reason. Real-time models require local compute inside the device, and these chips have nothing to do with the GPUs running in data centers. The AI-on-the-edge market is still largely untapped — and it’s going to be a multi-trillion-dollar opportunity. I believe $AMD will be one of the biggest beneficiaries

Daniel

151,698 Aufrufe • vor 7 Monaten

AI agents are evolving and becoming more proactive. From cloud-based to on-device, these systems can run continuously, handle tasks, and keep sensitive data local. New Liquid Foundation Models bring agents directly to your laptop and phone, even while you are offline. Watch the latest episode of Advanced Insights to learn more about our partnership with Liquid AI:

AI agents are evolving and becoming more proactive. From cloud-based to on-device, these systems can run continuously, handle tasks, and keep sensitive data local. New Liquid Foundation Models bring agents directly to your laptop and phone, even while you are offline. Watch the latest episode of Advanced Insights to learn more about our partnership with Liquid AI:

AMD

29,729 Aufrufe • vor 3 Monaten

1/ Excited to launch an experiment today - introducing Window, a way to use your own AI models on the web - including local ones! It's a bet on a new kind of AI app emerging, one that shifts model authentication and management to the user.

1/ Excited to launch an experiment today - introducing Window, a way to use your own AI models on the web - including local ones! It's a bet on a new kind of AI app emerging, one that shifts model authentication and management to the user.

Alex Atallah

389,260 Aufrufe • vor 3 Jahren

What happens in a world post-foundation model? "Foundation models are not going away, they will remain a core part of future systems. The question is not whether they get replaced, but what gets built on top of them. Future AI systems will likely combine foundation models with additional components to create more complete systems." Demis Hassabis Love to hear your thoughts Yann LeCun François Chollet Jürgen Schmidhuber Aran Komatsuzaki

What happens in a world post-foundation model? "Foundation models are not going away, they will remain a core part of future systems. The question is not whether they get replaced, but what gets built on top of them. Future AI systems will likely combine foundation models with additional components to create more complete systems." Demis Hassabis Love to hear your thoughts Yann LeCun François Chollet Jürgen Schmidhuber Aran Komatsuzaki

Harry Stebbings

13,648 Aufrufe • vor 3 Monaten

🌟 Another Epic Sneak Peek: OptimAI Core Node’s Edge AI Computing Power! We’re excited to continue unveiling the upcoming OptimAI Core Node features! This time, we’re introducing Edge AI Computing, a game-changing feature that will make your devices even more powerful in contributing to the OptimAI Network. 🔥 What is Edge AI Computing? With the OptimAI Core Node, your device’s idle computing resources (CPU/GPU) and storage will be put to work, powering critical AI computing tasks, including: 🔸Edge Inference: Running real-time AI predictions directly on your device without sending data to centralized servers. 🔸Hot LLM Models: Accelerating large language models for high-speed NLP tasks. 🔸Generative AI Models and More: Contributing to the training and inference of cutting-edge generative AI, like text-to-image models, deep learning, and more. More Contributions, Bigger Rewards Await! This Edge AI Computing feature allows us to leverage the full potential of decentralized computing power, reducing latency, increasing efficiency, and making AI more accessible. The more you contribute, the bigger the rewards!🔥 Stay in the Loop—Start Today with OptimAI Lite Node! While the OptimAI Core Node is still in the works, you don’t have to wait to join the action. The more you contribute, the greater the rewards! Let’s build a stronger, smarter, and more decentralized AI network together. Stay tuned for more exciting updates! 🔸Extension Node: 🔸Telegram Node: 🔸Register at: #DePIN

🌟 Another Epic Sneak Peek: OptimAI Core Node’s Edge AI Computing Power! We’re excited to continue unveiling the upcoming OptimAI Core Node features! This time, we’re introducing Edge AI Computing, a game-changing feature that will make your devices even more powerful in contributing to the OptimAI Network. 🔥 What is Edge AI Computing? With the OptimAI Core Node, your device’s idle computing resources (CPU/GPU) and storage will be put to work, powering critical AI computing tasks, including: 🔸Edge Inference: Running real-time AI predictions directly on your device without sending data to centralized servers. 🔸Hot LLM Models: Accelerating large language models for high-speed NLP tasks. 🔸Generative AI Models and More: Contributing to the training and inference of cutting-edge generative AI, like text-to-image models, deep learning, and more. More Contributions, Bigger Rewards Await! This Edge AI Computing feature allows us to leverage the full potential of decentralized computing power, reducing latency, increasing efficiency, and making AI more accessible. The more you contribute, the bigger the rewards!🔥 Stay in the Loop—Start Today with OptimAI Lite Node! While the OptimAI Core Node is still in the works, you don’t have to wait to join the action. The more you contribute, the greater the rewards! Let’s build a stronger, smarter, and more decentralized AI network together. Stay tuned for more exciting updates! 🔸Extension Node: 🔸Telegram Node: 🔸Register at: #DePIN

OptimAI Network

44,249 Aufrufe • vor 1 Jahr

For the first time, the latest LLMs run on the Apple Neural Engine — and NexaSDK is the only framework that makes it possible, powered by the NexaML engine. Last year, our two co-founders were invited by Apple DMLI team (Data & Machine Learning Innovation) to share their research about on-device multimodal model for local AI agents. One of the big questions in the room was: “Can the newest LLMs actually run on ANE?” At the time, nobody had a clear path. Today, that path exists. NexaSDK now runs Granite-4.0 (IBM), Qwen3 (Qwen), Gemma3 (Google), and Parakeet-v3 (NVIDIA) fully on Apple’s NPU — unlocking low-power, always-on, fast inference across Mac and iPhone. A new wave of NPU-first local AI apps is coming to Apple devices. Start with one line of code on Mac. iOS SDK coming soon.

For the first time, the latest LLMs run on the Apple Neural Engine — and NexaSDK is the only framework that makes it possible, powered by the NexaML engine. Last year, our two co-founders were invited by Apple DMLI team (Data & Machine Learning Innovation) to share their research about on-device multimodal model for local AI agents. One of the big questions in the room was: “Can the newest LLMs actually run on ANE?” At the time, nobody had a clear path. Today, that path exists. NexaSDK now runs Granite-4.0 (IBM), Qwen3 (Qwen), Gemma3 (Google), and Parakeet-v3 (NVIDIA) fully on Apple’s NPU — unlocking low-power, always-on, fast inference across Mac and iPhone. A new wave of NPU-first local AI apps is coming to Apple devices. Start with one line of code on Mac. iOS SDK coming soon.

NEXA AI

30,213 Aufrufe • vor 8 Monaten

🔱 Introducing Manta AI 🔱 In collaboration with Celestia, ORA, and Hyperbolic, we are excited to launch a comprehensive AI toolkit on #MantaPacific. Experience seamless training, deployment, and inference with our Universal Circuits, now enhanced with powerful AGI models like Stable Diffusion & Llama. 🌊 Dive into the future of AI on blockchain:

🔱 Introducing Manta AI 🔱 In collaboration with Celestia, ORA, and Hyperbolic, we are excited to launch a comprehensive AI toolkit on #MantaPacific. Experience seamless training, deployment, and inference with our Universal Circuits, now enhanced with powerful AGI models like Stable Diffusion & Llama. 🌊 Dive into the future of AI on blockchain:

Manta Network (🔱,🔱)

174,032 Aufrufe • vor 2 Jahren

i will die on this hill: Apple is a frontier AI company. they will inject AI into every place you scroll, type, read and listen imagine if you could “google” a past memory or ask siri to prove you’re right in a group chat ai models that run on-device with access to your entire life. the craziest part is the models don’t even need to be big! a 20B frontier model can run smoothly on apple’s chip architecture completely privately there are 3.5 billion apple devices, the gravitational pull this company has on societal culture is unmatched

i will die on this hill: Apple is a frontier AI company. they will inject AI into every place you scroll, type, read and listen imagine if you could “google” a past memory or ask siri to prove you’re right in a group chat ai models that run on-device with access to your entire life. the craziest part is the models don’t even need to be big! a 20B frontier model can run smoothly on apple’s chip architecture completely privately there are 3.5 billion apple devices, the gravitational pull this company has on societal culture is unmatched

Ejaaz

136,637 Aufrufe • vor 1 Monat

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

The Render Network

10,904 Aufrufe • vor 1 Jahr

"LM Arena is a cancer on AI. Labs have entire teams dedicated to hacking it." Edwin Chen (echen), CEO of Surge AI, on why the industry's favorite benchmark is broken and how Surge hit $1.2 billion in revenue without ever raising. Aravind Srinivas (Aravind Srinivas), CEO of Perplexity, on Apple's AI advantage, Claude Code economics, the endgame of coding, and Perplexity Computer. They join @jason on This Week in AI Episode 10: 00:00 Intro to Aravind Srinivas and Edwin Chen 05:25 Edwin on Surge: School for AGI 10:47 What Apple's next CEO should do 21:20 "The iPhone is not getting disrupted by AI" 23:55 Bootstrapping Surge past $1B without raising 30:58 Claude Code as a loss leader 33:30 Are we in the endgame for coding? 41:34 30% headcount growth, 5x revenue 50:29 "People don't buy models, they buy products" 58:00 "LM Arena is a cancer on AI" 1:05:41 Model Council and orchestrating frontier models Full episode on YT, Spotify, and Apple Podcasts below: Perplexity Surge AI

"LM Arena is a cancer on AI. Labs have entire teams dedicated to hacking it." Edwin Chen (echen), CEO of Surge AI, on why the industry's favorite benchmark is broken and how Surge hit $1.2 billion in revenue without ever raising. Aravind Srinivas (Aravind Srinivas), CEO of Perplexity, on Apple's AI advantage, Claude Code economics, the endgame of coding, and Perplexity Computer. They join @jason on This Week in AI Episode 10: 00:00 Intro to Aravind Srinivas and Edwin Chen 05:25 Edwin on Surge: School for AGI 10:47 What Apple's next CEO should do 21:20 "The iPhone is not getting disrupted by AI" 23:55 Bootstrapping Surge past $1B without raising 30:58 Claude Code as a loss leader 33:30 Are we in the endgame for coding? 41:34 30% headcount growth, 5x revenue 50:29 "People don't buy models, they buy products" 58:00 "LM Arena is a cancer on AI" 1:05:41 Model Council and orchestrating frontier models Full episode on YT, Spotify, and Apple Podcasts below: Perplexity Surge AI

This Week in AI

40,352 Aufrufe • vor 2 Monaten

1/3 Zesh AI Layer is an advanced AI solution on SUI, powered by a library of data models that act as its engine. Zesh layer is designed for building cutting-edge AI products, giving every project on Zesh access to its expansive and ever-evolving library of data models. As more products, users, and activity takes place in the Zesh ecosystem, the data model library continually learns and grows. This is AI that evolves with you.

1/3 Zesh AI Layer is an advanced AI solution on SUI, powered by a library of data models that act as its engine. Zesh layer is designed for building cutting-edge AI products, giving every project on Zesh access to its expansive and ever-evolving library of data models. As more products, users, and activity takes place in the Zesh ecosystem, the data model library continually learns and grows. This is AI that evolves with you.

Zesh AI Layer

1,044,803 Aufrufe • vor 1 Jahr

A completely open-source AI Wearable device like Avi’s Tab, Rewind’s pendant, and Humane’s Pin! Not only is it open-source, where you can own your data and switch between foundation models, but you can actually set it up today, not in a few months (oh, and it's cheaper!)

A completely open-source AI Wearable device like Avi’s Tab, Rewind’s pendant, and Humane’s Pin! Not only is it open-source, where you can own your data and switch between foundation models, but you can actually set it up today, not in a few months (oh, and it's cheaper!)

Adam

277,502 Aufrufe • vor 2 Jahren

🎉 For the past couple months, I've been keeping myself busy with something exciting — meet Najva! A free native macOS app that brings together on-device transcription and your favorite AI models, right from your menubar. 🧵👇

🎉 For the past couple months, I've been keeping myself busy with something exciting — meet Najva! A free native macOS app that brings together on-device transcription and your favorite AI models, right from your menubar. 🧵👇

Bardia Khosravi, MD

12,803 Aufrufe • vor 1 Jahr

Gavin explains that the bear case for AI capex spend is on-device inference: "In three years, on a bigger phone, you'll be able to run a pruned-down version of Gemini 5, Grok 4, or ChatGPT. And that's free. This is clearly Apple's strategy - we're going to make it privacy-safe and run on the phone. Other than scaling laws breaking, edge AI is by far the most plausible and scariest bear case."

Gavin explains that the bear case for AI capex spend is on-device inference: "In three years, on a bigger phone, you'll be able to run a pruned-down version of Gemini 5, Grok 4, or ChatGPT. And that's free. This is clearly Apple's strategy - we're going to make it privacy-safe and run on the phone. Other than scaling laws breaking, edge AI is by far the most plausible and scariest bear case."

Patrick OShaughnessy

516,795 Aufrufe • vor 7 Monaten

A look at the new Gab AI dashboard. Lightning fast. Every top AI model in one spot. All your chat history across all models in one spot. Create custom AI agents to be whatever you want. We absolutely cooked with this and have much more on the way. 👉

A look at the new Gab AI dashboard. Lightning fast. Every top AI model in one spot. All your chat history across all models in one spot. Create custom AI agents to be whatever you want. We absolutely cooked with this and have much more on the way. 👉

Andrew Torba

54,462 Aufrufe • vor 1 Jahr