Loading video...

Video Failed to Load

Go Home

ServiceNow-AI/Apriel-1.5-15b-Thinker running on a single GPU using `transformers serve` 🔥 great to have some very nice reasoning models that can run locally! next step, trying it on mps 👀

LysandreJik's profile picture

Lysandre

12,117 subscribers

14,770 views • 9 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

BOOM! STANFORD LAUNCHES FRAMEPACK A FREE OPEN SOURCE AI THAT CAN RUN ON 6 GB LAPTOP GPU TO GENERATE MINUTE LONG 30FPS VIDEO FROM SINGLE IMAGE. It is game changing…
0:19

BOOM! STANFORD LAUNCHES FRAMEPACK A FREE OPEN SOURCE AI THAT CAN RUN ON 6 GB LAPTOP GPU TO GENERATE MINUTE LONG 30FPS VIDEO FROM SINGLE IMAGE. It is game changing…

Brian Roemmele

534,742 views • 1 year ago

Run Hunyuan3D TURBO Locally (NVIDIA GPU) These AI models are super fast indeed! Depending on machine (details in thread) it takes: - Mesh Generation: just 1~5sec - Mesh + Texture Generation: 30~100sec And now, the Hunyuan3D-GP gradio app supports them. Run on your PC!
0:11

Run Hunyuan3D TURBO Locally (NVIDIA GPU) These AI models are super fast indeed! Depending on machine (details in thread) it takes: - Mesh Generation: just 1~5sec - Mesh + Texture Generation: 30~100sec And now, the Hunyuan3D-GP gradio app supports them. Run on your PC!

cocktail peanut

61,163 views • 1 year ago

wow.. ComfyUI's node canvas is crazy we can now generate image, video, audio, even 3D models locally on the AI canva and.. it has all the top AI models like FLUX, GPT image, Kling, Veo, Hunyuan3D and more step by step tutorial:
0:19

wow.. ComfyUI's node canvas is crazy we can now generate image, video, audio, even 3D models locally on the AI canva and.. it has all the top AI models like FLUX, GPT image, Kling, Veo, Hunyuan3D and more step by step tutorial:

el.cine

182,164 views • 1 year ago

this is the worst local AI will ever be. tomorrow it gets faster. next month the models get smarter. next year your GPU runs what a data center runs today. Qwen3.5-35B-A3B on a single 3090. told it to visualize its own expert routing. 256 experts, 8 active per token, rendered in 3D on the same GPU running inference. no API key. no subscription. no permission needed. closed AI isn't losing ground. it's losing the argument.
0:17

this is the worst local AI will ever be. tomorrow it gets faster. next month the models get smarter. next year your GPU runs what a data center runs today. Qwen3.5-35B-A3B on a single 3090. told it to visualize its own expert routing. 256 experts, 8 active per token, rendered in 3D on the same GPU running inference. no API key. no subscription. no permission needed. closed AI isn't losing ground. it's losing the argument.

Sudo su

106,710 views • 4 months ago

The leading model runnable on a single cloud H100 GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇
0:16

The leading model runnable on a single cloud H100 GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇

Glenn Cameron Jr

81,427 views • 1 year ago

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast
0:10

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast

Adrien Grondin

32,556 views • 5 months ago

Qwen has just released a model on par with GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level AI running offline on a laptop. - Fully open source - Only 3B active parameters - 262k context length natively Quick steps to run it on your machine and details below
0:15

Qwen has just released a model on par with GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level AI running offline on a laptop. - Fully open source - Only 3B active parameters - 262k context length natively Quick steps to run it on your machine and details below

Paul Couvert

503,787 views • 11 months ago

Wild that you can run a GPT-4 tier AI on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.
0:14

Wild that you can run a GPT-4 tier AI on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.

Aaron Ng

35,676 views • 1 year ago

Google released Gemma 3 270M, a new model for hyper-efficient local AI! We'll fine-tune this model and make it very smart at playing chess and predict the next move. Tech stack: - Unsloth AI for efficient fine-tuning. - Hugging Face transformers to run it locally. Let's go! 🚀
0:11

Google released Gemma 3 270M, a new model for hyper-efficient local AI! We'll fine-tune this model and make it very smart at playing chess and predict the next move. Tech stack: - Unsloth AI for efficient fine-tuning. - Hugging Face transformers to run it locally. Let's go! 🚀

Akshay 🚀

145,644 views • 10 months ago

Pixel has always used AI to improve your photos. And now, thanks to the help of Gemini models, it can help you become a better photographer. Camera Coach analyzes a single frame of your scene, and gives you step-by-step instructions on taking a great photo¹ 📷 #MadeByGoogle
0:12

Pixel has always used AI to improve your photos. And now, thanks to the help of Gemini models, it can help you become a better photographer. Camera Coach analyzes a single frame of your scene, and gives you step-by-step instructions on taking a great photo¹ 📷 #MadeByGoogle

Made by Google

34,903 views • 10 months ago

3d world abilities of AI models keep getting better, this is @Kling_AI 1.5 It can move around a space in 3d and you can steer its camera movements All based on a single input image
0:10

3d world abilities of AI models keep getting better, this is @Kling_AI 1.5 It can move around a space in 3d and you can steer its camera movements All based on a single input image

@levelsio

112,201 views • 1 year ago

Stanford dropped FramePack This AI can run on 6 GB laptop GPU to generate minute long 30fps video from single image No distillation, open source. 10 wild examples & how to try it: 👇
0:19

Stanford dropped FramePack This AI can run on 6 GB laptop GPU to generate minute long 30fps video from single image No distillation, open source. 10 wild examples & how to try it: 👇

Min Choi

633,607 views • 1 year ago

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.
0:16

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.

Adrien Grondin

12,045 views • 1 month ago

Ready to get started with visual generative AI? Look no further. Learn how to run image and video models locally on RTX GPUs using ComfyUI with LTX & BlackForestLabsAI - Unofficial FLUX in our blog below. 👇
0:10

Ready to get started with visual generative AI? Look no further. Learn how to run image and video models locally on RTX GPUs using ComfyUI with LTX & BlackForestLabsAI - Unofficial FLUX in our blog below. 👇

NVIDIA RTX Spark

1,238,456 views • 5 months ago

"I have developed two generators running 100% on ethanol, this proves that vehicle engines can also run on it." — Nitin Gadkari, Transport Minister
0:13

"I have developed two generators running 100% on ethanol, this proves that vehicle engines can also run on it." — Nitin Gadkari, Transport Minister

🚨Indian Gems

330,659 views • 11 days ago

SmallThinker 3B is one of the AI models I’d want backed up on my phone. Here’s it is reasoning at 12 tok/s on my phone. If you’re ever stuck offline, you’ll want a model that can think.
0:15

SmallThinker 3B is one of the AI models I’d want backed up on my phone. Here’s it is reasoning at 12 tok/s on my phone. If you’re ever stuck offline, you’ll want a model that can think.

Aaron Ng

35,858 views • 1 year ago

⚡️Introducing Open LLM Server⚡️ Looking to run models like GPT4All or LLaMa locally, but tired of python-based UIs that are impossibly slow/clunky to install? Now with a single command you can be up and running in seconds! (Windows/Mac/Linux) Here's why this is a big deal:
0:12

⚡️Introducing Open LLM Server⚡️ Looking to run models like GPT4All or LLaMa locally, but tired of python-based UIs that are impossibly slow/clunky to install? Now with a single command you can be up and running in seconds! (Windows/Mac/Linux) Here's why this is a big deal:

dcSpark

16,499 views • 3 years ago