Загрузка видео...

Не удалось загрузить видео

На главную

ServiceNow-AI/Apriel-1.5-15b-Thinker running on a single GPU using `transformers serve` 🔥 great to have some very nice reasoning models that can run locally! next step, trying it on mps 👀

LysandreJik's profile picture

Lysandre

12,117 subscribers

14,770 просмотров • 9 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

BOOM! STANFORD LAUNCHES FRAMEPACK A FREE OPEN SOURCE AI THAT CAN RUN ON 6 GB LAPTOP GPU TO GENERATE MINUTE LONG 30FPS VIDEO FROM SINGLE IMAGE. It is game changing…
0:19

BOOM! STANFORD LAUNCHES FRAMEPACK A FREE OPEN SOURCE AI THAT CAN RUN ON 6 GB LAPTOP GPU TO GENERATE MINUTE LONG 30FPS VIDEO FROM SINGLE IMAGE. It is game changing…

Brian Roemmele

534,742 просмотров • 1 год назад

Run Hunyuan3D TURBO Locally (NVIDIA GPU) These AI models are super fast indeed! Depending on machine (details in thread) it takes: - Mesh Generation: just 1~5sec - Mesh + Texture Generation: 30~100sec And now, the Hunyuan3D-GP gradio app supports them. Run on your PC!
0:11

Run Hunyuan3D TURBO Locally (NVIDIA GPU) These AI models are super fast indeed! Depending on machine (details in thread) it takes: - Mesh Generation: just 1~5sec - Mesh + Texture Generation: 30~100sec And now, the Hunyuan3D-GP gradio app supports them. Run on your PC!

cocktail peanut

61,163 просмотров • 1 год назад

wow.. ComfyUI's node canvas is crazy we can now generate image, video, audio, even 3D models locally on the AI canva and.. it has all the top AI models like FLUX, GPT image, Kling, Veo, Hunyuan3D and more step by step tutorial:
0:19

wow.. ComfyUI's node canvas is crazy we can now generate image, video, audio, even 3D models locally on the AI canva and.. it has all the top AI models like FLUX, GPT image, Kling, Veo, Hunyuan3D and more step by step tutorial:

el.cine

182,164 просмотров • 1 год назад

this is the worst local AI will ever be. tomorrow it gets faster. next month the models get smarter. next year your GPU runs what a data center runs today. Qwen3.5-35B-A3B on a single 3090. told it to visualize its own expert routing. 256 experts, 8 active per token, rendered in 3D on the same GPU running inference. no API key. no subscription. no permission needed. closed AI isn't losing ground. it's losing the argument.
0:17

this is the worst local AI will ever be. tomorrow it gets faster. next month the models get smarter. next year your GPU runs what a data center runs today. Qwen3.5-35B-A3B on a single 3090. told it to visualize its own expert routing. 256 experts, 8 active per token, rendered in 3D on the same GPU running inference. no API key. no subscription. no permission needed. closed AI isn't losing ground. it's losing the argument.

Sudo su

106,710 просмотров • 4 месяцев назад

The leading model runnable on a single cloud H100 GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇
0:16

The leading model runnable on a single cloud H100 GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇

Glenn Cameron Jr

81,427 просмотров • 1 год назад

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast
0:10

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast

Adrien Grondin

32,556 просмотров • 5 месяцев назад

Qwen has just released a model on par with GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level AI running offline on a laptop. - Fully open source - Only 3B active parameters - 262k context length natively Quick steps to run it on your machine and details below
0:15

Qwen has just released a model on par with GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level AI running offline on a laptop. - Fully open source - Only 3B active parameters - 262k context length natively Quick steps to run it on your machine and details below

Paul Couvert

503,787 просмотров • 11 месяцев назад

Wild that you can run a GPT-4 tier AI on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.
0:14

Wild that you can run a GPT-4 tier AI on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.

Aaron Ng

35,676 просмотров • 1 год назад

Google released Gemma 3 270M, a new model for hyper-efficient local AI! We'll fine-tune this model and make it very smart at playing chess and predict the next move. Tech stack: - Unsloth AI for efficient fine-tuning. - Hugging Face transformers to run it locally. Let's go! 🚀
0:11

Google released Gemma 3 270M, a new model for hyper-efficient local AI! We'll fine-tune this model and make it very smart at playing chess and predict the next move. Tech stack: - Unsloth AI for efficient fine-tuning. - Hugging Face transformers to run it locally. Let's go! 🚀

Akshay 🚀

145,644 просмотров • 10 месяцев назад

Pixel has always used AI to improve your photos. And now, thanks to the help of Gemini models, it can help you become a better photographer. Camera Coach analyzes a single frame of your scene, and gives you step-by-step instructions on taking a great photo¹ 📷 #MadeByGoogle
0:12

Pixel has always used AI to improve your photos. And now, thanks to the help of Gemini models, it can help you become a better photographer. Camera Coach analyzes a single frame of your scene, and gives you step-by-step instructions on taking a great photo¹ 📷 #MadeByGoogle

Made by Google

34,903 просмотров • 10 месяцев назад

3d world abilities of AI models keep getting better, this is @Kling_AI 1.5 It can move around a space in 3d and you can steer its camera movements All based on a single input image
0:10

3d world abilities of AI models keep getting better, this is @Kling_AI 1.5 It can move around a space in 3d and you can steer its camera movements All based on a single input image

@levelsio

112,201 просмотров • 1 год назад

Stanford dropped FramePack This AI can run on 6 GB laptop GPU to generate minute long 30fps video from single image No distillation, open source. 10 wild examples & how to try it: 👇
0:19

Stanford dropped FramePack This AI can run on 6 GB laptop GPU to generate minute long 30fps video from single image No distillation, open source. 10 wild examples & how to try it: 👇

Min Choi

633,607 просмотров • 1 год назад

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.
0:16

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.

Adrien Grondin

12,045 просмотров • 1 месяц назад

Ready to get started with visual generative AI? Look no further. Learn how to run image and video models locally on RTX GPUs using ComfyUI with LTX & BlackForestLabsAI - Unofficial FLUX in our blog below. 👇
0:10

Ready to get started with visual generative AI? Look no further. Learn how to run image and video models locally on RTX GPUs using ComfyUI with LTX & BlackForestLabsAI - Unofficial FLUX in our blog below. 👇

NVIDIA RTX Spark

1,238,456 просмотров • 5 месяцев назад

"I have developed two generators running 100% on ethanol, this proves that vehicle engines can also run on it." — Nitin Gadkari, Transport Minister
0:13

"I have developed two generators running 100% on ethanol, this proves that vehicle engines can also run on it." — Nitin Gadkari, Transport Minister

🚨Indian Gems

330,659 просмотров • 11 дней назад

SmallThinker 3B is one of the AI models I’d want backed up on my phone. Here’s it is reasoning at 12 tok/s on my phone. If you’re ever stuck offline, you’ll want a model that can think.
0:15

SmallThinker 3B is one of the AI models I’d want backed up on my phone. Here’s it is reasoning at 12 tok/s on my phone. If you’re ever stuck offline, you’ll want a model that can think.

Aaron Ng

35,858 просмотров • 1 год назад

⚡️Introducing Open LLM Server⚡️ Looking to run models like GPT4All or LLaMa locally, but tired of python-based UIs that are impossibly slow/clunky to install? Now with a single command you can be up and running in seconds! (Windows/Mac/Linux) Here's why this is a big deal:
0:12

⚡️Introducing Open LLM Server⚡️ Looking to run models like GPT4All or LLaMa locally, but tired of python-based UIs that are impossibly slow/clunky to install? Now with a single command you can be up and running in seconds! (Windows/Mac/Linux) Here's why this is a big deal:

dcSpark

16,499 просмотров • 3 лет назад