Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

BOOOM! Both VLMs and LLMs now have a baked-in http server w/ OpenAI spec compatible API in transformers Launch it with `transformers serve` and connect your favorite apps. Here I'm running Open WebUI with local transformers. LLM, VLM, tool calling is in, STT & TTS coming soon!

LysandreJik's profile picture

Lysandre

12,356 subscribers

16,290 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Up to 3x faster LLM generation with no extra resources/requirements - ngram speculation has landed in 🤗 transformers! 🏎️💨 All you need to do is to add `prompt_lookup_num_tokens=10` to your `generate` call and you'll get faster LLMs🔥 🧵How does it work?
0:10

Up to 3x faster LLM generation with no extra resources/requirements - ngram speculation has landed in 🤗 transformers! 🏎️💨 All you need to do is to add `prompt_lookup_num_tokens=10` to your `generate` call and you'll get faster LLMs🔥 🧵How does it work?

João Gante

107,778 Aufrufe • vor 2 Jahren

Depth Anything V2 is a total beast for real-time 3D. Built a website that hits 30fps+ depth reconstructions from a single camera feed, extruding 12k voxels via WebGPU. Pure ML running local Vision Transformers with Three.js and zero backend lag. Lmk in the comments if you want a copy! 🙌 Experience and music made with AI in Omma AI (tool by Spline).
0:15

Depth Anything V2 is a total beast for real-time 3D. Built a website that hits 30fps+ depth reconstructions from a single camera feed, extruding 12k voxels via WebGPU. Pure ML running local Vision Transformers with Three.js and zero backend lag. Lmk in the comments if you want a copy! 🙌 Experience and music made with AI in Omma AI (tool by Spline).

Gábor Pribék

142,337 Aufrufe • vor 4 Monaten

After months of work, and with the help of our awesome community, we're excited to finally share LM Studio 0.3.0! 🎉 🔥 What's new: - Built-in Chat with Documents, 100% offline - OpenAI-like 'Structured Outputs' API with any local model - Total UI revamp (with dark/light/sepia themes) - Load & serve multiple LLMs *on the local network* - Available in 7 languages! 🌎🌍🌏 - Download any supported model from Hugging Face - Update LLM runtimes (llama.cpp) separately from the app ... and tons more goodies! Let us know how you like it! 👾🤝
0:19

After months of work, and with the help of our awesome community, we're excited to finally share LM Studio 0.3.0! 🎉 🔥 What's new: - Built-in Chat with Documents, 100% offline - OpenAI-like 'Structured Outputs' API with any local model - Total UI revamp (with dark/light/sepia themes) - Load & serve multiple LLMs *on the local network* - Available in 7 languages! 🌎🌍🌏 - Download any supported model from Hugging Face - Update LLM runtimes (llama.cpp) separately from the app ... and tons more goodies! Let us know how you like it! 👾🤝

LM Studio

142,628 Aufrufe • vor 2 Jahren

Introducing Singularity AI Machines. One-click deployable GPUs with built-in LLMs. Deploy in one click, and within minutes you get an OpenAI-compatible API running high-speed inference on compute that stays under your control. You can literally deploy a machine and: 1. Apply to OpenRouter as a provider 2. Start your own AI business 3. Join Singularity Grid in one click without owning any hardware 4. Let AI agents launch and manage your machines for you Until now, becoming an AI provider felt like something only infra companies could do. We are making it accessible to literally everyone. Singularity AI Machines are live.
0:16

Introducing Singularity AI Machines. One-click deployable GPUs with built-in LLMs. Deploy in one click, and within minutes you get an OpenAI-compatible API running high-speed inference on compute that stays under your control. You can literally deploy a machine and: 1. Apply to OpenRouter as a provider 2. Start your own AI business 3. Join Singularity Grid in one click without owning any hardware 4. Let AI agents launch and manage your machines for you Until now, becoming an AI provider felt like something only infra companies could do. We are making it accessible to literally everyone. Singularity AI Machines are live.

The Singularity Layer

13,492 Aufrufe • vor 1 Monat

Claude Code is running on a remote server, along with the web app it just built. You’re on your phone. You can still open localhost:3000 in Safari or Chrome. Just create a local port forwarding rule in Termius and securely tunnel the remote port to your device. No public ports. No extra setup.
0:15

Claude Code is running on a remote server, along with the web app it just built. You’re on your phone. You can still open localhost:3000 in Safari or Chrome. Just create a local port forwarding rule in Termius and securely tunnel the remote port to your device. No public ports. No extra setup.

Termius

132,283 Aufrufe • vor 1 Monat

Alchemist AI 3.5 is here 🪄 Try it out now ▶️ ⚙️ Entirely rebuilt with a proprietary multi-agent engine ⚡️ Faster, smarter generations with real-time logic 🧠 16+ LLMs running in parallel across 8 orchestration layers 🎮 Build 3D games & apps live as you go Experience our flagship evolution and stay tuned for what's next!
0:18

Alchemist AI 3.5 is here 🪄 Try it out now ▶️ ⚙️ Entirely rebuilt with a proprietary multi-agent engine ⚡️ Faster, smarter generations with real-time logic 🧠 16+ LLMs running in parallel across 8 orchestration layers 🎮 Build 3D games & apps live as you go Experience our flagship evolution and stay tuned for what's next!

ALCHEMIST AI 🔮

102,935 Aufrufe • vor 1 Jahr

TrendTrack API & MCP are live Connect it to Claude, GPT, Gemini or any tool you already use. What you can pull : Winning ads before they saturate Scaling stores before everyone spots them Email campaigns from your competitors Hooks that are converting right now Everything you see on TrendTrack can now be extracted and processed by AI. How to use it ? API → integrate TrendTrack data directly into your tools, dashboards, or custom apps MCP → connect TrendTrack to any LLM. Claude, GPT, Gemini, Perplexity. Ask a question, it pulls the data itself, responds in real time Start building now →
0:17

TrendTrack API & MCP are live Connect it to Claude, GPT, Gemini or any tool you already use. What you can pull : Winning ads before they saturate Scaling stores before everyone spots them Email campaigns from your competitors Hooks that are converting right now Everything you see on TrendTrack can now be extracted and processed by AI. How to use it ? API → integrate TrendTrack data directly into your tools, dashboards, or custom apps MCP → connect TrendTrack to any LLM. Claude, GPT, Gemini, Perplexity. Ask a question, it pulls the data itself, responds in real time Start building now →

Trendtrack

177,020 Aufrufe • vor 4 Monaten

Having a platform where your favorite footballers have their own space to share training days, travels, behind the scenes moments, and everyday life. is the perfect platform, you can get it all in one. This is the universe for both football players and their fans. As a fan it’s a more personal experience to engage and connect with your favourite players and have a lovely and incredible journey beyond the pitch. ⚽️🔥
0:16

Having a platform where your favorite footballers have their own space to share training days, travels, behind the scenes moments, and everyday life. is the perfect platform, you can get it all in one. This is the universe for both football players and their fans. As a fan it’s a more personal experience to engage and connect with your favourite players and have a lovely and incredible journey beyond the pitch. ⚽️🔥

za’beth🎬

84,022 Aufrufe • vor 10 Tagen

most of you don't know how hard hermes agent is optimized for local AI at the system level. watch the full setup flow on screen. you paste an openai-compatible v1 endpoint, hermes auto-detects every model running behind it. doesn't matter if it's llama.cpp or vllm or any compatible server, all your models surface and become selectable in seconds. no config gymnastics, no manual model list. then it goes deeper. hermes ships with per model parsers, prompt template auto-handling, tool call format detection per model architecture, thinking mode awareness, all the small friction points other harnesses leak on. these were not built for cloud apis with one canonical model. they were built for builders running 10 different local models across 10 different stacks. cloud first harnesses bolt local support on top. hermes agent is local first from the architecture out. that's the system level gap. if you're getting started on local AI, this is the harness you start with. try for yourself and find out. anyone serious about local AI lands here eventually.
0:15

most of you don't know how hard hermes agent is optimized for local AI at the system level. watch the full setup flow on screen. you paste an openai-compatible v1 endpoint, hermes auto-detects every model running behind it. doesn't matter if it's llama.cpp or vllm or any compatible server, all your models surface and become selectable in seconds. no config gymnastics, no manual model list. then it goes deeper. hermes ships with per model parsers, prompt template auto-handling, tool call format detection per model architecture, thinking mode awareness, all the small friction points other harnesses leak on. these were not built for cloud apis with one canonical model. they were built for builders running 10 different local models across 10 different stacks. cloud first harnesses bolt local support on top. hermes agent is local first from the architecture out. that's the system level gap. if you're getting started on local AI, this is the harness you start with. try for yourself and find out. anyone serious about local AI lands here eventually.

Sudo su

14,407 Aufrufe • vor 3 Monaten

Grok 4.5 is now in Codex now too. No API key, no billing setup, no config file. If you have X Premium, you sign in with your X account and Grok 4.5 runs inside your Codex. OAuth handles it. Your subscription is your access. That's it. And Grok 4.5 just got a lot better, so if you already pay for X Premium, you can now run it in Codex for free.
0:12

Grok 4.5 is now in Codex now too. No API key, no billing setup, no config file. If you have X Premium, you sign in with your X account and Grok 4.5 runs inside your Codex. OAuth handles it. Your subscription is your access. That's it. And Grok 4.5 just got a lot better, so if you already pay for X Premium, you can now run it in Codex for free.

Ziwen

110,952 Aufrufe • vor 1 Monat

GEMMA 4 26B ON AN RTX 4060 WITH A 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓
0:19

GEMMA 4 26B ON AN RTX 4060 WITH A 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓

leopardracer

56,772 Aufrufe • vor 2 Monaten

🚨 I'm glad to announce is expanding to Middle East! 🚨 We are bringing over TWO servers: • Open server for all skill levels running DAILY competitive ladders with leaderboards • Private server with no zone rules and our advanced drop map system technology with a set lobby based on skill level. - Fortnitetracker Leaderboard Integration in to see all live leaderboards of daily scrims/ladders. • Proper rank system ranking players based on FNCS/CashCup/Power Rankings Join now! Open Server: Private Server:
0:18

🚨 I'm glad to announce is expanding to Middle East! 🚨 We are bringing over TWO servers: • Open server for all skill levels running DAILY competitive ladders with leaderboards • Private server with no zone rules and our advanced drop map system technology with a set lobby based on skill level. - Fortnitetracker Leaderboard Integration in to see all live leaderboards of daily scrims/ladders. • Proper rank system ranking players based on FNCS/CashCup/Power Rankings Join now! Open Server: Private Server:

Manu

133,705 Aufrufe • vor 3 Jahren

someone just open-sourced their own neuro-sama. and it might be better than the original. it's called airi. a fully autonomous ai companion that talks to you in real time, plays minecraft and factorio with you, chats on discord and telegram, and has a live2d/vrm avatar body. runs entirely on your machine. → real-time voice conversations, speech recognition → animated avatar with auto-blink, eye tracking, idle animations → persistent memory across sessions → local inference via webgpu, no api calls needed supports 30+ llm providers, openai, claude, gemini, deepseek, ollama, groq, mistral, xai, local models. swap the brain with a config change. runs on native cuda and apple metal for real gpu acceleration. 17.5k stars. 101 contributors. 46 releases. 100% free. open source.
0:11

someone just open-sourced their own neuro-sama. and it might be better than the original. it's called airi. a fully autonomous ai companion that talks to you in real time, plays minecraft and factorio with you, chats on discord and telegram, and has a live2d/vrm avatar body. runs entirely on your machine. → real-time voice conversations, speech recognition → animated avatar with auto-blink, eye tracking, idle animations → persistent memory across sessions → local inference via webgpu, no api calls needed supports 30+ llm providers, openai, claude, gemini, deepseek, ollama, groq, mistral, xai, local models. swap the brain with a config change. runs on native cuda and apple metal for real gpu acceleration. 17.5k stars. 101 contributors. 46 releases. 100% free. open source.

Oliver Prompts

286,743 Aufrufe • vor 1 Monat

Our open-source RAG app, Verba, can now run Ollama models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!
0:15

Our open-source RAG app, Verba, can now run Ollama models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!

Edward

125,582 Aufrufe • vor 2 Jahren

USDCx on Movement is now available via Circle xReserve, a USDC-backed stablecoin with seamless access to crosschain USDC liquidity. With USDCx, users can use it for near-zero-fee payments and remittances, RWA access, and robust DeFi-compatible crosschain liquidity. Key benefits: → USDCx is 1:1 backed by USDC held in xReserve → Trust minimized with no third-party bridges required → Fully interoperable with both USDC and USDCx across supported chains Supported at launch by Movement apps: Avalon Labs, Canopy, Echelon, Fireblocks, LayerBank, Matrix.fun, Meridian, Mosaic, MPCVault | crypto banking for institutions, Nightly, and YUZU 🍋. Learn more:
0:15

USDCx on Movement is now available via Circle xReserve, a USDC-backed stablecoin with seamless access to crosschain USDC liquidity. With USDCx, users can use it for near-zero-fee payments and remittances, RWA access, and robust DeFi-compatible crosschain liquidity. Key benefits: → USDCx is 1:1 backed by USDC held in xReserve → Trust minimized with no third-party bridges required → Fully interoperable with both USDC and USDCx across supported chains Supported at launch by Movement apps: Avalon Labs, Canopy, Echelon, Fireblocks, LayerBank, Matrix.fun, Meridian, Mosaic, MPCVault | crypto banking for institutions, Nightly, and YUZU 🍋. Learn more:

Circle

27,146 Aufrufe • vor 5 Monaten

💻 Agent mode just went local! Today, Mistral AI released Devstral, an Apache-2.0, 24B-parameter model trained for tool calling in real-world software development environments It reached #1 on SWE-bench for open-source models, but more importantly in our real-world testing it has proven to be capable of navigating and autonomously editing codebases, while running entirely on a laptop To try it out, just add `ollama/devstral` in Continue. See below for a quickstart with ollama👇
0:18

💻 Agent mode just went local! Today, Mistral AI released Devstral, an Apache-2.0, 24B-parameter model trained for tool calling in real-world software development environments It reached #1 on SWE-bench for open-source models, but more importantly in our real-world testing it has proven to be capable of navigating and autonomously editing codebases, while running entirely on a laptop To try it out, just add `ollama/devstral` in Continue. See below for a quickstart with ollama👇

Continue

39,217 Aufrufe • vor 1 Jahr

CHINA JUST LEAKED THE FUTURE OF WEB APPS. Alibaba open-sourced PageAgent and 99% of SaaS founders are sleeping on this. It's a JavaScript AI agent that lives INSIDE your webpage. Users control your entire interface with natural language. ↳ No browser extensions needed, screenshots or multi-modal LLMs, headless browser setup, and also no backend rewrite required Just drop it in your HTML with ONE line of code. What took 20 clicks now takes one sentence. "Click login, fill in my credentials, submit the form" Done. This is not a demo, it is production-ready. ↳ Turn any SaaS into an AI copilot in minutes ↳ Smart form filling for ERP, CRM, admin systems ↳ Voice commands and accessibility built in ↳ Multi-page agent tasks via Chrome extension ↳ MCP server support for external control ↳ Bring your own LLM (Qwen, GPT, Claude, anything) Every founder building AI features just got a shortcut. Every developer manually building copilots just got replaced. The integration looks like this: That's it. Your app now has an AI agent.
0:17

CHINA JUST LEAKED THE FUTURE OF WEB APPS. Alibaba open-sourced PageAgent and 99% of SaaS founders are sleeping on this. It's a JavaScript AI agent that lives INSIDE your webpage. Users control your entire interface with natural language. ↳ No browser extensions needed, screenshots or multi-modal LLMs, headless browser setup, and also no backend rewrite required Just drop it in your HTML with ONE line of code. What took 20 clicks now takes one sentence. "Click login, fill in my credentials, submit the form" Done. This is not a demo, it is production-ready. ↳ Turn any SaaS into an AI copilot in minutes ↳ Smart form filling for ERP, CRM, admin systems ↳ Voice commands and accessibility built in ↳ Multi-page agent tasks via Chrome extension ↳ MCP server support for external control ↳ Bring your own LLM (Qwen, GPT, Claude, anything) Every founder building AI features just got a shortcut. Every developer manually building copilots just got replaced. The integration looks like this: That's it. Your app now has an AI agent.

Kanika

332,703 Aufrufe • vor 2 Monaten

This is huge. (And we don't just throw that around.) Starlight Mini—with local rendering—just launched in Video AI 7. That means no pay-per-render. No cloud. Just pure and powerful Starlight video upscaling and enhancing—right on your machine. It's available locally for high-powered Windows + NVIDIA systems for now, with more coming soon. Or, you can access it in the cloud for 3x cheaper than Starlight. Comment an old, low-res video of your own below and if selected, we'll run it in Starlight Mini.
0:14

This is huge. (And we don't just throw that around.) Starlight Mini—with local rendering—just launched in Video AI 7. That means no pay-per-render. No cloud. Just pure and powerful Starlight video upscaling and enhancing—right on your machine. It's available locally for high-powered Windows + NVIDIA systems for now, with more coming soon. Or, you can access it in the cloud for 3x cheaper than Starlight. Comment an old, low-res video of your own below and if selected, we'll run it in Starlight Mini.

Topaz Labs

40,404 Aufrufe • vor 1 Jahr