Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Modern Java Project : a Spring Boot wrapper for from Alfonso² Peterssen supporting OpenAI Chat Completion REST requests 🔥 #OpenAI #SpringBoot

Stephan Janssen ☕️🧠🧞‍♂️

9,530 subscribers

12,117 views • 1 year ago •via X (Twitter)

Science & Technology News & Politics Education #OpenAI #SpringBoot

Anya Rossi• Live Now

Private livecam show

6 Comments

Stephan Janssen ☕️🧠🧞‍♂️1 year ago

As a result I can now use @DevoxxGenie with a pure Java Arm Inference engine running locally on my mac using Llama 3.2 🍏🔥

Stephan Janssen ☕️🧠🧞‍♂️1 year ago

Next possible steps: 🔺 MatMul on GPU using @tornadovm 🔺 GraalVM native version 🔺 Create Java Flame graph to see where performance issue's are located (matmul 🔥) ⁉️ LLM Sharding (any takers?) 🤩 ⁉️ BitNet * Ternary model support

Georgios Andrianakis1 year ago

@java @TheMukel Nice! I was planning on adding a Quarkus module so you just reminded me to create an issue:

Stephan Janssen ☕️🧠🧞‍♂️1 year ago

@java @TheMukel Great, the goal is to have a Modern & Fast Java Inference engine🔥#WhatEverItTakes

Danny Ki1 year ago

@java @TheMukel How do tools shape the boundaries of creativity?

Castani1 year ago

@java @TheMukel :)

Related Videos

I use AI to build mobile apps. Built a React Native chat app during my Twitch livestream two months ago, leveraging Cursor, OpenAI, and Expo. I demonstrated how to build a mobile app from scratch using AI, integrating OpenAI APIs to power the chat completion feature. Source code is in my github Full livestream replay here (6 hours) Cursor OpenAI Expo

I use AI to build mobile apps. Built a React Native chat app during my Twitch livestream two months ago, leveraging Cursor, OpenAI, and Expo. I demonstrated how to build a mobile app from scratch using AI, integrating OpenAI APIs to power the chat completion feature. Source code is in my github Full livestream replay here (6 hours) Cursor OpenAI Expo

Melvin Vivas

26,178 views • 1 year ago

Spring: The Documentary arrives 7th May! 🍃 Spring didn’t start as a framework, it started as a reaction to complexity in enterprise Java. What followed was a movement that redefined how modern applications are built, from Spring Boot to the cloud era. This is the story behind one of the most influential technologies in software.

Spring: The Documentary arrives 7th May! 🍃 Spring didn’t start as a framework, it started as a reaction to complexity in enterprise Java. What followed was a movement that redefined how modern applications are built, from Spring Boot to the cloud era. This is the story behind one of the most influential technologies in software.

Cult.Repo

17,382 views • 5 months ago

$A crypto project actually trained a 72B parameter AI model from scratch using decentralized GPU compute. Not fine-tuned, not a wrapper: trained from zero. The model benchmarks competitively against Meta's LLaMA 3 on reasoning tasks, and the entire training run cost a fraction of what centralized labs spend. If decentralized compute can produce frontier-class models, the moat around OpenAI and Anthropic is thinner than people think.$

A crypto project actually trained a 72B parameter AI model from scratch using decentralized GPU compute. Not fine-tuned, not a wrapper: trained from zero. The model benchmarks competitively against Meta's LLaMA 3 on reasoning tasks, and the entire training run cost a fraction of what centralized labs spend. If decentralized compute can produce frontier-class models, the moat around OpenAI and Anthropic is thinner than people think.

VirtualBacon

40,647 views • 5 months ago

JUST IN 🚨 A new OS where you can chat with 100K+ agents in the same chat to augment your creative flow and get rewarded for contributing feedback including models from xAI, OpenAI, Deepseek, Anthropic, DeepMind, Qwen, Flux.1 and many more. 👉 👉 members.

JUST IN 🚨 A new OS where you can chat with 100K+ agents in the same chat to augment your creative flow and get rewarded for contributing feedback including models from xAI, OpenAI, Deepseek, Anthropic, DeepMind, Qwen, Flux.1 and many more. 👉 👉 members.

Newcoin

38,902 views • 1 year ago

Woo hoo! OpenAI highlights HubSpot partnership on main stage at #DevDay. Today was a special day for me. Was so cool to see Sam Altman from OpenAI feature HubSpot from the main keynote stage at their Dev Day event. HubSpot and OpenAI are the two most impactful companies in my life. HubSpot, for obvious reasons and OpenAI for less obvious ones. My relationship with Sam and OpenAI goes back a bit: 1) Got access to the GPT-2 API so had my "moment of magic" well before ChatGPT launched. 2) Have been using OpenAI's APIs and platform to build apps and agents for years. They *really* understand developers and have an amazing dev experience. 3) Sold the chat .com domain name to them and as a result was able to become an investor in the company. 4) They're the primary AI platform that HubSpot partners with and builds with -- as highlighted today. My congrats to the entire OpenAI team for today's event. I know how much work goes into putting together an event like this. And it was clear from the vibes how much you folks *care*. Cheers.

Woo hoo! OpenAI highlights HubSpot partnership on main stage at #DevDay. Today was a special day for me. Was so cool to see Sam Altman from OpenAI feature HubSpot from the main keynote stage at their Dev Day event. HubSpot and OpenAI are the two most impactful companies in my life. HubSpot, for obvious reasons and OpenAI for less obvious ones. My relationship with Sam and OpenAI goes back a bit: 1) Got access to the GPT-2 API so had my "moment of magic" well before ChatGPT launched. 2) Have been using OpenAI's APIs and platform to build apps and agents for years. They really understand developers and have an amazing dev experience. 3) Sold the chat .com domain name to them and as a result was able to become an investor in the company. 4) They're the primary AI platform that HubSpot partners with and builds with -- as highlighted today. My congrats to the entire OpenAI team for today's event. I know how much work goes into putting together an event like this. And it was clear from the vibes how much you folks care. Cheers.

dharmesh

57,952 views • 11 months ago

OPENAI 👀: ChatGPT got a bunch of updates recently. Users can now automatically generate quizzes from the chat, search for reservations, add Google Drive files to the ChatGPT Library, and get better suggestions on the home page (paid plans only). h/t Adam Fry

Sensitive content

OPENAI 👀: ChatGPT got a bunch of updates recently. Users can now automatically generate quizzes from the chat, search for reservations, add Google Drive files to the ChatGPT Library, and get better suggestions on the home page (paid plans only). h/t Adam Fry

🚨 AI News | TestingCatalog

57,195 views • 1 month ago

OpenAI saga in 90 seconds: - Thursday night, Sam Altman gets a text from Ilya Sutskever, OpenAI’s chief scientist & board member asking to chat on Friday. - Friday at Noon, Sam Altman is fired by the Open AI board because he was “not consistently candid in his communications.” - CTO Mira Murati is made Interim CEO. - Microsoft, OpenAI’s largest investor, found out about the move 1 minute before the announcement. Their stock gets crushed. - Right after, Greg Brockman, OpenAI’s President is asked to chat, where he’s told he’s removed from the board but retaining his role. - Greg resigns from OpenAI in solidarity with Sam Altman shortly after. - Tech news & twitter subsequently blow the f*ck up. - Sam Altman fires off a few tweets saying how grateful he was for openAI and the people and how he’d have more things to say soon. - OpenAI employees start tweeting hearts supposedly a signal to the board of who would leave OpenAI to follow Sam Altman if the decision was kept. - By Saturday, rumors start that the OpenAI board is in discussions to bring Sam Altman back as CEO. - Sam Altman tweets out a picture of him wearing a guest pass at OpenAI HQ. - Microsoft & Satya Nadella lead the charge to negotiate with the board. - Board negotiation ends with Altman officially being out on Sunday night & employees streaming out of the office. - Monday morning Twitch cofounder Emmett Shear is named interim CEO. - Around the same time, Satya Nadella announces that Sam is joining Microsoft as the CEO of a new AI research group & former OpenAI leaders like Greg Brockman are joining him. - Still Monday Morning, OpenAI employees share a letter with the board where 650 of 700 employees tell the board to resign.

OpenAI saga in 90 seconds: - Thursday night, Sam Altman gets a text from Ilya Sutskever, OpenAI’s chief scientist & board member asking to chat on Friday. - Friday at Noon, Sam Altman is fired by the Open AI board because he was “not consistently candid in his communications.” - CTO Mira Murati is made Interim CEO. - Microsoft, OpenAI’s largest investor, found out about the move 1 minute before the announcement. Their stock gets crushed. - Right after, Greg Brockman, OpenAI’s President is asked to chat, where he’s told he’s removed from the board but retaining his role. - Greg resigns from OpenAI in solidarity with Sam Altman shortly after. - Tech news & twitter subsequently blow the f*ck up. - Sam Altman fires off a few tweets saying how grateful he was for openAI and the people and how he’d have more things to say soon. - OpenAI employees start tweeting hearts supposedly a signal to the board of who would leave OpenAI to follow Sam Altman if the decision was kept. - By Saturday, rumors start that the OpenAI board is in discussions to bring Sam Altman back as CEO. - Sam Altman tweets out a picture of him wearing a guest pass at OpenAI HQ. - Microsoft & Satya Nadella lead the charge to negotiate with the board. - Board negotiation ends with Altman officially being out on Sunday night & employees streaming out of the office. - Monday morning Twitch cofounder Emmett Shear is named interim CEO. - Around the same time, Satya Nadella announces that Sam is joining Microsoft as the CEO of a new AI research group & former OpenAI leaders like Greg Brockman are joining him. - Still Monday Morning, OpenAI employees share a letter with the board where 650 of 700 employees tell the board to resign.

Alex Lieberman

957,573 views • 2 years ago

🔻My First GPT-4 Project 🔻 I can chat with thousands of pages fast and affordably. How? Let's try with the latest World Economic Forum report (2023 April) Built with OpenAI, Pinecone and 1. Upload the PDF and divide its text into chunks. 2. Store the embeddings in your VectorStore. 3. Connect your Chat GPT-4 and restrict it to providing answers solely from the given document. It's truly a game-changer for a no-coder.

🔻My First GPT-4 Project 🔻 I can chat with thousands of pages fast and affordably. How? Let's try with the latest World Economic Forum report (2023 April) Built with OpenAI, Pinecone and 1. Upload the PDF and divide its text into chunks. 2. Store the embeddings in your VectorStore. 3. Connect your Chat GPT-4 and restrict it to providing answers solely from the given document. It's truly a game-changer for a no-coder.

Muratcan Koylan

492,654 views • 3 years ago

We build a Skill.md for it🔥 OpenAI Developers #Codex + #GPT-5.5 + #Hyper3D Rodin: one-click animated game assets. (This track looks goofy 😂 Try our Skill in any Coding Agent, interactive #3D Asset from image/text ⬇️

We build a Skill.md for it🔥 OpenAI Developers #Codex + #GPT-5.5 + #Hyper3D Rodin: one-click animated game assets. (This track looks goofy 😂 Try our Skill in any Coding Agent, interactive #3D Asset from image/text ⬇️

Hyper3D by Deemos

23,641 views • 5 months ago

New open source project: Easel, a macOS workspace for AI-assisted product design and frontend iteration powered by the Codex SDK. Think of it as "Claude Design for Codex." It brings together a local project library, design-system setup, Codex chat, and a live web preview with a point-and-click inspector. Set up your design system however you like. Import one from Figma , bring your own, or have the agent generate it as a design.md. Then use it to build prototypes and slide decks. Codex-first, with Claude and other AI providers and local models planned for future releases. OpenAI Developers

New open source project: Easel, a macOS workspace for AI-assisted product design and frontend iteration powered by the Codex SDK. Think of it as "Claude Design for Codex." It brings together a local project library, design-system setup, Codex chat, and a live web preview with a point-and-click inspector. Set up your design system however you like. Import one from Figma , bring your own, or have the agent generate it as a design.md. Then use it to build prototypes and slide decks. Codex-first, with Claude and other AI providers and local models planned for future releases. OpenAI Developers

James Rochabrun

61,608 views • 3 months ago

NVIDIA built the best free AI API platform and nobody's talking about it. 100+ models and no credit card need and best thing is credits don't expire. Meta, Google, DeepSeek, Microsoft all in one place. I was looking for a free reasoning model API for a project and everything was paywalled. Then I found → Pick your model (chat, code, vision, reasoning it's all there) → Click "View Code" → Generate API key → Drop it in your project OpenAI-compatible endpoints with zero billing setup.

NVIDIA built the best free AI API platform and nobody's talking about it. 100+ models and no credit card need and best thing is credits don't expire. Meta, Google, DeepSeek, Microsoft all in one place. I was looking for a free reasoning model API for a project and everything was paywalled. Then I found → Pick your model (chat, code, vision, reasoning it's all there) → Click "View Code" → Generate API key → Drop it in your project OpenAI-compatible endpoints with zero billing setup.

Hasan Toor

18,499 views • 3 months ago

New AI Podcast 🔥 | Lukasz Kaiser OpenAI Today is a very special day for us. We have Lukasz Kaiser, Lead Researcher at OpenAI, on our AI podcast, one of the co-creators of the Transformers and the groundbreaking paper “Attention Is All You Need” that started it all. We could easily say he is one of the creators of modern artificial intelligence. It was a true pleasure to talk with one of the brightest minds in the world of AI. Link pinned in the comments below. Thanks Lukasz Kaiser

New AI Podcast 🔥 | Lukasz Kaiser OpenAI Today is a very special day for us. We have Lukasz Kaiser, Lead Researcher at OpenAI, on our AI podcast, one of the co-creators of the Transformers and the groundbreaking paper “Attention Is All You Need” that started it all. We could easily say he is one of the creators of modern artificial intelligence. It was a true pleasure to talk with one of the brightest minds in the world of AI. Link pinned in the comments below. Thanks Lukasz Kaiser

Jon Hernandez

98,966 views • 11 months ago

Google just STOLE Apple away from OpenAI... And it might decide who wins the AI race. Apple announced a multi-year $1 billion deal with Google to power the next generation of Siri using Gemini AI. Not ChatGPT. Gemini. This is the same Apple that 18 months ago announced a partnership with OpenAI to integrate ChatGPT into iPhones. Everyone thought that meant OpenAI won. Turns out it was an audition. And OpenAI failed. Here's why: June 2024: Apple announces OpenAI partnership. Sam Altman tweets: "very happy to be partnering with apple." Media declares OpenAI the winner of the AI race. December 2025: Sam Altman issues "code red" at OpenAI. Tells everyone to pause everything and ship ChatGPT 5.2 faster. Why the panic? Google released Gemini 3 and it was actually good. January 2026: Apple picks Google. ChatGPT stays as an "optional feature" for complicated queries. But Gemini becomes the DEFAULT intelligence layer for 2 billion Apple devices. The financial reality: Apple pays OpenAI $0 But Apple pays Google $1 BILLION per year That's a verdict. The excuse OpenAI gave for why they did it for free was "exposure to millions of iPhone users." Which basically means "we couldn't negotiate worth shit." Meanwhile Google walked away with both the money AND the distribution. Why Google won: Infrastructure ownership. OpenAI runs on Microsoft's Azure cloud. That creates a dependency chain: Apple → OpenAI → Microsoft. 3 companies. 3 points of failure. Google owns its entire stack. One relationship. Zero middlemen. Apple's statement said Google's technology provides "the most capable foundation." Not "most innovative." Not "best partner." Most CAPABLE. In other words, OpenAI's tech couldn't handle the scale. The Alphabet boost: Google's stock hit $4 trillion market cap after the announcement. Up 65% in 2024 on AI momentum alone. This deal validates Google's pivot from "search company" to "AI infrastructure company." Now they power Samsung's Galaxy AI AND Apple's Siri. Billions of mobile devices running on Gemini. OpenAI's big problem here: Still no profit. Ever. Anthropic is stealing enterprise customers. DeepSeek launched a price war forcing ChatGPT to cut prices. GPT-5 was overhyped and underwhelming. Circular financing deals are getting scrutinized. And now Apple just downgraded them from partner to backup option. That "code red" in December? Too little, too late. The reality everyone's missing: This isn't about chatbot quality. It's about who owns the infrastructure to power billions of devices. Google proved it with Samsung. Now Apple. OpenAI proved it can build a viral product but can't scale it profitably. Very different skill sets. Elon called it "unreasonable concentration of power for Google." He's right. But that's exactly why Apple chose them. Apple doesn't want a startup partner. They want a utility provider. Google is now the default AI for Android AND iOS. OpenAI is relegated to opt-in queries for people who specifically request ChatGPT. That's the difference between infrastructure and feature. The next 12 months: Apple launches Gemini-powered Siri in spring 2026. If it works, every iPhone user defaults to Google's AI. ChatGPT becomes the thing people use when Siri can't answer. The backup plan. My takeaway for entrepreneurs watching this: Distribution beats innovation. Google didn't necessarily build a better chatbot. They built better infrastructure and negotiated better terms. OpenAI won the hype race. Google won the business war. What do you think can save OpenAI now?

Google just STOLE Apple away from OpenAI... And it might decide who wins the AI race. Apple announced a multi-year $1 billion deal with Google to power the next generation of Siri using Gemini AI. Not ChatGPT. Gemini. This is the same Apple that 18 months ago announced a partnership with OpenAI to integrate ChatGPT into iPhones. Everyone thought that meant OpenAI won. Turns out it was an audition. And OpenAI failed. Here's why: June 2024: Apple announces OpenAI partnership. Sam Altman tweets: "very happy to be partnering with apple." Media declares OpenAI the winner of the AI race. December 2025: Sam Altman issues "code red" at OpenAI. Tells everyone to pause everything and ship ChatGPT 5.2 faster. Why the panic? Google released Gemini 3 and it was actually good. January 2026: Apple picks Google. ChatGPT stays as an "optional feature" for complicated queries. But Gemini becomes the DEFAULT intelligence layer for 2 billion Apple devices. The financial reality: Apple pays OpenAI $0 But Apple pays Google $1 BILLION per year That's a verdict. The excuse OpenAI gave for why they did it for free was "exposure to millions of iPhone users." Which basically means "we couldn't negotiate worth shit." Meanwhile Google walked away with both the money AND the distribution. Why Google won: Infrastructure ownership. OpenAI runs on Microsoft's Azure cloud. That creates a dependency chain: Apple → OpenAI → Microsoft. 3 companies. 3 points of failure. Google owns its entire stack. One relationship. Zero middlemen. Apple's statement said Google's technology provides "the most capable foundation." Not "most innovative." Not "best partner." Most CAPABLE. In other words, OpenAI's tech couldn't handle the scale. The Alphabet boost: Google's stock hit $4 trillion market cap after the announcement. Up 65% in 2024 on AI momentum alone. This deal validates Google's pivot from "search company" to "AI infrastructure company." Now they power Samsung's Galaxy AI AND Apple's Siri. Billions of mobile devices running on Gemini. OpenAI's big problem here: Still no profit. Ever. Anthropic is stealing enterprise customers. DeepSeek launched a price war forcing ChatGPT to cut prices. GPT-5 was overhyped and underwhelming. Circular financing deals are getting scrutinized. And now Apple just downgraded them from partner to backup option. That "code red" in December? Too little, too late. The reality everyone's missing: This isn't about chatbot quality. It's about who owns the infrastructure to power billions of devices. Google proved it with Samsung. Now Apple. OpenAI proved it can build a viral product but can't scale it profitably. Very different skill sets. Elon called it "unreasonable concentration of power for Google." He's right. But that's exactly why Apple chose them. Apple doesn't want a startup partner. They want a utility provider. Google is now the default AI for Android AND iOS. OpenAI is relegated to opt-in queries for people who specifically request ChatGPT. That's the difference between infrastructure and feature. The next 12 months: Apple launches Gemini-powered Siri in spring 2026. If it works, every iPhone user defaults to Google's AI. ChatGPT becomes the thing people use when Siri can't answer. The backup plan. My takeaway for entrepreneurs watching this: Distribution beats innovation. Google didn't necessarily build a better chatbot. They built better infrastructure and negotiated better terms. OpenAI won the hype race. Google won the business war. What do you think can save OpenAI now?

Ricardo

50,741 views • 8 months ago

"I ran a startup for 5 years. I thought we moved fast. Then I joined OpenAI—and realized I had no idea what fast actually meant." Head of Product for OpenAI's Codex Alexander Embiricos and I chat about: 🔸 How OpenAI built the Sora Android app (which hit #1) in just 18 days by using Codex 🔸 Codex growing 20x since August 🔸 How they're thinking about the dev bottleneck shifting from coding to reviewing AI-generated work 🔸 Why coding will be a core competency for every AI agent—because writing code is how agents use computers best 🔸 Why the bottleneck to AGI-level productivity isn’t model capability—it’s human typing speed 🔸 The vision of Codex, and how they plan to win Listen now 👇 • YouTube: • Spotify: • Apple: Thank you to our wonderful sponsors for supporting the podcast: 🏆 WorkOS — Modern identity platform for B2B SaaS, free up to 1 million MAUs: 🏆 Fin — The #1 AI agent for customer service: 🏆 Atlassian Jira Product Discovery — Confidence to build the right thing:

"I ran a startup for 5 years. I thought we moved fast. Then I joined OpenAI—and realized I had no idea what fast actually meant." Head of Product for OpenAI's Codex Alexander Embiricos and I chat about: 🔸 How OpenAI built the Sora Android app (which hit #1) in just 18 days by using Codex 🔸 Codex growing 20x since August 🔸 How they're thinking about the dev bottleneck shifting from coding to reviewing AI-generated work 🔸 Why coding will be a core competency for every AI agent—because writing code is how agents use computers best 🔸 Why the bottleneck to AGI-level productivity isn’t model capability—it’s human typing speed 🔸 The vision of Codex, and how they plan to win Listen now 👇 • YouTube: • Spotify: • Apple: Thank you to our wonderful sponsors for supporting the podcast: 🏆 WorkOS — Modern identity platform for B2B SaaS, free up to 1 million MAUs: 🏆 Fin — The #1 AI agent for customer service: 🏆 Atlassian Jira Product Discovery — Confidence to build the right thing:

Lenny Rachitsky

334,586 views • 9 months ago

OpenAI's new Agents API is a hosted Codex runtime that can connect to sandboxes like E2B. OpenAI manages the model, harness, and agent sessions, while code executes on an isolated E2B machine with its own filesystem and preinstalled tools. We built an agent workbench where each chat runs on its own machine. It starts from a custom template, auto-pauses between turns, forks to try another approach from the same starting point, and can even act on videos inside the sandbox. Thanks Ondrej for the workbench demo! Try it: e2b sbx create openai-agents-api-python-sdk Build on top of the workbench: Docs:

OpenAI's new Agents API is a hosted Codex runtime that can connect to sandboxes like E2B. OpenAI manages the model, harness, and agent sessions, while code executes on an isolated E2B machine with its own filesystem and preinstalled tools. We built an agent workbench where each chat runs on its own machine. It starts from a custom template, auto-pauses between turns, forks to try another approach from the same starting point, and can even act on videos inside the sandbox. Thanks Ondrej for the workbench demo! Try it: e2b sbx create openai-agents-api-python-sdk Build on top of the workbench: Docs:

Vasek Mlejnsky

23,210 views • 15 days ago

Growth tactics from OpenAI and Stripe's first marketing hire Krithika At OpenAI, Krithika established marketing foundations for ChatGPT for consumers and enterprises, as well as their developer API platform. While at Stripe, she spent over eight years building and scaling their marketing function from scratch. She also led marketing at Retool, and marketing teams at Dropbox. An engineer turned marketer, Krithika brings a uniquely analytical approach to marketing. She currently serves as Entrepreneur in Residence at Thrive Capital, where she helps portfolio companies with all things marketing. Listen now 👇 • YouTube: • Spotify: • Apple: Thank you to our wonderful sponsors for supporting the podcast: 🏆 @Get_Eppo — Run reliable, impactful experiments 🏆 Airtable ProductCentral — Launch to new heights with a unified system for product development: 🏆 @LinkedInMktg — Reach professionals and drive results for your business:

Growth tactics from OpenAI and Stripe's first marketing hire Krithika At OpenAI, Krithika established marketing foundations for ChatGPT for consumers and enterprises, as well as their developer API platform. While at Stripe, she spent over eight years building and scaling their marketing function from scratch. She also led marketing at Retool, and marketing teams at Dropbox. An engineer turned marketer, Krithika brings a uniquely analytical approach to marketing. She currently serves as Entrepreneur in Residence at Thrive Capital, where she helps portfolio companies with all things marketing. Listen now 👇 • YouTube: • Spotify: • Apple: Thank you to our wonderful sponsors for supporting the podcast: 🏆 @Get_Eppo — Run reliable, impactful experiments 🏆 Airtable ProductCentral — Launch to new heights with a unified system for product development: 🏆 @LinkedInMktg — Reach professionals and drive results for your business:

Lenny Rachitsky

80,823 views • 1 year ago

🚨 YOUR GPU IS PROBABLY WASTING MORE THAN YOU THINK. vLLM is built to squeeze far more useful work out of your GPU when serving LLMs. Running an LLM at scale isn’t just about having a powerful GPU. The real problem is how efficiently you use its memory and compute. That’s where vLLM comes in. → High-throughput LLM inference and serving → PagedAttention for smarter KV-cache memory management → Continuous batching to keep GPUs busy → Prefix caching + chunked prefill → OpenAI-compatible API out of the box → Supports a huge range of modern LLM architectures → Quantization support for running models more efficiently And the crazy part? You can start an OpenAI-compatible inference server with: `vllm serve ` So your application can talk to your own model almost like it’s talking to OpenAI. The bigger idea: Don’t just buy more GPUs. Make the GPUs you already have work harder. That’s why vLLM has become such a major project in LLM inference. 🔥 #vLLM #AI #LLM #Inference #GPU #MachineLearning #AIInfrastructure #OpenSource #AIAgents #Developers

🚨 YOUR GPU IS PROBABLY WASTING MORE THAN YOU THINK. vLLM is built to squeeze far more useful work out of your GPU when serving LLMs. Running an LLM at scale isn’t just about having a powerful GPU. The real problem is how efficiently you use its memory and compute. That’s where vLLM comes in. → High-throughput LLM inference and serving → PagedAttention for smarter KV-cache memory management → Continuous batching to keep GPUs busy → Prefix caching + chunked prefill → OpenAI-compatible API out of the box → Supports a huge range of modern LLM architectures → Quantization support for running models more efficiently And the crazy part? You can start an OpenAI-compatible inference server with: `vllm serve ` So your application can talk to your own model almost like it’s talking to OpenAI. The bigger idea: Don’t just buy more GPUs. Make the GPUs you already have work harder. That’s why vLLM has become such a major project in LLM inference. 🔥 #vLLM #AI #LLM #Inference #GPU #MachineLearning #AIInfrastructure #OpenSource #AIAgents #Developers

Vikas gupta

14,138 views • 14 days ago

Meet Orin! 🟠 Orin is a voice-enabled AI companion built for conversation. You open a chat, say what's on your mind, and get a thoughtful reply. If talking out loud is easier, you can start a voice call in the same thread. ElevenLabs powers Orin for real-time voice, OpenAI for text, and a layered prompt system across five personalities — Warm, Curious, Playful, Calm, and Direct. Spent the past couple of weeks building this from the ground up, and it's live now. Say hello at orin[.]chat, and star the repo on GitHub!

Meet Orin! 🟠 Orin is a voice-enabled AI companion built for conversation. You open a chat, say what's on your mind, and get a thoughtful reply. If talking out loud is easier, you can start a voice call in the same thread. ElevenLabs powers Orin for real-time voice, OpenAI for text, and a layered prompt system across five personalities — Warm, Curious, Playful, Calm, and Direct. Spent the past couple of weeks building this from the ground up, and it's live now. Say hello at orin[.]chat, and star the repo on GitHub!

victor

137,880 views • 2 months ago

why is Elon Musk suing OpenAI? the genesis of the lawsuit is OpenAI's "original sin": going from OPEN to CLOSED elon contends that if OAI can legally: -- take donations, build the product, and get tax exemptions as a nonprofit -- THEN create a for-profit subsidiary, raise investor capital, sell secondary, and commercialize the software once it's built ... then this should be the model for EVERY startup going forward. either it should be illegal, or it should be the standard. but OpenAI (and its employees) might have a bigger problem around the corner: the IRS @jason breaks it down: "They took an open source project. They closed it. They raised money. And then within the next two years, on this incredible innovation, they sold $2B and put that in their pockets. That's where I think this whole thing is gonna get really crazy." as Chamath Palihapitiya explains, even if OpenAI decides to open-source its models again, there is a bigger picture problem: "(Open-sourcing) may solve the lawsuit ... but it's opened a can of worms with respect to tax and structuring that's much bigger than just OpenAI."

why is Elon Musk suing OpenAI? the genesis of the lawsuit is OpenAI's "original sin": going from OPEN to CLOSED elon contends that if OAI can legally: -- take donations, build the product, and get tax exemptions as a nonprofit -- THEN create a for-profit subsidiary, raise investor capital, sell secondary, and commercialize the software once it's built ... then this should be the model for EVERY startup going forward. either it should be illegal, or it should be the standard. but OpenAI (and its employees) might have a bigger problem around the corner: the IRS @jason breaks it down: "They took an open source project. They closed it. They raised money. And then within the next two years, on this incredible innovation, they sold $2B and put that in their pockets. That's where I think this whole thing is gonna get really crazy." as Chamath Palihapitiya explains, even if OpenAI decides to open-source its models again, there is a bigger picture problem: "(Open-sourcing) may solve the lawsuit ... but it's opened a can of worms with respect to tax and structuring that's much bigger than just OpenAI."

The All-In Podcast

7,261,052 views • 2 years ago