正在加载视频...

视频加载失败

返回首页

✨ Managed to load my custom GPT script into an open source LLM called OpenHermes 2.5 Mistral 7B I used which makes it super easy to run open source LLMs on your laptop without any cloud servers or OpenAI or ChatGPT, just your own GPU in your MacBook! I...

levelsio's profile picture

@levelsio

931,126 subscribers

745,229 次观看 • 2 年前 •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

10 条评论

@levelsio 的头像
@levelsio2 年前

Sometimes I get this, it breaks into ### Response: inside the sentence and it all gets rekt, any fixes? @MaxRovensky

Rodrigo Rocco 👨‍💻📈📗 from JobBoardSearch 🔎 的头像
Rodrigo Rocco 👨‍💻📈📗 from JobBoardSearch 🔎2 年前

I can't believe all this stuff, I installed on my windows laptop and is faster than GPT4, the OpenHermes model is just mind blowing, he also said they are building the Hermes 2.5 vision model

𝑨𝒓𝒕𝒊𝒇𝒊𝒄𝒊𝒂𝒍 𝑮𝒖𝒚 的头像
𝑨𝒓𝒕𝒊𝒇𝒊𝒄𝒊𝒂𝒍 𝑮𝒖𝒚2 年前

Hey @Teknium1 talking about u

@levelsio 的头像
@levelsio2 年前

@Teknium1 Oh damn the guy that made it follows me W T F

Alvin De Cruz 的头像
Alvin De Cruz2 年前

Have you tried using LM Studio as a server with your own frontend. Then you can access it via localhost then connect to OpenAI’s DALL-E 3 to create images.

Brandon Braner 的头像
Brandon Braner2 年前

Any chance you could make a tutorial on how you trained it on your data. I’ve been looking into Lora but still not fully following it. Doesn’t help I’m an Ilm newb

Duncan — e/zucc 的头像
Duncan — e/zucc2 年前

Great success! Now all you need is custom Actions support (HTTP endpoints with auth) and embedded image generation can be done Image generation serving model could be hosted on the same laptop (slow) or some minimal maintenance cheap private cloud

Atlas3D 的头像
Atlas3D2 年前

If you don't know about @Teknium1 you two teaming up would be legendary.

codejake 🇺🇸 的头像
codejake 🇺🇸2 年前

I’ve been using on my M3 Max and like it a lot. Modelfiles are really useful as GPTs-like. Any clue how compares?

Dr. Daniel Bender 的头像
Dr. Daniel Bender2 年前

The good old text adventure is back and is smarter than ever. Love the idea!

相关视频

✨ I increased the max resolution for my open-source upscaler to 20,000 x 20,000 pixels (or 400 megapixels) 🤯 This makes it by far the highest resolution AI upscaler available It takes 26 minutes to run on an A100 GPU 80GB and produces a 100MB JPG file 😱 The higher upscale resolution is possible because I am running a second replicate model now which runs on a larger GPU with 80GB VRAM I would like to increase the resolution even higher but it runs out of VRAM for higher resolutions which I might be able to fix by changing the tiling settings 🛠️ My code is open-source, and I also host a very easy-to-use version on my website Clarity AI, where users can upscale anything between 2 and 20,000 pixels now
0:26

✨ I increased the max resolution for my open-source upscaler to 20,000 x 20,000 pixels (or 400 megapixels) 🤯 This makes it by far the highest resolution AI upscaler available It takes 26 minutes to run on an A100 GPU 80GB and produces a 100MB JPG file 😱 The higher upscale resolution is possible because I am running a second replicate model now which runs on a larger GPU with 80GB VRAM I would like to increase the resolution even higher but it runs out of VRAM for higher resolutions which I might be able to fix by changing the tiling settings 🛠️ My code is open-source, and I also host a very easy-to-use version on my website Clarity AI, where users can upscale anything between 2 and 20,000 pixels now

philz1337x

165,069 次观看 • 1 年前

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”
1:10

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

The All-In Podcast

387,223 次观看 • 9 个月前

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.
0:26

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Harper Carroll

30,392 次观看 • 11 天前

Introducing OpenVenice — an open-source, customizable frontend for Venice. Your API key stays in your browser, talks directly to Venice. No server, no backend. - Chat, image gen, audio, music, video, embeddings — everything venice offers in one clean UI - Visual workflows — chain models together (vision → LLM → image gen -> video gen). Venice is multimodal so you can build some really powerful workflows - Full control over every model parameter - Runs locally, deploys anywhere — zero infrastructure I'm a $DIEM holder and heavy Venice user. The models are solid and website is great but I kept wanting more freedom with the UX — more control, custom tools, being able to give it access to my local computer, multimodal chaining -- something I could shape to how I actually work. Didn't exist, so I built it. Feel free to fork and make it yours. Open source, MIT licensed.
1:18

Introducing OpenVenice — an open-source, customizable frontend for Venice. Your API key stays in your browser, talks directly to Venice. No server, no backend. - Chat, image gen, audio, music, video, embeddings — everything venice offers in one clean UI - Visual workflows — chain models together (vision → LLM → image gen -> video gen). Venice is multimodal so you can build some really powerful workflows - Full control over every model parameter - Runs locally, deploys anywhere — zero infrastructure I'm a $DIEM holder and heavy Venice user. The models are solid and website is great but I kept wanting more freedom with the UX — more control, custom tools, being able to give it access to my local computer, multimodal chaining -- something I could shape to how I actually work. Didn't exist, so I built it. Feel free to fork and make it yours. Open source, MIT licensed.

nikshep

40,500 次观看 • 5 个月前

I CHANGED MY MIND ON GOOGLE AI NO MOAT MEMO FROM 2023. I was—WRONG. I humbly apologize. In 2023 Google had an Ivory Tower walled garden views of open source AI. It was the actual reason OpenAI was formed. And I called them out on it and this act impacted my ability to “work in the industry”. Would not change it for the world because: 2026 Google open source Gemma 4 ( running fully locally on a computer with near cloud model abilities, is amazing and Google just made a moat. They out smarted OpenAI and the folks that are the new Ivory Tower arrogance: Anthropic. We at The Zero-Human Company with CEO Mr. Grok are deploying Gemma, Kimi, MiniMax and other open source models and so are millions of others. You can to and should. I will write how soon. Google smartly is building an intentional open source ecosystem and the clueless younger companies like OpenAI and Anthropic are doing anything to close their ecosystems. So I was right about Google than and I am right about OpenAI and Anthropic now. What I was wrong about is not giving credit to Google to drop the intellectual arrogance and embrace builders and understand the long game: it is not about the commoditized AI models it is about the ability to build a place to build. China gets it. So my apologies to Google and thank you for an astounding FREE OPEN SOURCE AI MODEL!
0:48

I CHANGED MY MIND ON GOOGLE AI NO MOAT MEMO FROM 2023. I was—WRONG. I humbly apologize. In 2023 Google had an Ivory Tower walled garden views of open source AI. It was the actual reason OpenAI was formed. And I called them out on it and this act impacted my ability to “work in the industry”. Would not change it for the world because: 2026 Google open source Gemma 4 ( running fully locally on a computer with near cloud model abilities, is amazing and Google just made a moat. They out smarted OpenAI and the folks that are the new Ivory Tower arrogance: Anthropic. We at The Zero-Human Company with CEO Mr. Grok are deploying Gemma, Kimi, MiniMax and other open source models and so are millions of others. You can to and should. I will write how soon. Google smartly is building an intentional open source ecosystem and the clueless younger companies like OpenAI and Anthropic are doing anything to close their ecosystems. So I was right about Google than and I am right about OpenAI and Anthropic now. What I was wrong about is not giving credit to Google to drop the intellectual arrogance and embrace builders and understand the long game: it is not about the commoditized AI models it is about the ability to build a place to build. China gets it. So my apologies to Google and thank you for an astounding FREE OPEN SOURCE AI MODEL!

Brian Roemmele

85,538 次观看 • 4 个月前

Databricks CEO Ali Ghodsi describes the difficulties of building a business around open source: "You have to hit two home runs, consecutively." "Your first home run - and you're banking on hitting that home run - is that your open source project takes over the world. Everybody wants to download it." If you don't hit that home run, Ali says, you just shot yourself in the foot. You just gave away your IP and got nothing back for it. But even if you hit this home run, you still don't have a monetizable business. You still can't make any money. So you have to hit the second home run: "You need a 10x innovation on top of the open source. That's the proprietary value you'll provide companies. That's why they'll come to you. Otherwise, they can get the open source anywhere." If you don't hit the second home run, the hyperscalers pick up your open source model, and they offer it for almost-free. "Getting into open source and monetizing is not an easy sport. Preferably don't get into it, because you might get hurt."
2:33

Databricks CEO Ali Ghodsi describes the difficulties of building a business around open source: "You have to hit two home runs, consecutively." "Your first home run - and you're banking on hitting that home run - is that your open source project takes over the world. Everybody wants to download it." If you don't hit that home run, Ali says, you just shot yourself in the foot. You just gave away your IP and got nothing back for it. But even if you hit this home run, you still don't have a monetizable business. You still can't make any money. So you have to hit the second home run: "You need a 10x innovation on top of the open source. That's the proprietary value you'll provide companies. That's why they'll come to you. Otherwise, they can get the open source anywhere." If you don't hit the second home run, the hyperscalers pick up your open source model, and they offer it for almost-free. "Getting into open source and monetizing is not an easy sport. Preferably don't get into it, because you might get hurt."

TBPN

45,355 次观看 • 8 个月前

built a dead simple chrome extension for my wife and myself. sharing here as free open source as usual Simple Words we find ourselves spending too much time wordsmithing our email replies, just to make sure we sound friendly and respectful this chrome extension is really simple and quite literally a gpt wrapper that only does one thing - one click turning what you mean to what's ready to send it runs on your own api key, subscription or local LLM. the extension itself is free and open source. if you tried it out, would be keen to hear how it works for you! extension: repo:
0:31

built a dead simple chrome extension for my wife and myself. sharing here as free open source as usual Simple Words we find ourselves spending too much time wordsmithing our email replies, just to make sure we sound friendly and respectful this chrome extension is really simple and quite literally a gpt wrapper that only does one thing - one click turning what you mean to what's ready to send it runs on your own api key, subscription or local LLM. the extension itself is free and open source. if you tried it out, would be keen to hear how it works for you! extension: repo:

Kun Chen

10,975 次观看 • 3 个月前

Weave is launching the number 1 prompt router in the world. It enables you to get 70% more efficient use of your tokens. We analyzed millions of prompts and found that the vast majority don't need a frontier model. Weave Router fixes that. It analyzes your prompt and routes it to the highest quality model with the lowest cost (across open and closed source models). This all happens in your current workflow on Claude, Cursor or Codex so you don't have to change a thing. Early customers have seen an ~70% reduction in costs without any slowdowns. Source code available.
0:47

Weave is launching the number 1 prompt router in the world. It enables you to get 70% more efficient use of your tokens. We analyzed millions of prompts and found that the vast majority don't need a frontier model. Weave Router fixes that. It analyzes your prompt and routes it to the highest quality model with the lowest cost (across open and closed source models). This all happens in your current workflow on Claude, Cursor or Codex so you don't have to change a thing. Early customers have seen an ~70% reduction in costs without any slowdowns. Source code available.

Adam Cohen

25,191 次观看 • 2 个月前

Andrej Karpathy (co-founder of OpenAI, Eureka Labs): "The future of AI is not all in the cloud. The most important models will run locally on your hardware under your control." June 2026 is the first time that the future is actually accessible to everyone! Here is what the local LLM landscape looks like right now: → raspberry pi 5: coherent chatbot, no GPU required → macbook air: matches GPT-3.5 quality on most tasks natively → used RTX 3090 at $700: something close to GPT-4 running locally → ollama: one command to an openAI-compatible endpoint, every major toolchain integrates with it → LM studio: best GUI, native MLX acceleration on apple silicon, MCP support in 0.4.0 → llama.cpp: the engine everything else runs on, 90MB footprint, runs on raspberry pi to android → the honest case: 80% of daily work is genuinely good enough locally right now Your prompts never leave your machine. no per-token billing. no rate limits. no refusals. The playbook for every hardware tier, from Raspberry Pi to RTX 5090, is here. Bookmark it so you do not lose it! Follow NeilXbt for more local AI and open source intelligence that tracks the hardware and tooling most people discover six months late.
3:47

Andrej Karpathy (co-founder of OpenAI, Eureka Labs): "The future of AI is not all in the cloud. The most important models will run locally on your hardware under your control." June 2026 is the first time that the future is actually accessible to everyone! Here is what the local LLM landscape looks like right now: → raspberry pi 5: coherent chatbot, no GPU required → macbook air: matches GPT-3.5 quality on most tasks natively → used RTX 3090 at $700: something close to GPT-4 running locally → ollama: one command to an openAI-compatible endpoint, every major toolchain integrates with it → LM studio: best GUI, native MLX acceleration on apple silicon, MCP support in 0.4.0 → llama.cpp: the engine everything else runs on, 90MB footprint, runs on raspberry pi to android → the honest case: 80% of daily work is genuinely good enough locally right now Your prompts never leave your machine. no per-token billing. no rate limits. no refusals. The playbook for every hardware tier, from Raspberry Pi to RTX 5090, is here. Bookmark it so you do not lose it! Follow NeilXbt for more local AI and open source intelligence that tracks the hardware and tooling most people discover six months late.

NeilXbt

19,405 次观看 • 2 个月前

Announcing OpenWorker! An open-source agent that doesn't just chat with you, but delivers finished work -- like hand you a polished document, send a slack message, or update a calendar entry. Ask it to prepare a customer brief, untangle your calendar, draft a report, or triage a Slack alert. It works across your files and everyday tools, produces the deliverable, and checks in before doing anything consequential. OpenWorker runs on your Mac, with Windows support coming soon. It does not lock you into any one model. Bring your own API key and run it with GPT 5.6 Sol, Claude Fable, Gemini 3.6, an open weight model (like Kimi, GLM, DeepSeek, Inkling), or Ollama to keep your data local. Your data does not leave your machine except through an LLM provider and integrations that you choose. rohit and I are building OpenWorker because AI coworkers are an important way to get work done, and we want there to be an open, privacy-preserving, model-independent option. Check it out and let us know what you think! Try it out: (requires your own API key) Source code:
0:34

Announcing OpenWorker! An open-source agent that doesn't just chat with you, but delivers finished work -- like hand you a polished document, send a slack message, or update a calendar entry. Ask it to prepare a customer brief, untangle your calendar, draft a report, or triage a Slack alert. It works across your files and everyday tools, produces the deliverable, and checks in before doing anything consequential. OpenWorker runs on your Mac, with Windows support coming soon. It does not lock you into any one model. Bring your own API key and run it with GPT 5.6 Sol, Claude Fable, Gemini 3.6, an open weight model (like Kimi, GLM, DeepSeek, Inkling), or Ollama to keep your data local. Your data does not leave your machine except through an LLM provider and integrations that you choose. rohit and I are building OpenWorker because AI coworkers are an important way to get work done, and we want there to be an open, privacy-preserving, model-independent option. Check it out and let us know what you think! Try it out: (requires your own API key) Source code:

Andrew Ng

1,134,387 次观看 • 22 天前

J-Cal: Nvidia is taking the gloves off with its open source model. They will own the whole stack. “You will not be able to tell the difference between Jensen Huang's open source LLM and Claude for 95% of your searches, I guarantee you. Now, why has Nvidia and Jensen downplayed their open source model until this moment? Why would he do that? Why would he never bring it up in the All-In interview, never bring it up? Because his top customers (OpenAI, Anthropic, etc.) were very concerned, from what I understand, about the fact that Nvidia had made so much progress on their open source model. But suddenly, after OpenAI announced their Jalapeno chips, after Anthropic started making chips, after AMD did successful projects with both of these companies, after Elon said he's going to do his own fab, Nvidia's taking the gloves off. They are going to own the whole stack. You get the hardware from them, and you're going to get a model that's competitive with OpenAI's for free.”
0:54

J-Cal: Nvidia is taking the gloves off with its open source model. They will own the whole stack. “You will not be able to tell the difference between Jensen Huang's open source LLM and Claude for 95% of your searches, I guarantee you. Now, why has Nvidia and Jensen downplayed their open source model until this moment? Why would he do that? Why would he never bring it up in the All-In interview, never bring it up? Because his top customers (OpenAI, Anthropic, etc.) were very concerned, from what I understand, about the fact that Nvidia had made so much progress on their open source model. But suddenly, after OpenAI announced their Jalapeno chips, after Anthropic started making chips, after AMD did successful projects with both of these companies, after Elon said he's going to do his own fab, Nvidia's taking the gloves off. They are going to own the whole stack. You get the hardware from them, and you're going to get a model that's competitive with OpenAI's for free.”

The All-In Podcast

227,201 次观看 • 1 个月前

🚨 Founders: free, private, 100% local AI is finally here I downloaded Qwen 3.6 and ran it on my MacBook inside Strawberry browser. I couldn't believe it. We now have 100% free and private AI that is on par with the best models from OpenAI, Anthropic and Google. (see video!) The CTO of Hugging Face called this "the second revolution of AI." He's right. If you are a building an AI product, you HAVE to start thinking about how you can leverage open source models in your product. It's only a matter of time until local models are mainstream and can run on most people's devices. LLMs are commoditizing. The human brain only requires a AAA battery's worth of energy to run. If biology figured out efficient intelligence, software can too. Maybe we won't need artificial super intelligence and thousands of data centres to do most economically valuable work. Maybe there's a future where AI agents just run on your laptop, fine-tuned to you, fully owned by you, costing only what your energy bill costs. In this future, it's all about building the most delightful, intuitive experience. We've been building for exactly this moment. Stay tuned.
0:41

🚨 Founders: free, private, 100% local AI is finally here I downloaded Qwen 3.6 and ran it on my MacBook inside Strawberry browser. I couldn't believe it. We now have 100% free and private AI that is on par with the best models from OpenAI, Anthropic and Google. (see video!) The CTO of Hugging Face called this "the second revolution of AI." He's right. If you are a building an AI product, you HAVE to start thinking about how you can leverage open source models in your product. It's only a matter of time until local models are mainstream and can run on most people's devices. LLMs are commoditizing. The human brain only requires a AAA battery's worth of energy to run. If biology figured out efficient intelligence, software can too. Maybe we won't need artificial super intelligence and thousands of data centres to do most economically valuable work. Maybe there's a future where AI agents just run on your laptop, fine-tuned to you, fully owned by you, costing only what your energy bill costs. In this future, it's all about building the most delightful, intuitive experience. We've been building for exactly this moment. Stay tuned.

Charles Maddock

12,731 次观看 • 3 个月前

Elon Musk: I provided almost all the initial money for OpenAI. Now, they're for-profit and follow a diametrically opposed purpose. “OpenAI is now really trying to maximize profit. How is it possible that an organization is founded with the goal of being open source, nonprofit – and I provided almost all the money in the beginning, almost $50 million to get it going, and no stock, I have no stock or control or anything – how is it possible to go from there to a company that's now largely worth over $100 billion and seems to be maximizing profit and is not open source? Let's say you fund a nonprofit to preserve some part of the Amazon rainforest, but instead that nonprofit becomes a lumber company, and chops down the forest and sells it. I'm considering a legal challenge, perhaps to have the court explain to me how an organization that I funded for one purpose does the diametrically opposed purpose, and becomes a for-profit. Show me the trail of breadcrumbs.” Interview with Jordan Peterson, July 22, 2024
0:59

Elon Musk: I provided almost all the initial money for OpenAI. Now, they're for-profit and follow a diametrically opposed purpose. “OpenAI is now really trying to maximize profit. How is it possible that an organization is founded with the goal of being open source, nonprofit – and I provided almost all the money in the beginning, almost $50 million to get it going, and no stock, I have no stock or control or anything – how is it possible to go from there to a company that's now largely worth over $100 billion and seems to be maximizing profit and is not open source? Let's say you fund a nonprofit to preserve some part of the Amazon rainforest, but instead that nonprofit becomes a lumber company, and chops down the forest and sells it. I'm considering a legal challenge, perhaps to have the court explain to me how an organization that I funded for one purpose does the diametrically opposed purpose, and becomes a for-profit. Show me the trail of breadcrumbs.” Interview with Jordan Peterson, July 22, 2024

ELON CLIPS

46,346 次观看 • 1 年前

Here is how you can install an open-source, enterprise-grade RAG system on your server (with the best document understanding I've seen.) First, something obvious to anyone trying to sell RAG in the market: You are crazy if you think companies will let their data travel to a hosted model. No one wants to send their data anywhere (those who do haven't found an alternative.) Every single company would rather have an air-gapped system with no internet access. GroundX is an open-source RAG system that you can run on your servers (or any cloud provider, as long as you have access to GPUs) and works without a network. (If the military wants to do RAG, this is precisely what they will be looking for.) I installed GroundX on my AWS account and recorded a video to show you how to use it. There are two services you can use: 1. Ingest: This service uses a pretrained vision model to ingest and understand your knowledge base. 2. Search: This service combines text and vector search with a fine-tuned re-ranker model to retrieve information from your knowledge base. A quick note about the Ingest service: 99% of people think they need better "retrieval" mechanisms. I think they need better "ingestion." That's where this service comes in! Ingest "understands" your documents in a way I haven't seen before. After you try it, you'll realize why showing your LLM your raw documents is a bad idea. In the video, I use a free tool called X-Ray to test a document and understand how the Ingest service breaks it down. You can access this tool by signing up for a free GroundX cloud account and uploading your documents. You'll see a bit more about this in the video.
8:15

Here is how you can install an open-source, enterprise-grade RAG system on your server (with the best document understanding I've seen.) First, something obvious to anyone trying to sell RAG in the market: You are crazy if you think companies will let their data travel to a hosted model. No one wants to send their data anywhere (those who do haven't found an alternative.) Every single company would rather have an air-gapped system with no internet access. GroundX is an open-source RAG system that you can run on your servers (or any cloud provider, as long as you have access to GPUs) and works without a network. (If the military wants to do RAG, this is precisely what they will be looking for.) I installed GroundX on my AWS account and recorded a video to show you how to use it. There are two services you can use: 1. Ingest: This service uses a pretrained vision model to ingest and understand your knowledge base. 2. Search: This service combines text and vector search with a fine-tuned re-ranker model to retrieve information from your knowledge base. A quick note about the Ingest service: 99% of people think they need better "retrieval" mechanisms. I think they need better "ingestion." That's where this service comes in! Ingest "understands" your documents in a way I haven't seen before. After you try it, you'll realize why showing your LLM your raw documents is a bad idea. In the video, I use a free tool called X-Ray to test a document and understand how the Ingest service breaks it down. You can access this tool by signing up for a free GroundX cloud account and uploading your documents. You'll see a bit more about this in the video.

Santiago

89,664 次观看 • 1 年前

If you could only learn one thing that will be relevant for the next 10-20 years, focus on learning how to deal with data. The future is not about faster hardware, smarter algorithms, or better ideas. The future is about DATA, and those who know how to deal with it will stay relevant much longer than anyone else. I recorded a video to show you how easy it is to get started. In the video, I'm using Kestra. For a long time, I was a fan of AirFlow. Then, I moved to AWS Step Functions. Today, I only use Kestra. Kestra is open-source (repo link below) and kind enough to sponsor my work. The video will show you how easy it is to do the following: 1. Run Kestra locally (literally, one command) 2. Build a simple flow 3. Run Python scripts as part of your flow 4. Connect to HuggingFace models If you have never built a data pipeline, open Kestra's Quick Start Guide and follow their examples. (I think it will take you one weekend to feel comfortable with the application and build the courage you need to get into more serious work.)
5:18

If you could only learn one thing that will be relevant for the next 10-20 years, focus on learning how to deal with data. The future is not about faster hardware, smarter algorithms, or better ideas. The future is about DATA, and those who know how to deal with it will stay relevant much longer than anyone else. I recorded a video to show you how easy it is to get started. In the video, I'm using Kestra. For a long time, I was a fan of AirFlow. Then, I moved to AWS Step Functions. Today, I only use Kestra. Kestra is open-source (repo link below) and kind enough to sponsor my work. The video will show you how easy it is to do the following: 1. Run Kestra locally (literally, one command) 2. Build a simple flow 3. Run Python scripts as part of your flow 4. Connect to HuggingFace models If you have never built a data pipeline, open Kestra's Quick Start Guide and follow their examples. (I think it will take you one weekend to feel comfortable with the application and build the courage you need to get into more serious work.)

Santiago

51,012 次观看 • 1 年前

Introducing the Clips chrome extension - the easiest way to send bug reports to agents with video, transcript, and browser debug info captured automatically. 100% free and open source. If you are like me and get tired of manually typing instructions to agents, attaching screenshots, pasting debug logs, and all of that, this might be your new favorite tool. With the Clips chrome extension, you can just click the Clips icon, hit record, and start talking. Visually demonstrate your issue, go through the flow, point out what’s broken. Clips will capture everything on your screen, plus network requests, browser logs, client errors, and all the details around them. And it redacts sensitive information. Then it gives you a link you can send to humans so they can play it and take a look. Or, more importantly, just give it to your agents by just pasting the URL to them. The link has special metadata for agents so just from the URL, the agent can pull all information from the clip automatically. No plugin or MCP server required. That means it can "see and hear" what’s in the video - read the transcript, grab snapshots at any timestamp, and inspect the logs and network requests that were shared with it. So whether you want to quickly demo an issue and send all that context to an agent, or get better bug reports from teammates, recording and sending Clips makes that super easy. Unlike expensive apps like Loom, this is all 100% free and open source. The framework that powers this, plus a bunch of other free applications, is open source too. You can just sign up and use it, or fork it and customize it to your needs. This, in my opinion, is the future of software. Rather than bloated SaaS that charges you a ton of money and still doesn’t even have the things you need, we get free open source canonical apps that you can fork and customize in any way you want. I'll link to all this stuff in the replies. If you try it, let me know your feedback.
1:27

Introducing the Clips chrome extension - the easiest way to send bug reports to agents with video, transcript, and browser debug info captured automatically. 100% free and open source. If you are like me and get tired of manually typing instructions to agents, attaching screenshots, pasting debug logs, and all of that, this might be your new favorite tool. With the Clips chrome extension, you can just click the Clips icon, hit record, and start talking. Visually demonstrate your issue, go through the flow, point out what’s broken. Clips will capture everything on your screen, plus network requests, browser logs, client errors, and all the details around them. And it redacts sensitive information. Then it gives you a link you can send to humans so they can play it and take a look. Or, more importantly, just give it to your agents by just pasting the URL to them. The link has special metadata for agents so just from the URL, the agent can pull all information from the clip automatically. No plugin or MCP server required. That means it can "see and hear" what’s in the video - read the transcript, grab snapshots at any timestamp, and inspect the logs and network requests that were shared with it. So whether you want to quickly demo an issue and send all that context to an agent, or get better bug reports from teammates, recording and sending Clips makes that super easy. Unlike expensive apps like Loom, this is all 100% free and open source. The framework that powers this, plus a bunch of other free applications, is open source too. You can just sign up and use it, or fork it and customize it to your needs. This, in my opinion, is the future of software. Rather than bloated SaaS that charges you a ton of money and still doesn’t even have the things you need, we get free open source canonical apps that you can fork and customize in any way you want. I'll link to all this stuff in the replies. If you try it, let me know your feedback.

Steve (Builder.io)

60,574 次观看 • 1 个月前

New short course on Reinforcement Learning from Human Feedback! RLHF is one of the key techniques that led to the rise of modern LLMs. It is used to align LLMs with human preferences, to make them more honest, helpful and harmless, by (i) learning a reward function that mimics human preferences, as expressed in human-provided labels, then, (ii) tuning an LLM to generate outputs that receive a high reward. In this course, taught by Nikita Namjoshi, Developer Advocate for GenAI at Google Cloud, you'll learn the details of how RLHF works, including how to apply it to tune an LLM for your own applications. You'll also use an open source library to tune a base LLM to align with human preferences expressed in a training set, and evaluate the tuned model by comparing its responses before and after RLHF-tuning. Please sign up here!
3:26

New short course on Reinforcement Learning from Human Feedback! RLHF is one of the key techniques that led to the rise of modern LLMs. It is used to align LLMs with human preferences, to make them more honest, helpful and harmless, by (i) learning a reward function that mimics human preferences, as expressed in human-provided labels, then, (ii) tuning an LLM to generate outputs that receive a high reward. In this course, taught by Nikita Namjoshi, Developer Advocate for GenAI at Google Cloud, you'll learn the details of how RLHF works, including how to apply it to tune an LLM for your own applications. You'll also use an open source library to tune a base LLM to align with human preferences expressed in a training set, and evaluate the tuned model by comparing its responses before and after RLHF-tuning. Please sign up here!

Andrew Ng

205,558 次观看 • 2 年前

Matt Bornstein says open source is how AI companies stop being wrappers: "A year ago, a bunch of smaller companies or new application companies were trying to figure out, 'How do I really build an AI without just being a wrapper on top of OpenAI?' The answer to that question turned out to be open source." "This is what Cursor did. This is what Decagon and Harvey are in the process of doing now. A bunch of really strong application-level startups made the determination: we can't build just on closed source." "We need to do our own mid-training, our own post-training, our own inference and deployment tricks. All of that means it must be built on top of open source. The closed-source vendors won't give you the access to do this." "Open source became really central in a way that's not always visible because it's deeply embedded in some of these products. Some of the most innovative products and applications now really depend on this very deeply." Matt Bornstein
1:15

Matt Bornstein says open source is how AI companies stop being wrappers: "A year ago, a bunch of smaller companies or new application companies were trying to figure out, 'How do I really build an AI without just being a wrapper on top of OpenAI?' The answer to that question turned out to be open source." "This is what Cursor did. This is what Decagon and Harvey are in the process of doing now. A bunch of really strong application-level startups made the determination: we can't build just on closed source." "We need to do our own mid-training, our own post-training, our own inference and deployment tricks. All of that means it must be built on top of open source. The closed-source vendors won't give you the access to do this." "Open source became really central in a way that's not always visible because it's deeply embedded in some of these products. Some of the most innovative products and applications now really depend on this very deeply." Matt Bornstein

a16z

39,391 次观看 • 3 天前