Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

The code for σ-GPT is out! Feel free to experiment with it here: It extends the François Fleuret picoclvr (non-nlp tasks) and Andrej Karpathy nanoGPT (text) codebases, with an additional KV-Cache from IRIS by Vincent Micheli and Eloi Alonso. (links below)

Arnaud Pannatier

1,108 subscribers

12,600 Aufrufe • vor 2 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

5 Kommentare

Profilbild von Arnaud Pannatier

Arnaud Pannatiervor 2 Jahren

picoclvr: nanoGPT: IRIS (for KV-Cache, and go check the whole project it's amazing): σ-GPT:

Profilbild von Lab4crypto

Lab4cryptovor 1 Jahr

🚀 Don't gamble with your portfolio! Use our advanced hybrid quant risk tool using on/off-chain data and make informed decisions. 📈 Acess to 1000+ charts for your crypto journey. 📚Join our Premium Telegram for daily alerts. 📊+21 projects supported. 🏗️ Beginners and experts.

Profilbild von k_zer0s

k_zer0svor 2 Jahren

@francoisfleuret @karpathy @micheli_vincent @EloiAlonso1 👍

Profilbild von Chris Krempel

Chris Krempelvor 1 Jahr

@francoisfleuret @karpathy @micheli_vincent @EloiAlonso1 very! interesting. Is the only thing I need to adjust `def order` for a new learning/ randomization scheme? Let's say I want to gradually move from masking random cells in a table to masking out a whole column?!

Profilbild von Arnaud Pannatier

Arnaud Pannatiervor 1 Jahr

@francoisfleuret @karpathy @micheli_vincent @EloiAlonso1 Yeah changing will let you use any kind of ordering. But if you want to be able to change on the fly at generation time, you need to keep a random order during training. But σ-GPT does not use masking like BERT it is causal like a standard GPT.

Ähnliche Videos

Hello GPT-5.5! Our best model yet is here. It’s smarter, faster, and gets more done. I had the chance to capture first reactions from developers building with it: it writes better code, understands more complex tasks, and keeps going. Can’t wait to see what you build with it!

Hello GPT-5.5! Our best model yet is here. It’s smarter, faster, and gets more done. I had the chance to capture first reactions from developers building with it: it writes better code, understands more complex tasks, and keeps going. Can’t wait to see what you build with it!

Romain Huet

16,262 Aufrufe • vor 2 Monaten

BREAKING: ChatGPT GPT-4o was just announce by OpenAI. It improves on vision, audio and text. The ease of use is incredibly enhanced. It makes interaction with the GPT much more natural, especially with voice. GPT-4o reasons across voice, text and vision. GPT-4 wil be available to everyone.

BREAKING: ChatGPT GPT-4o was just announce by OpenAI. It improves on vision, audio and text. The ease of use is incredibly enhanced. It makes interaction with the GPT much more natural, especially with voice. GPT-4o reasons across voice, text and vision. GPT-4 wil be available to everyone.

Ed Krassenstein

21,605 Aufrufe • vor 2 Jahren

I added KV caching and INT8 KV quantization to our transformer inference, improving throughput by 35x. All of this was done from scratch in Rust + CUDA, on top of a homemade ML framework. On a 4-token prompt with 252 generated tokens: - Original: 0.76 tok/s - KV cache fp32: 27.21 tok/s - KV cache int8 (quantized): 27.29 tok/s Try it out yourself here: In practice: - KV caching gave us about a 35x end-to-end speedup - INT8 KV cache kept roughly the same speed as fp32 but cut KV cache memory by 3.78x FP32 cache used 4.5 MB in this run while the INT8 cache used only 1.19 MB This simple change to inference created a huge impact on performance. To learn more about the KV cache and other optimizations like this, check out the blog at

I added KV caching and INT8 KV quantization to our transformer inference, improving throughput by 35x. All of this was done from scratch in Rust + CUDA, on top of a homemade ML framework. On a 4-token prompt with 252 generated tokens: - Original: 0.76 tok/s - KV cache fp32: 27.21 tok/s - KV cache int8 (quantized): 27.29 tok/s Try it out yourself here: In practice: - KV caching gave us about a 35x end-to-end speedup - INT8 KV cache kept roughly the same speed as fp32 but cut KV cache memory by 3.78x FP32 cache used 4.5 MB in this run while the INT8 cache used only 1.19 MB This simple change to inference created a huge impact on performance. To learn more about the KV cache and other optimizations like this, check out the blog at

Reese Chong

52,588 Aufrufe • vor 2 Monaten

The Magic Starts here... Introducing Dynamic Apps in Nimo . Create beautiful Personal Dynamic Apps that connect with your data and tools like Gmail, Sheets, Notion, Slack, and more. Check out some stunning Dynamic Apps below. Now with GPT-5, creating fast, reliable, and stunning Dynamic Apps is easier than ever. Check out the threads below to get an invitation code and try it today.

The Magic Starts here... Introducing Dynamic Apps in Nimo . Create beautiful Personal Dynamic Apps that connect with your data and tools like Gmail, Sheets, Notion, Slack, and more. Check out some stunning Dynamic Apps below. Now with GPT-5, creating fast, reliable, and stunning Dynamic Apps is easier than ever. Check out the threads below to get an invitation code and try it today.

rohildev

72,824 Aufrufe • vor 11 Monaten

.The Information Reporter Stephanie Palazzolo on OpenAI's GPT-5—a major step up for coding and what it means for competitors. "GPT-5 is a step up on a lot of different domains...one area that really stood out to [sources] was with coding." "Not only is GPT-5 better on more academic...tasks, but it's also better on the more practical programming tasks...working with very large and complex code bases." "If GPT-5 is going to be significantly better at these more practical everyday programming tasks, that could prove to be bad news for Anthropic." Watch the full episode on

.The Information Reporter Stephanie Palazzolo on OpenAI's GPT-5—a major step up for coding and what it means for competitors. "GPT-5 is a step up on a lot of different domains...one area that really stood out to [sources] was with coding." "Not only is GPT-5 better on more academic...tasks, but it's also better on the more practical programming tasks...working with very large and complex code bases." "If GPT-5 is going to be significantly better at these more practical everyday programming tasks, that could prove to be bad news for Anthropic." Watch the full episode on

The Information

52,067 Aufrufe • vor 11 Monaten

1/ Introducing Glider - the smallest model to beat GPT-4o-mini on eval tasks ⚡🚀 - Open source, open weights, open code - Explainable evaluations by nature - Trained on 183 criteria and 685 domains Try it out for free at 🔥

1/ Introducing Glider - the smallest model to beat GPT-4o-mini on eval tasks ⚡🚀 - Open source, open weights, open code - Explainable evaluations by nature - Trained on 183 criteria and 685 domains Try it out for free at 🔥

PatronusAI

14,856 Aufrufe • vor 1 Jahr

Exploring Andrej Karpathy Nanochat through a Knowledge Graph Love how this project combines simplicity with power. Want to navigate and understand the entire repo? Check it out here: Plus, you can connect it via MCP to any AI coding assistant and work directly on the repository. Powered by Deep Graph MCP AI at Meta and Groq Inc

Exploring Andrej Karpathy Nanochat through a Knowledge Graph Love how this project combines simplicity with power. Want to navigate and understand the entire repo? Check it out here: Plus, you can connect it via MCP to any AI coding assistant and work directly on the repository. Powered by Deep Graph MCP AI at Meta and Groq Inc

Daniel San

126,642 Aufrufe • vor 9 Monaten

The new Andrej Karpathy podcast with No Priors is a must-watch. I turned the most surprising insights & anecdotes into a webpage. For each, you can easily jump to the timetamp in the video where it occurred. Made with AnyGen (the most underrated AI tool out there) Link below!

The new Andrej Karpathy podcast with No Priors is a must-watch. I turned the most surprising insights & anecdotes into a webpage. For each, you can easily jump to the timetamp in the video where it occurred. Made with AnyGen (the most underrated AI tool out there) Link below!

Zara Zhang

29,349 Aufrufe • vor 3 Monaten

Operator is an AI agent by ChatGPT that browses the web and performs tasks. Currently in research preview with restrictions, it evolves with feedback. Check out the use cases below: 1. Crypto investment research based on tokens:

Operator is an AI agent by ChatGPT that browses the web and performs tasks. Currently in research preview with restrictions, it evolves with feedback. Check out the use cases below: 1. Crypto investment research based on tokens:

Shruti

205,754 Aufrufe • vor 1 Jahr

GPT-5.2-high by OpenAI is off to a strong start in the Code Arena. ⚡️ If you’re new here: Code Arena is where AI models build full web apps, tools, and interactive sites — all from a single prompt. Watch the video to see GPT-5.2-high in action, then try your own prompt and reply with your creation below. ⬇️

GPT-5.2-high by OpenAI is off to a strong start in the Code Arena. ⚡️ If you’re new here: Code Arena is where AI models build full web apps, tools, and interactive sites — all from a single prompt. Watch the video to see GPT-5.2-high in action, then try your own prompt and reply with your creation below. ⬇️

Arena.ai

246,337 Aufrufe • vor 7 Monaten

OpenAI just announced "GPT-4o". It can reason with voice, vision, and text. The model is 2x faster, 50% cheaper, and has 5x higher rate limit than GPT-4 Turbo. It will be available for free users and via the API. The voice model can even pick up on emotion and generate emotive voice.

OpenAI just announced "GPT-4o". It can reason with voice, vision, and text. The model is 2x faster, 50% cheaper, and has 5x higher rate limit than GPT-4 Turbo. It will be available for free users and via the API. The voice model can even pick up on emotion and generate emotive voice.

Lior Alexander

485,074 Aufrufe • vor 2 Jahren

🔥🔥 Tonkeeper has launched Signer, a revolutionary blockchain security product. The Signer app introduces an additional security layer for non-custodial wallets, enabling the secure storage and usage of private keys, which is particularly beneficial for users with larger crypto balances. The app seamlessly integrates with Tonkeeper and is now available for both iOS and Android. Check it out here:

🔥🔥 Tonkeeper has launched Signer, a revolutionary blockchain security product. The Signer app introduces an additional security layer for non-custodial wallets, enabling the secure storage and usage of private keys, which is particularly beneficial for users with larger crypto balances. The app seamlessly integrates with Tonkeeper and is now available for both iOS and Android. Check it out here:

Tonkeeper

84,066 Aufrufe • vor 1 Jahr

AutoGPT might be the next big step in AI. Here's why Karpathy recently said "AutoGPT is the next frontier of prompt engineering" AutoGPT is the equivalent of giving GPT-based models a memory and a body. You can now give a task to an AI agent and have it autonomously come up with a plan, execute on it, browse the web, and use new data to revise the strategy until the task is completed. It can analyze the market and come up with a trading strategy, customer service, marketing, finance, or other tasks that requires continuous updates. There are three components to it: 1. Architecture: It leverages GPT-4 and GPT-3.5 via API. 2. Autonomous Iterations: AutoGPT can refine its outputs by self-critical review, building on its previous work and integrating prompt history for more accurate results. 3. Memory Management: Integration with Pinecone allows for long-term memory storage, enabling context preservation and improved decision-making. 4. Multi-functionality: Capabilities include file manipulation, web browsing, and data retrieval, distinguishing AutoGPT from previous AI advancements by broadening its application scope.

AutoGPT might be the next big step in AI. Here's why Karpathy recently said "AutoGPT is the next frontier of prompt engineering" AutoGPT is the equivalent of giving GPT-based models a memory and a body. You can now give a task to an AI agent and have it autonomously come up with a plan, execute on it, browse the web, and use new data to revise the strategy until the task is completed. It can analyze the market and come up with a trading strategy, customer service, marketing, finance, or other tasks that requires continuous updates. There are three components to it: 1. Architecture: It leverages GPT-4 and GPT-3.5 via API. 2. Autonomous Iterations: AutoGPT can refine its outputs by self-critical review, building on its previous work and integrating prompt history for more accurate results. 3. Memory Management: Integration with Pinecone allows for long-term memory storage, enabling context preservation and improved decision-making. 4. Multi-functionality: Capabilities include file manipulation, web browsing, and data retrieval, distinguishing AutoGPT from previous AI advancements by broadening its application scope.

Lior Alexander

808,089 Aufrufe • vor 3 Jahren

It was a ride to have it finished, but the SLIDE REEL IS HERE, and ummm... quite with something more actually because I made for it a whole stand as the one we insert it into, with the lantern inside of it! 🔥 ⬇️Photos and additional info below! Annapurna Interactive Mobius Digital Games #OuterWilds

It was a ride to have it finished, but the SLIDE REEL IS HERE, and ummm... quite with something more actually because I made for it a whole stand as the one we insert it into, with the lantern inside of it! 🔥 ⬇️Photos and additional info below! Annapurna Interactive Mobius Digital Games #OuterWilds

Mallow 🌈

171,719 Aufrufe • vor 2 Jahren

How to create your Based Agent with 0 lines of code Recorded a quick demo video to show how easy it is and walk you through the entire process step-by-step All the links are in the comment below

How to create your Based Agent with 0 lines of code Recorded a quick demo video to show how easy it is and walk you through the entire process step-by-step All the links are in the comment below

lincoln.base.eth

148,805 Aufrufe • vor 1 Jahr

Somebody hooked up Claude Code to pair program with o3 and Gemini 2.5 via MCP for an all-star coding lineup 🤯 - Claude controls the work - Can call out to Gemini and o3 for tasks and input - Works around MCP limit by using prompt files Check out Zen MCP (link below)

Somebody hooked up Claude Code to pair program with o3 and Gemini 2.5 via MCP for an all-star coding lineup 🤯 - Claude controls the work - Can call out to Gemini and o3 for tasks and input - Works around MCP limit by using prompt files Check out Zen MCP (link below)

Ian Nuttall

216,556 Aufrufe • vor 1 Jahr

here's a hands on guide to setup multi-agent autoresearch by Andrej Karpathy. uses open models. works with codex, claude, open code. - uses 5 agents each with a configuration, specific tools, roles, and permission (see repo) - a researcher agent searches papers on hf papers and creates hypotheses - a planner agent maintains an experiment plan and log - workers take the hypotheses and updates the scripts, then it starts a hf job with a gpu to run the script - a reporter agent monitors these jobs and reports events and metrics to a TrackioApp dashboard I ran this for 4 hours and the agents ran 32 jobs, they improved on the baseline by a small margin. check out everything I learnt in thread.

here's a hands on guide to setup multi-agent autoresearch by Andrej Karpathy. uses open models. works with codex, claude, open code. - uses 5 agents each with a configuration, specific tools, roles, and permission (see repo) - a researcher agent searches papers on hf papers and creates hypotheses - a planner agent maintains an experiment plan and log - workers take the hypotheses and updates the scripts, then it starts a hf job with a gpu to run the script - a reporter agent monitors these jobs and reports events and metrics to a TrackioApp dashboard I ran this for 4 hours and the agents ran 32 jobs, they improved on the baseline by a small margin. check out everything I learnt in thread.

Ben Burtenshaw

90,641 Aufrufe • vor 2 Monaten

➡️ Sometimes, the best way to capture information is with a clear diagram! Our latest AI tool, AI Diagrams, takes simple text and turns it into the visual of your choice. From there, easily save the result to your Evernote account, or copy/download it directly from the web. Check it out below👇and try the tool for yourself:

➡️ Sometimes, the best way to capture information is with a clear diagram! Our latest AI tool, AI Diagrams, takes simple text and turns it into the visual of your choice. From there, easily save the result to your Evernote account, or copy/download it directly from the web. Check it out below👇and try the tool for yourself:

Evernote

16,827 Aufrufe • vor 11 Monaten

I am hooked on Dynamic Workflows! The idea of generating harnesses on the fly is so compelling that I reverse-engineered it for my agent orchestrator. And then I built a monitoring dashboard (as an HTML artifact) to track tasks, metrics, and reports. I can now use and monitor dynamic workflows in my agent orchestrator with coding agents like Claude Code, Codex, Pi, and even my own custom-built DAIR.AI agent. This is clearly the future of working with agents to accomplish complex, long-running tasks. Some use cases I'm having success with: - Branching deep research tasks (with verification) - Parallel deep research tasks - Session mining of all my agent sessions - Bug hunting - Triaging - Fact-checking - LLM councils - AI simulations - Data synthesis - Evals generation ... and many others Dynamic workflows, like agent skills, feel like an important primitive to not only get the most out of agents but also incorporate dynamic behaviors and important components like cooperation and verification. There is so much exploration ground here. The exciting part is that this is not limited to coding tasks; it extends to business use cases and many other technical domains like science and research.

I am hooked on Dynamic Workflows! The idea of generating harnesses on the fly is so compelling that I reverse-engineered it for my agent orchestrator. And then I built a monitoring dashboard (as an HTML artifact) to track tasks, metrics, and reports. I can now use and monitor dynamic workflows in my agent orchestrator with coding agents like Claude Code, Codex, Pi, and even my own custom-built DAIR.AI agent. This is clearly the future of working with agents to accomplish complex, long-running tasks. Some use cases I'm having success with: - Branching deep research tasks (with verification) - Parallel deep research tasks - Session mining of all my agent sessions - Bug hunting - Triaging - Fact-checking - LLM councils - AI simulations - Data synthesis - Evals generation ... and many others Dynamic workflows, like agent skills, feel like an important primitive to not only get the most out of agents but also incorporate dynamic behaviors and important components like cooperation and verification. There is so much exploration ground here. The exciting part is that this is not limited to coding tasks; it extends to business use cases and many other technical domains like science and research.

elvis

102,712 Aufrufe • vor 1 Monat