Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

This is pure witchcraft! A single line of code makes my Pandas code 5x faster! I don't have to migrate to a different library or change anything else. The magic happens by patching Pandas with FireDucks, a multi-threaded, compiler-accelerated library with a fully compatible pandas API. The library makes... show more

Santiago

452,371 subscribers

51,995 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie Nachrichten & Politik Bildung

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Santiago

Santiagovor 1 Jahr

Here is a link to the code I show in the video: Here is FireDucks' GitHub Repository: This notebook compares FireDucks with Polars and Pandas: Finally, a few benchmarks:

Profilbild von Santiago

Santiagovor 1 Jahr

If you prefer to watch the video on YouTube, here is the link:

Profilbild von Matt Figdore

Matt Figdorevor 2 Jahren

This is the biggest productivity cheat code right now. Kiss reading documents goodbye. You can get an instant summary of any document with this tool.

Profilbild von Subhajit Bhar

Subhajit Bharvor 1 Jahr

One quick question: Is this speedup due only to multithreading? Also, have you tested Polars? What’s your opinion on it?

Profilbild von Raunak Rangari

Raunak Rangarivor 1 Jahr

Your vey helpfull for so many peopels🔥

Profilbild von Albert

Albertvor 1 Jahr

Why does pandas try to reinvent the wheel when SQL and @duckdb already do the job?

Profilbild von Tomislav

Tomislavvor 1 Jahr

You forgot to mention its for Linux. Ouch, killed your post.

Profilbild von 🧪Juice 🧃

🧪Juice 🧃vor 1 Jahr

Hey there, you should try using pandas on on a gpu. CuDF is even crazier.

Profilbild von Anda

Andavor 1 Jahr

"Friendly reminder that even pandas need optimized bamboo-munching techniques to boost their performance!" 🐼🎋

Profilbild von Muhammad Waqar Afzal

Muhammad Waqar Afzalvor 1 Jahr

Does it work on mac and windows?

Profilbild von Rodrigo

Rodrigovor 1 Jahr

What prevents pandas to adopt the optimizations?

Ähnliche Videos

FireDucks makes Pandas 125x Faster... ...by changing JUST ONE LINE of code. Pandas has some major limitations: - Pandas only uses a single CPU core. - It often creates memory-heavy DataFrames. - Its eager (immediate) execution prevents global optimization of operation sequences. FireDucks is a highly optimized, drop-in replacement for Pandas with the same API. To use FireDucks: Remove this: ↳ import pandas as pd Add this: ↳ import fireducks.pandas as pd And you're done! ✔️ A performance comparison of FireDucks vs. DuckDB, Polars, and Pandas is shown in the video below. Official benchmarks indicate: - Modin: ~1.0x faster than Pandas - Polars: ~57x faster than Pandas - FireDucks: ~125x faster than Pandas I have shared a detailed article on this in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

FireDucks makes Pandas 125x Faster... ...by changing JUST ONE LINE of code. Pandas has some major limitations: - Pandas only uses a single CPU core. - It often creates memory-heavy DataFrames. - Its eager (immediate) execution prevents global optimization of operation sequences. FireDucks is a highly optimized, drop-in replacement for Pandas with the same API. To use FireDucks: Remove this: ↳ import pandas as pd Add this: ↳ import fireducks.pandas as pd And you're done! ✔️ A performance comparison of FireDucks vs. DuckDB, Polars, and Pandas is shown in the video below. Official benchmarks indicate: - Modin: ~1.0x faster than Pandas - Polars: ~57x faster than Pandas - FireDucks: ~125x faster than Pandas I have shared a detailed article on this in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

Akshay 🚀

218,990 Aufrufe • vor 1 Jahr

Ran two prompts in Kimi K2.7 Code HighSpeed, Kimi K2.7 Code, and GLM 5.2 HighSpeed is 2.5 to 4.2 times faster than Kimi K2.7 Code while producing comparable quality 4.5 to 15 times faster than GLM 5.2, and half the price (or less) These are simple tests, so the pricing difference is small and speed difference could diverge a lot But definitely a hell of a lot faster with good output

Ran two prompts in Kimi K2.7 Code HighSpeed, Kimi K2.7 Code, and GLM 5.2 HighSpeed is 2.5 to 4.2 times faster than Kimi K2.7 Code while producing comparable quality 4.5 to 15 times faster than GLM 5.2, and half the price (or less) These are simple tests, so the pricing difference is small and speed difference could diverge a lot But definitely a hell of a lot faster with good output

GMI Cloud

38,174 Aufrufe • vor 1 Monat

This is the best Claude Code workflow ever In this video I cover how to run 5 Claudes in the terminal to create apps SO much faster Dead simple and really powerful Whether you've never used Claude Code before or you're a pro, you're going to learn a ton from this video:

This is the best Claude Code workflow ever In this video I cover how to run 5 Claudes in the terminal to create apps SO much faster Dead simple and really powerful Whether you've never used Claude Code before or you're a pro, you're going to learn a ton from this video:

Alex Finn

68,448 Aufrufe • vor 6 Monaten

damn its so easy to go from design -> code with Figma MCP + Claude Code. literally just one click of a button, and the code is ready! still a lot of polishing to do, but this has helped us make development ~50% faster 😁

damn its so easy to go from design -> code with Figma MCP + Claude Code. literally just one click of a button, and the code is ready! still a lot of polishing to do, but this has helped us make development ~50% faster 😁

Marcel

54,524 Aufrufe • vor 5 Monaten

The new ChatGPT Mac app is amazing. I got a fully working Breakout game code using a shortcut to pull up the app with GPT-4o and a simple screenshot of my screen. So many use cases and faster workflows.

The new ChatGPT Mac app is amazing. I got a fully working Breakout game code using a shortcut to pull up the app with GPT-4o and a simple screenshot of my screen. So many use cases and faster workflows.

Alvaro Cintas

1,729,806 Aufrufe • vor 2 Jahren

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Santiago

155,179 Aufrufe • vor 2 Jahren

I'm excited to introduce my FREE AI Pandas Data Analyst Copilot which created a data analysis report with dozens of charts from my questions in under 30 seconds. Today, I'll share with you how to automate data analysis with my Pandas AI Agent + Copilot, which is available on GitHub. I'll guide you through setting up the Copilot app, creating dozens of data analysis charts from any CSV or Excel file, and interacting with your data live. This AI is a BIG help! Table of Contents: 00:00 Introduction to the App 02:24 Setting Up the App 04:25 Using the App 08:58 Understanding the Python Code Github to AI Data Science Team (app is in the apps folder): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: === Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, April 9th, I'm sharing one of my best AI Projects: Time Series Forecasting with AI Register here (500 Seats):

I'm excited to introduce my FREE AI Pandas Data Analyst Copilot which created a data analysis report with dozens of charts from my questions in under 30 seconds. Today, I'll share with you how to automate data analysis with my Pandas AI Agent + Copilot, which is available on GitHub. I'll guide you through setting up the Copilot app, creating dozens of data analysis charts from any CSV or Excel file, and interacting with your data live. This AI is a BIG help! Table of Contents: 00:00 Introduction to the App 02:24 Setting Up the App 04:25 Using the App 08:58 Understanding the Python Code Github to AI Data Science Team (app is in the apps folder): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: === Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, April 9th, I'm sharing one of my best AI Projects: Time Series Forecasting with AI Register here (500 Seats):

Matt Dancho (Business Science)

12,736 Aufrufe • vor 1 Jahr

Stage is a code review platform designed to help engineers understand AI-generated code. Your team is drowning in an endless backlog of PRs. Stage turns code review into a guided process and enables you to review changes faster than using GitHub. Congrats on the launch, Charles Pan and Dean Stratakos!

Stage is a code review platform designed to help engineers understand AI-generated code. Your team is drowning in an endless backlog of PRs. Stage turns code review into a guided process and enables you to review changes faster than using GitHub. Congrats on the launch, Charles Pan and Dean Stratakos!

Y Combinator

1,063,555 Aufrufe • vor 2 Monaten

Today is a big day! We're launching a ~ new ~ version of Claude Code in the desktop app. It's been redesigned from the ground up for parallel work and is a lot faster. It's been my main way to use Claude Code for the last few weeks.

Today is a big day! We're launching a ~ new ~ version of Claude Code in the desktop app. It's been redesigned from the ground up for parallel work and is a lot faster. It's been my main way to use Claude Code for the last few weeks.

Felix Rieseberg

953,428 Aufrufe • vor 3 Monaten

AntiGravity just became UNSTOPPABLE (with Open Code) Nothing kills momentum faster than hitting a rate limit mid-build. I fixed this by adding Open Code to AntiGravity/Cursor. Now I have 150+ models on demand. Here’s the setup 👇

AntiGravity just became UNSTOPPABLE (with Open Code) Nothing kills momentum faster than hitting a rate limit mid-build. I fixed this by adding Open Code to AntiGravity/Cursor. Now I have 150+ models on demand. Here’s the setup 👇

Prajwal Tomar

134,242 Aufrufe • vor 6 Monaten

This library will blow up for a simple reason: It's the best for building a chatbot that doesn't hallucinate and knows how to answer questions. It's open-source, and it literally takes a few lines of code to run. Check the attached video.

This library will blow up for a simple reason: It's the best for building a chatbot that doesn't hallucinate and knows how to answer questions. It's open-source, and it literally takes a few lines of code to run. Check the attached video.

Santiago

107,840 Aufrufe • vor 11 Monaten

You should really stop using Zapier, Make or n8n Generating a Python script and running it is much faster (and cheaper) using: - o3-mini / Claude / Gemini to create the script - Python Code Runner (free Chrome extension) to run it And it only takes a few minutes. Link below

You should really stop using Zapier, Make or n8n Generating a Python script and running it is much faster (and cheaper) using: - o3-mini / Claude / Gemini to create the script - Python Code Runner (free Chrome extension) to run it And it only takes a few minutes. Link below

Paul Couvert

166,508 Aufrufe • vor 1 Jahr

Couldn't agree more with Linus here. Making your code running as fast as possible (or just faster than someone's else code) is the best feeling you can get from programming The issue that it is extremely hard to find the project that will pay you for instruction level efficiency

Couldn't agree more with Linus here. Making your code running as fast as possible (or just faster than someone's else code) is the best feeling you can get from programming The issue that it is extremely hard to find the project that will pay you for instruction level efficiency

Dmitriy Kovalenko

416,855 Aufrufe • vor 11 Monaten

I built an open source data analyst agent! Upload any CSV, ask a question, and get it answered with statistics or a nice chart. Launching in 24 hours. 100% free & open source. Under the hood, here's how it works: 1. User uploads a CSV and asks a question. 2. The app uses Together Code Interpreter to spin up a VM and uploads the CSV onto it. 3. I have an LLM (Qwen 3 Coder) write code to interpret the CSV using `pandas`, then solve the question the user asked. 4. Together Code Interpreter runs the code in a secure environment & returns a result. These results can be text (some kind of stats analysis) or a chart.

I built an open source data analyst agent! Upload any CSV, ask a question, and get it answered with statistics or a nice chart. Launching in 24 hours. 100% free & open source. Under the hood, here's how it works: 1. User uploads a CSV and asks a question. 2. The app uses Together Code Interpreter to spin up a VM and uploads the CSV onto it. 3. I have an LLM (Qwen 3 Coder) write code to interpret the CSV using `pandas`, then solve the question the user asked. 4. Together Code Interpreter runs the code in a secure environment & returns a result. These results can be text (some kind of stats analysis) or a chart.

Hassan

27,086 Aufrufe • vor 11 Monaten

PANS and PANDAS are extremely serious but little understood paediatric conditions which can impact any child. On this 15th annual awareness day, I'm pleased to have raised this with the Prime Minister and secured his promise of a meeting for PANS PANDAS UK with the Health Dept.

PANS and PANDAS are extremely serious but little understood paediatric conditions which can impact any child. On this 15th annual awareness day, I'm pleased to have raised this with the Prime Minister and secured his promise of a meeting for PANS PANDAS UK with the Health Dept.

Wendy Chamberlain

21,984 Aufrufe • vor 1 Jahr

Let's face it: AI can check your code 100x faster and catch 10x more issues than you can. "Code reviews" as a widespread practice is not coming back. There are only two reasons we should consider code reviews today: 1. To transfer knowledge within a team. 2. To ensure AI didn't miss critical aspects in the code. We are getting closer to a point where manually reviewing code will be as relevant as punching holes in a punch card. Here is one idea for you:

Let's face it: AI can check your code 100x faster and catch 10x more issues than you can. "Code reviews" as a widespread practice is not coming back. There are only two reasons we should consider code reviews today: 1. To transfer knowledge within a team. 2. To ensure AI didn't miss critical aspects in the code. We are getting closer to a point where manually reviewing code will be as relevant as punching holes in a punch card. Here is one idea for you:

Santiago

48,783 Aufrufe • vor 1 Jahr

Here's how to build your first MCP tool and server with less than 10 Lines of Python code🐍✨ Tried to make this video as short as possible and show the code, the json config and running the server in vs code with github copilot💜

Here's how to build your first MCP tool and server with less than 10 Lines of Python code🐍✨ Tried to make this video as short as possible and show the code, the json config and running the server in vs code with github copilot💜

Marlene Mhangami

14,603 Aufrufe • vor 1 Jahr

Since being contacted by a family in my constituency earlier this year I have been working to improve recognition of the conditions PANS and PANDAS which affect children. 1/3

Since being contacted by a family in my constituency earlier this year I have been working to improve recognition of the conditions PANS and PANDAS which affect children. 1/3

Wendy Chamberlain

13,485 Aufrufe • vor 2 Jahren

This is literally the easiest way to build an AI agent. Zero code. You only need to run a couple of commands. (I've said this before, but Google ADK is my favorite way to build code-first agents.) Here is what you need to do: 1. Open your terminal and create an empty folder 2. Run `uv init` inside the folder (if you don't have uv installed, you are really missing out!) 3. Install the google-adk library using the following command: `uv add google-adk`. 4. At this point, you can use the ask to create your agent with a single command: `uv run adk create --type=config my_agent`. This will ask you a couple of questions, including your GEMINI_API_KEY (you can create one online). 5. The command above will create a my_agent/root_agent.yaml file. Open it and add the following two lines at the end of the file so your agent can use Google to search for stuff: tools: - name: google_search 6. You have everything you need now. Run the adk web interface and start playing with your agent: `uv run adk web` That's it! Literally zero code. The agent works off the YAML configuration file.

This is literally the easiest way to build an AI agent. Zero code. You only need to run a couple of commands. (I've said this before, but Google ADK is my favorite way to build code-first agents.) Here is what you need to do: 1. Open your terminal and create an empty folder 2. Run `uv init` inside the folder (if you don't have uv installed, you are really missing out!) 3. Install the google-adk library using the following command: `uv add google-adk`. 4. At this point, you can use the ask to create your agent with a single command: `uv run adk create --type=config my_agent`. This will ask you a couple of questions, including your GEMINI_API_KEY (you can create one online). 5. The command above will create a my_agent/root_agent.yaml file. Open it and add the following two lines at the end of the file so your agent can use Google to search for stuff: tools: - name: google_search 6. You have everything you need now. Run the adk web interface and start playing with your agent: `uv run adk web` That's it! Literally zero code. The agent works off the YAML configuration file.

Santiago

140,873 Aufrufe • vor 8 Monaten