Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

This is pure witchcraft! A single line of code makes my Pandas code 5x faster! I don't have to migrate to a different library or change anything else. The magic happens by patching Pandas with FireDucks, a multi-threaded, compiler-accelerated library with a fully compatible pandas API. The library makes... show more

Santiago

452,371 subscribers

51,995 views • 1 year ago •via X (Twitter)

Science & Technology News & Politics Education

Anya Rossi• Live Now

Private livecam show

11 Comments

Santiago1 year ago

Here is a link to the code I show in the video: Here is FireDucks' GitHub Repository: This notebook compares FireDucks with Polars and Pandas: Finally, a few benchmarks:

Santiago1 year ago

If you prefer to watch the video on YouTube, here is the link:

Matt Figdore2 years ago

This is the biggest productivity cheat code right now. Kiss reading documents goodbye. You can get an instant summary of any document with this tool.

Subhajit Bhar1 year ago

One quick question: Is this speedup due only to multithreading? Also, have you tested Polars? What’s your opinion on it?

Raunak Rangari1 year ago

Your vey helpfull for so many peopels🔥

Albert1 year ago

Why does pandas try to reinvent the wheel when SQL and @duckdb already do the job?

Tomislav1 year ago

You forgot to mention its for Linux. Ouch, killed your post.

🧪Juice 🧃1 year ago

Hey there, you should try using pandas on on a gpu. CuDF is even crazier.

Anda1 year ago

"Friendly reminder that even pandas need optimized bamboo-munching techniques to boost their performance!" 🐼🎋

Muhammad Waqar Afzal1 year ago

Does it work on mac and windows?

Rodrigo1 year ago

What prevents pandas to adopt the optimizations?

Related Videos

FireDucks makes Pandas 125x Faster... ...by changing JUST ONE LINE of code. Pandas has some major limitations: - Pandas only uses a single CPU core. - It often creates memory-heavy DataFrames. - Its eager (immediate) execution prevents global optimization of operation sequences. FireDucks is a highly optimized, drop-in replacement for Pandas with the same API. To use FireDucks: Remove this: ↳ import pandas as pd Add this: ↳ import fireducks.pandas as pd And you're done! ✔️ A performance comparison of FireDucks vs. DuckDB, Polars, and Pandas is shown in the video below. Official benchmarks indicate: - Modin: ~1.0x faster than Pandas - Polars: ~57x faster than Pandas - FireDucks: ~125x faster than Pandas I have shared a detailed article on this in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

FireDucks makes Pandas 125x Faster... ...by changing JUST ONE LINE of code. Pandas has some major limitations: - Pandas only uses a single CPU core. - It often creates memory-heavy DataFrames. - Its eager (immediate) execution prevents global optimization of operation sequences. FireDucks is a highly optimized, drop-in replacement for Pandas with the same API. To use FireDucks: Remove this: ↳ import pandas as pd Add this: ↳ import fireducks.pandas as pd And you're done! ✔️ A performance comparison of FireDucks vs. DuckDB, Polars, and Pandas is shown in the video below. Official benchmarks indicate: - Modin: ~1.0x faster than Pandas - Polars: ~57x faster than Pandas - FireDucks: ~125x faster than Pandas I have shared a detailed article on this in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

Akshay 🚀

218,990 views • 1 year ago

Ran two prompts in Kimi K2.7 Code HighSpeed, Kimi K2.7 Code, and GLM 5.2 HighSpeed is 2.5 to 4.2 times faster than Kimi K2.7 Code while producing comparable quality 4.5 to 15 times faster than GLM 5.2, and half the price (or less) These are simple tests, so the pricing difference is small and speed difference could diverge a lot But definitely a hell of a lot faster with good output

Ran two prompts in Kimi K2.7 Code HighSpeed, Kimi K2.7 Code, and GLM 5.2 HighSpeed is 2.5 to 4.2 times faster than Kimi K2.7 Code while producing comparable quality 4.5 to 15 times faster than GLM 5.2, and half the price (or less) These are simple tests, so the pricing difference is small and speed difference could diverge a lot But definitely a hell of a lot faster with good output

GMI Cloud

38,174 views • 1 month ago

This is the best Claude Code workflow ever In this video I cover how to run 5 Claudes in the terminal to create apps SO much faster Dead simple and really powerful Whether you've never used Claude Code before or you're a pro, you're going to learn a ton from this video:

This is the best Claude Code workflow ever In this video I cover how to run 5 Claudes in the terminal to create apps SO much faster Dead simple and really powerful Whether you've never used Claude Code before or you're a pro, you're going to learn a ton from this video:

Alex Finn

68,448 views • 7 months ago

damn its so easy to go from design -> code with Figma MCP + Claude Code. literally just one click of a button, and the code is ready! still a lot of polishing to do, but this has helped us make development ~50% faster 😁

damn its so easy to go from design -> code with Figma MCP + Claude Code. literally just one click of a button, and the code is ready! still a lot of polishing to do, but this has helped us make development ~50% faster 😁

Marcel

54,670 views • 6 months ago

The new ChatGPT Mac app is amazing. I got a fully working Breakout game code using a shortcut to pull up the app with GPT-4o and a simple screenshot of my screen. So many use cases and faster workflows.

The new ChatGPT Mac app is amazing. I got a fully working Breakout game code using a shortcut to pull up the app with GPT-4o and a simple screenshot of my screen. So many use cases and faster workflows.

Alvaro Cintas

1,729,875 views • 2 years ago

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Santiago

155,179 views • 2 years ago

I'm excited to introduce my FREE AI Pandas Data Analyst Copilot which created a data analysis report with dozens of charts from my questions in under 30 seconds. Today, I'll share with you how to automate data analysis with my Pandas AI Agent + Copilot, which is available on GitHub. I'll guide you through setting up the Copilot app, creating dozens of data analysis charts from any CSV or Excel file, and interacting with your data live. This AI is a BIG help! Table of Contents: 00:00 Introduction to the App 02:24 Setting Up the App 04:25 Using the App 08:58 Understanding the Python Code Github to AI Data Science Team (app is in the apps folder): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: === Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, April 9th, I'm sharing one of my best AI Projects: Time Series Forecasting with AI Register here (500 Seats):

I'm excited to introduce my FREE AI Pandas Data Analyst Copilot which created a data analysis report with dozens of charts from my questions in under 30 seconds. Today, I'll share with you how to automate data analysis with my Pandas AI Agent + Copilot, which is available on GitHub. I'll guide you through setting up the Copilot app, creating dozens of data analysis charts from any CSV or Excel file, and interacting with your data live. This AI is a BIG help! Table of Contents: 00:00 Introduction to the App 02:24 Setting Up the App 04:25 Using the App 08:58 Understanding the Python Code Github to AI Data Science Team (app is in the apps folder): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: === Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, April 9th, I'm sharing one of my best AI Projects: Time Series Forecasting with AI Register here (500 Seats):

Matt Dancho (Business Science)

12,736 views • 1 year ago

Stage is a code review platform designed to help engineers understand AI-generated code. Your team is drowning in an endless backlog of PRs. Stage turns code review into a guided process and enables you to review changes faster than using GitHub. Congrats on the launch, Charles Pan and Dean Stratakos!

Stage is a code review platform designed to help engineers understand AI-generated code. Your team is drowning in an endless backlog of PRs. Stage turns code review into a guided process and enables you to review changes faster than using GitHub. Congrats on the launch, Charles Pan and Dean Stratakos!

Y Combinator

1,063,689 views • 3 months ago

Today is a big day! We're launching a ~ new ~ version of Claude Code in the desktop app. It's been redesigned from the ground up for parallel work and is a lot faster. It's been my main way to use Claude Code for the last few weeks.

Today is a big day! We're launching a ~ new ~ version of Claude Code in the desktop app. It's been redesigned from the ground up for parallel work and is a lot faster. It's been my main way to use Claude Code for the last few weeks.

Felix Rieseberg

954,010 views • 4 months ago

AntiGravity just became UNSTOPPABLE (with Open Code) Nothing kills momentum faster than hitting a rate limit mid-build. I fixed this by adding Open Code to AntiGravity/Cursor. Now I have 150+ models on demand. Here’s the setup 👇

AntiGravity just became UNSTOPPABLE (with Open Code) Nothing kills momentum faster than hitting a rate limit mid-build. I fixed this by adding Open Code to AntiGravity/Cursor. Now I have 150+ models on demand. Here’s the setup 👇

Prajwal Tomar

134,242 views • 6 months ago

You should really stop using Zapier, Make or n8n Generating a Python script and running it is much faster (and cheaper) using: - o3-mini / Claude / Gemini to create the script - Python Code Runner (free Chrome extension) to run it And it only takes a few minutes. Link below

You should really stop using Zapier, Make or n8n Generating a Python script and running it is much faster (and cheaper) using: - o3-mini / Claude / Gemini to create the script - Python Code Runner (free Chrome extension) to run it And it only takes a few minutes. Link below

Paul Couvert

166,508 views • 1 year ago

This library will blow up for a simple reason: It's the best for building a chatbot that doesn't hallucinate and knows how to answer questions. It's open-source, and it literally takes a few lines of code to run. Check the attached video.

This library will blow up for a simple reason: It's the best for building a chatbot that doesn't hallucinate and knows how to answer questions. It's open-source, and it literally takes a few lines of code to run. Check the attached video.

Santiago

107,908 views • 1 year ago

Couldn't agree more with Linus here. Making your code running as fast as possible (or just faster than someone's else code) is the best feeling you can get from programming The issue that it is extremely hard to find the project that will pay you for instruction level efficiency

Couldn't agree more with Linus here. Making your code running as fast as possible (or just faster than someone's else code) is the best feeling you can get from programming The issue that it is extremely hard to find the project that will pay you for instruction level efficiency

Dmitriy Kovalenko

416,855 views • 11 months ago

PANS and PANDAS are extremely serious but little understood paediatric conditions which can impact any child. On this 15th annual awareness day, I'm pleased to have raised this with the Prime Minister and secured his promise of a meeting for PANS PANDAS UK with the Health Dept.

PANS and PANDAS are extremely serious but little understood paediatric conditions which can impact any child. On this 15th annual awareness day, I'm pleased to have raised this with the Prime Minister and secured his promise of a meeting for PANS PANDAS UK with the Health Dept.

Wendy Chamberlain

22,007 views • 1 year ago

Let's face it: AI can check your code 100x faster and catch 10x more issues than you can. "Code reviews" as a widespread practice is not coming back. There are only two reasons we should consider code reviews today: 1. To transfer knowledge within a team. 2. To ensure AI didn't miss critical aspects in the code. We are getting closer to a point where manually reviewing code will be as relevant as punching holes in a punch card. Here is one idea for you:

Let's face it: AI can check your code 100x faster and catch 10x more issues than you can. "Code reviews" as a widespread practice is not coming back. There are only two reasons we should consider code reviews today: 1. To transfer knowledge within a team. 2. To ensure AI didn't miss critical aspects in the code. We are getting closer to a point where manually reviewing code will be as relevant as punching holes in a punch card. Here is one idea for you:

Santiago

48,783 views • 1 year ago

Here's how to build your first MCP tool and server with less than 10 Lines of Python code🐍✨ Tried to make this video as short as possible and show the code, the json config and running the server in vs code with github copilot💜

Here's how to build your first MCP tool and server with less than 10 Lines of Python code🐍✨ Tried to make this video as short as possible and show the code, the json config and running the server in vs code with github copilot💜

Marlene Mhangami

14,603 views • 1 year ago

Since being contacted by a family in my constituency earlier this year I have been working to improve recognition of the conditions PANS and PANDAS which affect children. 1/3

Since being contacted by a family in my constituency earlier this year I have been working to improve recognition of the conditions PANS and PANDAS which affect children. 1/3

Wendy Chamberlain

13,485 views • 2 years ago

This is literally the easiest way to build an AI agent. Zero code. You only need to run a couple of commands. (I've said this before, but Google ADK is my favorite way to build code-first agents.) Here is what you need to do: 1. Open your terminal and create an empty folder 2. Run `uv init` inside the folder (if you don't have uv installed, you are really missing out!) 3. Install the google-adk library using the following command: `uv add google-adk`. 4. At this point, you can use the ask to create your agent with a single command: `uv run adk create --type=config my_agent`. This will ask you a couple of questions, including your GEMINI_API_KEY (you can create one online). 5. The command above will create a my_agent/root_agent.yaml file. Open it and add the following two lines at the end of the file so your agent can use Google to search for stuff: tools: - name: google_search 6. You have everything you need now. Run the adk web interface and start playing with your agent: `uv run adk web` That's it! Literally zero code. The agent works off the YAML configuration file.

This is literally the easiest way to build an AI agent. Zero code. You only need to run a couple of commands. (I've said this before, but Google ADK is my favorite way to build code-first agents.) Here is what you need to do: 1. Open your terminal and create an empty folder 2. Run `uv init` inside the folder (if you don't have uv installed, you are really missing out!) 3. Install the google-adk library using the following command: `uv add google-adk`. 4. At this point, you can use the ask to create your agent with a single command: `uv run adk create --type=config my_agent`. This will ask you a couple of questions, including your GEMINI_API_KEY (you can create one online). 5. The command above will create a my_agent/root_agent.yaml file. Open it and add the following two lines at the end of the file so your agent can use Google to search for stuff: tools: - name: google_search 6. You have everything you need now. Run the adk web interface and start playing with your agent: `uv run adk web` That's it! Literally zero code. The agent works off the YAML configuration file.

Santiago

140,922 views • 8 months ago