Загрузка видео...

Не удалось загрузить видео

На главную

This is pure witchcraft! A single line of code makes my Pandas code 5x faster! I don't have to migrate to a different library or change anything else. The magic happens by patching Pandas with FireDucks, a multi-threaded, compiler-accelerated library with a fully compatible pandas API. The library makes...

svpino's profile picture

Santiago

452,371 subscribers

51,995 просмотров • 1 год назад •via X (Twitter)

Наука и технологииНовости и политикаОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 11

Фото профиля Santiago
Santiago1 год назад

Here is a link to the code I show in the video: Here is FireDucks' GitHub Repository: This notebook compares FireDucks with Polars and Pandas: Finally, a few benchmarks:

Фото профиля Santiago
Santiago1 год назад

If you prefer to watch the video on YouTube, here is the link:

Фото профиля Matt Figdore
Matt Figdore2 лет назад

This is the biggest productivity cheat code right now. Kiss reading documents goodbye. You can get an instant summary of any document with this tool.

Фото профиля Subhajit Bhar
Subhajit Bhar1 год назад

One quick question: Is this speedup due only to multithreading? Also, have you tested Polars? What’s your opinion on it?

Фото профиля Raunak Rangari
Raunak Rangari1 год назад

Your vey helpfull for so many peopels🔥

Фото профиля Albert
Albert1 год назад

Why does pandas try to reinvent the wheel when SQL and @duckdb already do the job?

Фото профиля Tomislav
Tomislav1 год назад

You forgot to mention its for Linux. Ouch, killed your post.

Фото профиля 🧪Juice 🧃
🧪Juice 🧃1 год назад

Hey there, you should try using pandas on on a gpu. CuDF is even crazier.

Фото профиля Anda
Anda1 год назад

"Friendly reminder that even pandas need optimized bamboo-munching techniques to boost their performance!" 🐼🎋

Фото профиля Muhammad Waqar Afzal
Muhammad Waqar Afzal1 год назад

Does it work on mac and windows?

Фото профиля Rodrigo
Rodrigo1 год назад

What prevents pandas to adopt the optimizations?

Похожие видео

FireDucks makes Pandas 125x Faster... ...by changing JUST ONE LINE of code. Pandas has some major limitations: - Pandas only uses a single CPU core. - It often creates memory-heavy DataFrames. - Its eager (immediate) execution prevents global optimization of operation sequences. FireDucks is a highly optimized, drop-in replacement for Pandas with the same API. To use FireDucks: Remove this: ↳ import pandas as pd Add this: ↳ import fireducks.pandas as pd And you're done! ✔️ A performance comparison of FireDucks vs. DuckDB, Polars, and Pandas is shown in the video below. Official benchmarks indicate: - Modin: ~1.0x faster than Pandas - Polars: ~57x faster than Pandas - FireDucks: ~125x faster than Pandas I have shared a detailed article on this in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!
0:37

FireDucks makes Pandas 125x Faster... ...by changing JUST ONE LINE of code. Pandas has some major limitations: - Pandas only uses a single CPU core. - It often creates memory-heavy DataFrames. - Its eager (immediate) execution prevents global optimization of operation sequences. FireDucks is a highly optimized, drop-in replacement for Pandas with the same API. To use FireDucks: Remove this: ↳ import pandas as pd Add this: ↳ import fireducks.pandas as pd And you're done! ✔️ A performance comparison of FireDucks vs. DuckDB, Polars, and Pandas is shown in the video below. Official benchmarks indicate: - Modin: ~1.0x faster than Pandas - Polars: ~57x faster than Pandas - FireDucks: ~125x faster than Pandas I have shared a detailed article on this in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

Akshay 🚀

218,990 просмотров • 1 год назад

Ran two prompts in Kimi K2.7 Code HighSpeed, Kimi K2.7 Code, and GLM 5.2 HighSpeed is 2.5 to 4.2 times faster than Kimi K2.7 Code while producing comparable quality 4.5 to 15 times faster than GLM 5.2, and half the price (or less) These are simple tests, so the pricing difference is small and speed difference could diverge a lot But definitely a hell of a lot faster with good output
0:53

Ran two prompts in Kimi K2.7 Code HighSpeed, Kimi K2.7 Code, and GLM 5.2 HighSpeed is 2.5 to 4.2 times faster than Kimi K2.7 Code while producing comparable quality 4.5 to 15 times faster than GLM 5.2, and half the price (or less) These are simple tests, so the pricing difference is small and speed difference could diverge a lot But definitely a hell of a lot faster with good output

GMI Cloud

38,174 просмотров • 1 месяц назад

This is the best Claude Code workflow ever In this video I cover how to run 5 Claudes in the terminal to create apps SO much faster Dead simple and really powerful Whether you've never used Claude Code before or you're a pro, you're going to learn a ton from this video:
17:13

This is the best Claude Code workflow ever In this video I cover how to run 5 Claudes in the terminal to create apps SO much faster Dead simple and really powerful Whether you've never used Claude Code before or you're a pro, you're going to learn a ton from this video:

Alex Finn

68,448 просмотров • 7 месяцев назад

damn its so easy to go from design -> code with Figma MCP + Claude Code. literally just one click of a button, and the code is ready! still a lot of polishing to do, but this has helped us make development ~50% faster 😁
1:19

damn its so easy to go from design -> code with Figma MCP + Claude Code. literally just one click of a button, and the code is ready! still a lot of polishing to do, but this has helped us make development ~50% faster 😁

Marcel

54,524 просмотров • 6 месяцев назад

The new ChatGPT Mac app is amazing. I got a fully working Breakout game code using a shortcut to pull up the app with GPT-4o and a simple screenshot of my screen. So many use cases and faster workflows.
0:29

The new ChatGPT Mac app is amazing. I got a fully working Breakout game code using a shortcut to pull up the app with GPT-4o and a simple screenshot of my screen. So many use cases and faster workflows.

Alvaro Cintas

1,729,875 просмотров • 2 лет назад

I'm excited to introduce my FREE AI Pandas Data Analyst Copilot which created a data analysis report with dozens of charts from my questions in under 30 seconds. Today, I'll share with you how to automate data analysis with my Pandas AI Agent + Copilot, which is available on GitHub. I'll guide you through setting up the Copilot app, creating dozens of data analysis charts from any CSV or Excel file, and interacting with your data live. This AI is a BIG help! Table of Contents: 00:00 Introduction to the App 02:24 Setting Up the App 04:25 Using the App 08:58 Understanding the Python Code Github to AI Data Science Team (app is in the apps folder): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: === Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, April 9th, I'm sharing one of my best AI Projects: Time Series Forecasting with AI Register here (500 Seats):
10:27

I'm excited to introduce my FREE AI Pandas Data Analyst Copilot which created a data analysis report with dozens of charts from my questions in under 30 seconds. Today, I'll share with you how to automate data analysis with my Pandas AI Agent + Copilot, which is available on GitHub. I'll guide you through setting up the Copilot app, creating dozens of data analysis charts from any CSV or Excel file, and interacting with your data live. This AI is a BIG help! Table of Contents: 00:00 Introduction to the App 02:24 Setting Up the App 04:25 Using the App 08:58 Understanding the Python Code Github to AI Data Science Team (app is in the apps folder): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: === Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, April 9th, I'm sharing one of my best AI Projects: Time Series Forecasting with AI Register here (500 Seats):

Matt Dancho (Business Science)

12,736 просмотров • 1 год назад

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.
0:45

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Santiago

155,179 просмотров • 2 лет назад

Stage is a code review platform designed to help engineers understand AI-generated code. Your team is drowning in an endless backlog of PRs. Stage turns code review into a guided process and enables you to review changes faster than using GitHub. Congrats on the launch, Charles Pan and Dean Stratakos!
0:50

Stage is a code review platform designed to help engineers understand AI-generated code. Your team is drowning in an endless backlog of PRs. Stage turns code review into a guided process and enables you to review changes faster than using GitHub. Congrats on the launch, Charles Pan and Dean Stratakos!

Y Combinator

1,063,689 просмотров • 2 месяцев назад

AntiGravity just became UNSTOPPABLE (with Open Code) Nothing kills momentum faster than hitting a rate limit mid-build. I fixed this by adding Open Code to AntiGravity/Cursor. Now I have 150+ models on demand. Here’s the setup 👇
0:36

AntiGravity just became UNSTOPPABLE (with Open Code) Nothing kills momentum faster than hitting a rate limit mid-build. I fixed this by adding Open Code to AntiGravity/Cursor. Now I have 150+ models on demand. Here’s the setup 👇

Prajwal Tomar

134,242 просмотров • 6 месяцев назад

Today is a big day! We're launching a ~ new ~ version of Claude Code in the desktop app. It's been redesigned from the ground up for parallel work and is a lot faster. It's been my main way to use Claude Code for the last few weeks.
0:37

Today is a big day! We're launching a ~ new ~ version of Claude Code in the desktop app. It's been redesigned from the ground up for parallel work and is a lot faster. It's been my main way to use Claude Code for the last few weeks.

Felix Rieseberg

953,878 просмотров • 4 месяцев назад

This library will blow up for a simple reason: It's the best for building a chatbot that doesn't hallucinate and knows how to answer questions. It's open-source, and it literally takes a few lines of code to run. Check the attached video.
6:58

This library will blow up for a simple reason: It's the best for building a chatbot that doesn't hallucinate and knows how to answer questions. It's open-source, and it literally takes a few lines of code to run. Check the attached video.

Santiago

107,840 просмотров • 1 год назад

You should really stop using Zapier, Make or n8n Generating a Python script and running it is much faster (and cheaper) using: - o3-mini / Claude / Gemini to create the script - Python Code Runner (free Chrome extension) to run it And it only takes a few minutes. Link below
6:38

You should really stop using Zapier, Make or n8n Generating a Python script and running it is much faster (and cheaper) using: - o3-mini / Claude / Gemini to create the script - Python Code Runner (free Chrome extension) to run it And it only takes a few minutes. Link below

Paul Couvert

166,508 просмотров • 1 год назад

Couldn't agree more with Linus here. Making your code running as fast as possible (or just faster than someone's else code) is the best feeling you can get from programming The issue that it is extremely hard to find the project that will pay you for instruction level efficiency
1:06

Couldn't agree more with Linus here. Making your code running as fast as possible (or just faster than someone's else code) is the best feeling you can get from programming The issue that it is extremely hard to find the project that will pay you for instruction level efficiency

Dmitriy Kovalenko

416,855 просмотров • 11 месяцев назад

I built an open source data analyst agent! Upload any CSV, ask a question, and get it answered with statistics or a nice chart. Launching in 24 hours. 100% free & open source. Under the hood, here's how it works: 1. User uploads a CSV and asks a question. 2. The app uses Together Code Interpreter to spin up a VM and uploads the CSV onto it. 3. I have an LLM (Qwen 3 Coder) write code to interpret the CSV using `pandas`, then solve the question the user asked. 4. Together Code Interpreter runs the code in a secure environment & returns a result. These results can be text (some kind of stats analysis) or a chart.
0:34

I built an open source data analyst agent! Upload any CSV, ask a question, and get it answered with statistics or a nice chart. Launching in 24 hours. 100% free & open source. Under the hood, here's how it works: 1. User uploads a CSV and asks a question. 2. The app uses Together Code Interpreter to spin up a VM and uploads the CSV onto it. 3. I have an LLM (Qwen 3 Coder) write code to interpret the CSV using `pandas`, then solve the question the user asked. 4. Together Code Interpreter runs the code in a secure environment & returns a result. These results can be text (some kind of stats analysis) or a chart.

Hassan

27,086 просмотров • 11 месяцев назад

PANS and PANDAS are extremely serious but little understood paediatric conditions which can impact any child. On this 15th annual awareness day, I'm pleased to have raised this with the Prime Minister and secured his promise of a meeting for PANS PANDAS UK with the Health Dept.
0:40

PANS and PANDAS are extremely serious but little understood paediatric conditions which can impact any child. On this 15th annual awareness day, I'm pleased to have raised this with the Prime Minister and secured his promise of a meeting for PANS PANDAS UK with the Health Dept.

Wendy Chamberlain

21,999 просмотров • 1 год назад

Let's face it: AI can check your code 100x faster and catch 10x more issues than you can. "Code reviews" as a widespread practice is not coming back. There are only two reasons we should consider code reviews today: 1. To transfer knowledge within a team. 2. To ensure AI didn't miss critical aspects in the code. We are getting closer to a point where manually reviewing code will be as relevant as punching holes in a punch card. Here is one idea for you:
0:40

Let's face it: AI can check your code 100x faster and catch 10x more issues than you can. "Code reviews" as a widespread practice is not coming back. There are only two reasons we should consider code reviews today: 1. To transfer knowledge within a team. 2. To ensure AI didn't miss critical aspects in the code. We are getting closer to a point where manually reviewing code will be as relevant as punching holes in a punch card. Here is one idea for you:

Santiago

48,783 просмотров • 1 год назад

Here's how to build your first MCP tool and server with less than 10 Lines of Python code🐍✨ Tried to make this video as short as possible and show the code, the json config and running the server in vs code with github copilot💜
3:43

Here's how to build your first MCP tool and server with less than 10 Lines of Python code🐍✨ Tried to make this video as short as possible and show the code, the json config and running the server in vs code with github copilot💜

Marlene Mhangami

14,603 просмотров • 1 год назад

Since being contacted by a family in my constituency earlier this year I have been working to improve recognition of the conditions PANS and PANDAS which affect children. 1/3
2:09

Since being contacted by a family in my constituency earlier this year I have been working to improve recognition of the conditions PANS and PANDAS which affect children. 1/3

Wendy Chamberlain

13,485 просмотров • 2 лет назад

This is literally the easiest way to build an AI agent. Zero code. You only need to run a couple of commands. (I've said this before, but Google ADK is my favorite way to build code-first agents.) Here is what you need to do: 1. Open your terminal and create an empty folder 2. Run `uv init` inside the folder (if you don't have uv installed, you are really missing out!) 3. Install the google-adk library using the following command: `uv add google-adk`. 4. At this point, you can use the ask to create your agent with a single command: `uv run adk create --type=config my_agent`. This will ask you a couple of questions, including your GEMINI_API_KEY (you can create one online). 5. The command above will create a my_agent/root_agent.yaml file. Open it and add the following two lines at the end of the file so your agent can use Google to search for stuff: tools: - name: google_search 6. You have everything you need now. Run the adk web interface and start playing with your agent: `uv run adk web` That's it! Literally zero code. The agent works off the YAML configuration file.
1:33

This is literally the easiest way to build an AI agent. Zero code. You only need to run a couple of commands. (I've said this before, but Google ADK is my favorite way to build code-first agents.) Here is what you need to do: 1. Open your terminal and create an empty folder 2. Run `uv init` inside the folder (if you don't have uv installed, you are really missing out!) 3. Install the google-adk library using the following command: `uv add google-adk`. 4. At this point, you can use the ask to create your agent with a single command: `uv run adk create --type=config my_agent`. This will ask you a couple of questions, including your GEMINI_API_KEY (you can create one online). 5. The command above will create a my_agent/root_agent.yaml file. Open it and add the following two lines at the end of the file so your agent can use Google to search for stuff: tools: - name: google_search 6. You have everything you need now. Run the adk web interface and start playing with your agent: `uv run adk web` That's it! Literally zero code. The agent works off the YAML configuration file.

Santiago

140,922 просмотров • 8 месяцев назад