Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I've put together an interactive article on database sharding. Learn more about the database scaling pattern used by large orgs to handle million+ QPS workloads. I hope you learn, enjoy, and have some fun along the way.

Ben Dicken

29,035 subscribers

39,472 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

6 Comments

Ben Dicken1 year ago

Here's the article:

Tembo - Multi-Workload Managed Postgres2 years ago

Tembo is multi-workload Postgres—OLTP, Message Queue, Vector Search, RAG, OLAP, Time Series, and Data Warehouse workloads—composed from OSS Postgres ecosystem

Brayden Wilmoth1 year ago

Perhaps the best article I've read regarding database sharding. Also very much enjoyed the interactive pieces throughout – great job on this 👏

Ben Dicken1 year ago

Thank you!

Chichan1 year ago

This was awesome to read. The interactivity on each section is just 👌

Alan Williams1 year ago

Excellent article. Thanks for explaining in such an approachable manner

Related Videos

How do huge orgs like Uber, Slack, Cash App, and others scale their databases? Sharding! I'm working on an interactive article for PlanetScale covering what sharding is and considerations for designing a well-performing database cluster. Stay tuned.

How do huge orgs like Uber, Slack, Cash App, and others scale their databases? Sharding! I'm working on an interactive article for PlanetScale covering what sharding is and considerations for designing a well-performing database cluster. Stay tuned.

Ben Dicken

75,821 views • 1 year ago

Seems like everyone's talking about database sharding. Earlier this year, I wrote an interactive guide on how it works for relational databases. Every engineer should know the core principles and challenges of sharding. This article is here to help.

Seems like everyone's talking about database sharding. Earlier this year, I wrote an interactive guide on how it works for relational databases. Every engineer should know the core principles and challenges of sharding. This article is here to help.

Ben Dicken

103,277 views • 10 months ago

Postgres: process-per-connection MySQL: thread-per-connection Learn more about processes, threads, connection pooling, and how they impact database performance in our latest interactive article.

Postgres: process-per-connection MySQL: thread-per-connection Learn more about processes, threads, connection pooling, and how they impact database performance in our latest interactive article.

PlanetScale

349,333 views • 8 months ago

Sharding is: 1) The foundation of database scalability 2) Super interesting architecturally If you want to Design Data Intensive Applications (at scale) you must learn it, and learn it well.

Sharding is: 1) The foundation of database scalability 2) Super interesting architecturally If you want to Design Data Intensive Applications (at scale) you must learn it, and learn it well.

Ben Dicken

82,989 views • 1 month ago

The best database sharding video on the internet ⬇️

The best database sharding video on the internet ⬇️

PlanetScale

24,033 views • 9 months ago

The hardest part of deploying apps is storing data. Every app created by Replit Agent can have a production-grade Postgres database. Most do by default! Watch along to learn about persistent storage with Agent, powered by the fine folks at Neon. 00:00—Introduction to Replit Agent & Database Configuration 00:46—How Agent Automatically Detects Database Needs 01:53—Real-time Database Testing & Implementation 03:33—Adding Database to Snake Game Demo 06:48—Complete Leaderboard Implementation

The hardest part of deploying apps is storing data. Every app created by Replit Agent can have a production-grade Postgres database. Most do by default! Watch along to learn about persistent storage with Agent, powered by the fine folks at Neon. 00:00—Introduction to Replit Agent & Database Configuration 00:46—How Agent Automatically Detects Database Needs 01:53—Real-time Database Testing & Implementation 03:33—Adding Database to Snake Game Demo 06:48—Complete Leaderboard Implementation

matt palmer

18,280 views • 1 year ago

Ever wondered what makes building AI at scale possible? It starts with a database that’s as smart and resilient as your models 🌐 With Cloud-Native Database, experience a limitless and serverless database like never before. Watch the video to learn more!

Ever wondered what makes building AI at scale possible? It starts with a database that’s as smart and resilient as your models 🌐 With Cloud-Native Database, experience a limitless and serverless database like never before. Watch the video to learn more!

Alibaba Group

120,663 views • 6 months ago

I made an interactive item database and dependency viewer, free and open source. More info and links are in the comments. 🔗 u/Effective_Bag_9682

I made an interactive item database and dependency viewer, free and open source. More info and links are in the comments. 🔗 u/Effective_Bag_9682

Arc Raiders Intel

340,345 views • 6 months ago

Some lessons you have to learn the hard way…

Some lessons you have to learn the hard way…

FIGHTFLIX

33,451 views • 2 months ago

🙍How to trade head and shoulders pattern? I made a video very simply explaining the best way that I've found to make money trading this simple pattern. I hope you enjoy

🙍How to trade head and shoulders pattern? I made a video very simply explaining the best way that I've found to make money trading this simple pattern. I hope you enjoy

Nebraskangooner

21,833 views • 8 months ago

Announcing Realtime Broadcast from Database! Broadcast from Database allows you to broadcast changes happening in your database in a flexible and scalable way. It even supports joining multiple tables to broadcast the payload, opening up new way to listen to database changes!

Announcing Realtime Broadcast from Database! Broadcast from Database allows you to broadcast changes happening in your database in a flexible and scalable way. It even supports joining multiple tables to broadcast the payload, opening up new way to listen to database changes!

Supabase

33,170 views • 1 year ago

"Wanted to pop in and introduce myself!" I've wanted to do a project like this for a long time. It took months to learn the skills to put together, so I hope you enjoy seeing Kiido brought to life! A HUGE thank you to @KaniDayOfficial for the voicework. 🎵Float - Geographer🎵

"Wanted to pop in and introduce myself!" I've wanted to do a project like this for a long time. It took months to learn the skills to put together, so I hope you enjoy seeing Kiido brought to life! A HUGE thank you to @KaniDayOfficial for the voicework. 🎵Float - Geographer🎵

Kiido Arts

13,066 views • 1 year ago

Correa: One of your officers in Maine said to one of the individuals protesting, we're going to put your face in a database. Do you have a database of Americans? Lyons: There is no database.

Correa: One of your officers in Maine said to one of the individuals protesting, we're going to put your face in a database. Do you have a database of Americans? Lyons: There is no database.

Acyn

69,499 views • 4 months ago

Introducing Database Traffic Control: a Postgres traffic management system built into PlanetScale. Enforce flexible budgets on your database traffic to protect against unexpected and dangerous workloads.

Introducing Database Traffic Control: a Postgres traffic management system built into PlanetScale. Enforce flexible budgets on your database traffic to protect against unexpected and dangerous workloads.

PlanetScale

160,932 views • 2 months ago

Qullamaggie on Minervini’s 18,000 Chart Database “Wait, Minervini has an 18,000-page chart database on paper? Guys, that’s what you have to do. I think 18,000 may be a bit overkill, and especially on paper. But if you have like one note or ever note or something like that, there’s no reason why you should… you know you… everyone should build a chart database, a pattern database right, at least a couple of thousand charts and setups. And then you trade those setups over and over, again right. Like, I have three setups and variations that I trade over and over again. I don’t do any rocket science at all.”

Qullamaggie on Minervini’s 18,000 Chart Database “Wait, Minervini has an 18,000-page chart database on paper? Guys, that’s what you have to do. I think 18,000 may be a bit overkill, and especially on paper. But if you have like one note or ever note or something like that, there’s no reason why you should… you know you… everyone should build a chart database, a pattern database right, at least a couple of thousand charts and setups. And then you trade those setups over and over, again right. Like, I have three setups and variations that I trade over and over again. I don’t do any rocket science at all.”

Lone

43,527 views • 7 months ago

This video is alleged to have been posted and later removed by AIPAC. In the video, they reportedly boast about securing $627 million from U.S. taxpayers. Watch the video to learn more about how these funds are used.

This video is alleged to have been posted and later removed by AIPAC. In the video, they reportedly boast about securing $627 million from U.S. taxpayers. Watch the video to learn more about how these funds are used.

Noah’s Ark 🚢

158,498 views • 1 year ago

hey so you can preorder now limited edition, made to order, handmade by us in new york sharing what we learn about scaling production on the way :~) some bts footage w/ Ryan Mather evan kahn by ig @/brendanfilm

hey so you can preorder now limited edition, made to order, handmade by us in new york sharing what we learn about scaling production on the way :~) some bts footage w/ Ryan Mather evan kahn by ig @/brendanfilm

kelin

22,984 views • 1 year ago

Maxine Waters (2013): "The President (Obama) has put in place an organization that contains a kind of Database that noone has ever seen before in life... and that Database will have information about everything, on every individual" Why didn't she care then?

Maxine Waters (2013): "The President (Obama) has put in place an organization that contains a kind of Database that noone has ever seen before in life... and that Database will have information about everything, on every individual" Why didn't she care then?

Brad Zerbo

21,123 views • 1 year ago

I have a lot to learn about animatic and editing But I did have fun making this one, an idea I had while listening to the song on the train. Mass Effect2, Shepard/Garrus

I have a lot to learn about animatic and editing But I did have fun making this one, an idea I had while listening to the song on the train. Mass Effect2, Shepard/Garrus

椰子叶子【leafy】【 comm closed】

26,241 views • 11 months ago