Loading video...

Video Failed to Load

Go Home

Fast backups at-scale are made possible by sharding. These require an amazing amount of engineering to nail the infrastructure, orchestration, and reliability. I wrote all about it... with the help of some PlanetScale database geniuses, of course!

BenjDicken's profile picture

Ben Dicken

43,070 subscribers

36,771 views • 27 days ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

1 of N reasons why sharding is a great way to scale a database? Backup speed. This is one of the fun little animations I worked on in my recent interactive sharding article. In case you missed it, link below.
0:12

1 of N reasons why sharding is a great way to scale a database? Backup speed. This is one of the fun little animations I worked on in my recent interactive sharding article. In case you missed it, link below.

Ben Dicken

13,264 views • 1 year ago

in software, we're entering a new age of skyscrapers: rather than a small group of humans hand-typing code into a computer, software is now built by thousands of humans and agents working together to build applications at a scale that was previously unthinkable. the unsung heroes of this new era are infrastructure engineers. they are the people who are figuring out how to make software with 100x the amount of code, and 1000x the amount of contributors actually work OpenAI is one of the few companies already operating at this scale so we Every 🪨 spent a few days deep inside of the company to learn how their infrastructure team thinks about building software skyscrapers—and how they use agents to do it one of the most important articles we've written this year:
0:10

in software, we're entering a new age of skyscrapers: rather than a small group of humans hand-typing code into a computer, software is now built by thousands of humans and agents working together to build applications at a scale that was previously unthinkable. the unsung heroes of this new era are infrastructure engineers. they are the people who are figuring out how to make software with 100x the amount of code, and 1000x the amount of contributors actually work OpenAI is one of the few companies already operating at this scale so we Every 🪨 spent a few days deep inside of the company to learn how their infrastructure team thinks about building software skyscrapers—and how they use agents to do it one of the most important articles we've written this year:

Dan Shipper 📧

14,699 views • 29 days ago

I had a dream last night that I was building a local beef processing facility to sell at scale to my local community. I’ve been thinking about this a lot lately. As it is now, there are thousands of head of cattle in my county. The vast majority are shipped by 18-wheelers to the Midwest, fed out, then processed and shipped back to us as a part of the national supply chain. I know we could produce a much better product at a competitive price by keeping everything close to home. It’s just a huge endeavor that would require investment and some help from the administration. But it is possible.
0:12

I had a dream last night that I was building a local beef processing facility to sell at scale to my local community. I’ve been thinking about this a lot lately. As it is now, there are thousands of head of cattle in my county. The vast majority are shipped by 18-wheelers to the Midwest, fed out, then processed and shipped back to us as a part of the national supply chain. I know we could produce a much better product at a competitive price by keeping everything close to home. It’s just a huge endeavor that would require investment and some help from the administration. But it is possible.

Dale Stark

328,919 views • 10 months ago

Chinese police are scanning the faces of diners at a BBQ...and automatically match them with police database, to search and arrest anyone considered as Enemy of the State. China's digital ID system, which has all Chinese people's biometrics information, makes it possible.
0:11

Chinese police are scanning the faces of diners at a BBQ...and automatically match them with police database, to search and arrest anyone considered as Enemy of the State. China's digital ID system, which has all Chinese people's biometrics information, makes it possible.

Songpinganq

195,779 views • 2 years ago

Scream Everyday, nightmare critters music video promo is here! It was a huge honor to handle the song with an amazing voice of Baldwin 🔜 Dreamcon 2026, and of course, all the talented singers of nightmare critters. I hope you all enjoy the animation!
0:10

Scream Everyday, nightmare critters music video promo is here! It was a huge honor to handle the song with an amazing voice of Baldwin 🔜 Dreamcon 2026, and of course, all the talented singers of nightmare critters. I hope you all enjoy the animation!

INUbis

57,584 views • 1 year ago

- we need to provide moscow with the required amount [of petrol], it just happens to be all of it - do you think it’ll raise dissatisfaction in other regions? - of course but what are they gonna do about it the anti-colonial anti-imperialists strike again
0:18

- we need to provide moscow with the required amount [of petrol], it just happens to be all of it - do you think it’ll raise dissatisfaction in other regions? - of course but what are they gonna do about it the anti-colonial anti-imperialists strike again

anya

34,806 views • 1 month ago

9-1-1 is back tonight so to celebrate here is an animation made with the help of some amazing 911twt artists !! #911onABC
0:14

9-1-1 is back tonight so to celebrate here is an animation made with the help of some amazing 911twt artists !! #911onABC

RyAn🧑🏻‍🚒🏎️🥊

66,621 views • 10 months ago

THE BOOKMARKS! Glad to see we're all normal about this. Of course, I had to make an edit with it. You're welcome🤝🏻 #CharlotteAustin
0:15

THE BOOKMARKS! Glad to see we're all normal about this. Of course, I had to make an edit with it. You're welcome🤝🏻 #CharlotteAustin

Prol_x

17,081 views • 4 months ago

Congrats to Boston Dynamics on their new electric version of Atlas robot. Thanks to all the amazing engineering teams at Boston Dynamics, Tesla, and others pushing the field of robotics forward! I can't wait to hang out with Atlas & Optimus together at some point. Robot party 🤣
0:14

Congrats to Boston Dynamics on their new electric version of Atlas robot. Thanks to all the amazing engineering teams at Boston Dynamics, Tesla, and others pushing the field of robotics forward! I can't wait to hang out with Atlas & Optimus together at some point. Robot party 🤣

Lex Fridman

1,538,329 views • 2 years ago

With the help of God Almighty, my humble self, my lovely sister and some fellow OBIdients, we were able to support about 70 women with foodstuffs and some little amount of money. My heart was broken during the distribution of the food.😭 People are going through a lot in Nigeria
0:07

With the help of God Almighty, my humble self, my lovely sister and some fellow OBIdients, we were able to support about 70 women with foodstuffs and some little amount of money. My heart was broken during the distribution of the food.😭 People are going through a lot in Nigeria

Mallam jabir

94,982 views • 3 years ago

He crashed twice. Lost his bike computer. Had to rely on his sport director for directions and help navigating the course. And STILL he pulled off an incredible 5th place finish at de Ronde. None of it would've been possible without the help of the entire team. Every single rider rode an amazing race yesterday. We couldn't be prouder. Ronde van Vlaanderen 2023 was a memorable one. Check out episode 3 of RaceTV with the link:
0:18

He crashed twice. Lost his bike computer. Had to rely on his sport director for directions and help navigating the course. And STILL he pulled off an incredible 5th place finish at de Ronde. None of it would've been possible without the help of the entire team. Every single rider rode an amazing race yesterday. We couldn't be prouder. Ronde van Vlaanderen 2023 was a memorable one. Check out episode 3 of RaceTV with the link:

EF Pro Cycling

87,292 views • 3 years ago

These are just some of the new outfits. And of course, the additional content doesn’t stop at costumes!🩵💙 #StellarBladePC #STEAM #EpicgamesStore #25NewOutfits
0:14

These are just some of the new outfits. And of course, the additional content doesn’t stop at costumes!🩵💙 #StellarBladePC #STEAM #EpicgamesStore #25NewOutfits

StellarBlade

1,406,489 views • 1 year ago

Here's an early look at some of the conference merch I believe these YIMBY catnip numbers are going to be modelled around the secure zone by Steve Reed and his team
0:15

Here's an early look at some of the conference merch I believe these YIMBY catnip numbers are going to be modelled around the secure zone by Steve Reed and his team

Noa Hoffman

59,058 views • 11 months ago

Look who just hatched in Lummestad!❄️ It all started with an egg at Alice’s doorstep, chilly and quiet. Bjorn tried to help (by sitting on it, of course)… and guess what? Crack! 💥 Out popped a Lil Pudgy, ready to waddle into the world. Now the island’s buzzing — and there are tiny footprints everywhere! 🐧🌸
0:19

Look who just hatched in Lummestad!❄️ It all started with an egg at Alice’s doorstep, chilly and quiet. Bjorn tried to help (by sitting on it, of course)… and guess what? Crack! 💥 Out popped a Lil Pudgy, ready to waddle into the world. Now the island’s buzzing — and there are tiny footprints everywhere! 🐧🌸

Alice

23,146 views • 1 year ago

The amount of layers, bones and constraints it took me to rig and animate Yidhari. モノ | Mono 🐟 did an excellent job at separating all of the layers! #spine2d
0:19

The amount of layers, bones and constraints it took me to rig and animate Yidhari. モノ | Mono 🐟 did an excellent job at separating all of the layers! #spine2d

Seter

19,674 views • 9 months ago

CircuitX started as an hackathon project at the Zypherpunk hackathon by Mert. After the hackathon I decided to continue building but without funding which made development really slow . A token got launched on BAGS some days ago and it generated some $ , which made the development of the first version of the private swap dex possible ! ( ) I have now applied for the Bags Grant to take this to the next stage and continue research/development of the private perp dex !!!! Excited to continue building ! FINN sincara Stuu
0:32

CircuitX started as an hackathon project at the Zypherpunk hackathon by Mert. After the hackathon I decided to continue building but without funding which made development really slow . A token got launched on BAGS some days ago and it generated some $ , which made the development of the first version of the private swap dex possible ! ( ) I have now applied for the Bags Grant to take this to the next stage and continue research/development of the private perp dex !!!! Excited to continue building ! FINN sincara Stuu

mankind

11,799 views • 6 months ago

Trump on the No Kings protests: “I saw that ridiculous march the other day. I say, these people are not representative of our country. And not all of them, of course, but many of them are total lowlifes. These are lowlifes.”
0:19

Trump on the No Kings protests: “I saw that ridiculous march the other day. I say, these people are not representative of our country. And not all of them, of course, but many of them are total lowlifes. These are lowlifes.”

The Bulwark

34,372 views • 10 months ago