Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

For years, I thought DynamoDB was both brilliant and convenient. - Schemaless - Serverless - Cheap What's not to like? Well, turns out, it's only cheap for a while. And the schemaless nature of DynamoDB quickly starts working against you... One of the stupidest decisions I made. Instead, I...

38,322 Aufrufe • vor 2 Monaten •via X (Twitter)

37 Kommentare

Profilbild von Simon Høiberg
Simon Høibergvor 2 Monaten

📌 The other day, I dropped a video where I show you my entire self-hosted setup. - What tools I use - How I maintain it - How I handle security

Profilbild von Andras Bacsai
Andras Bacsaivor 2 Monaten

old tech is the way, always

Profilbild von Tony Chang
Tony Changvor 2 Monaten

serverless is good to start off with varying range of load without worrying to much. Once it gets to enterprise level there will definitely be load every minute :) so better to use always on DB.

Profilbild von Simon Høiberg
Simon Høibergvor 2 Monaten

I wouldn't even recommend starting honestly

Profilbild von Tony Chang
Tony Changvor 2 Monaten

with agent being the primary operator. Serverless workloads is good for toy projects or agentic workloads

Profilbild von Vance Lucas
Vance Lucasvor 2 Monaten

So glad I skipped stuff like this and used old boring tech instead. PostrgreSQL FTW.

Profilbild von Nesters Kovalkovs
Nesters Kovalkovsvor 2 Monaten

Just migrated from DynamoDB to SQLite. That product is trash.

Profilbild von Richard
Richardvor 2 Monaten

99% of companies, big or small, only need: Postgres + Redis

Profilbild von Pierre
Pierrevor 2 Monaten

Yeah in doubt go MongoDB, that never goes wrong.

Profilbild von Michael Petychakis
Michael Petychakisvor 2 Monaten

I couldn't agree more. I remember as a newbie I loved that flexibility. And then after a bit of scaling, the real charges started coming every time I needed a new query.

Profilbild von Simon Høiberg
Simon Høibergvor 2 Monaten

Yeah!

Profilbild von Rafal Wilinski
Rafal Wilinskivor 2 Monaten

welcome to the bright side, been there done that

Profilbild von Andrew Peacock
Andrew Peacockvor 2 Monaten

Absolutely. I've never understood the desire for schema-less DBs unless you are storing data which has a variable structure. As soon are you are storing standard structures (eg users, orders, projects) then use a standard DB, because they've been around for decades!

Profilbild von 𝔾𝔸𝔹𝕆 || Puto Pulse 📖
𝔾𝔸𝔹𝕆 || Puto Pulse 📖vor 2 Monaten

Have you tried Cockroach DB?

Profilbild von Simon Høiberg
Simon Høibergvor 2 Monaten

@GABRIELxCxR I didn't actually

Profilbild von 𝔾𝔸𝔹𝕆 || Puto Pulse 📖
𝔾𝔸𝔹𝕆 || Puto Pulse 📖vor 2 Monaten

You might find it interesting. Quite generous free tier and eqsy to scale without skyrocketing prices in my opinión.

Profilbild von Simon Høiberg
Simon Høibergvor 2 Monaten

@GABRIELxCxR If it's not open source and I can fully self-host it, I'm definitely not interested at all haha

Profilbild von 𝔾𝔸𝔹𝕆 || Puto Pulse 📖
𝔾𝔸𝔹𝕆 || Puto Pulse 📖vor 2 Monaten

That's a great phylosofy

Profilbild von Fadi Hares
Fadi Haresvor 2 Monaten

The schemaless part is the trap. You still have a schema, it just lives scattered across your app code instead of one place you can reason about. Access patterns shift and suddenly every query is a full scan. Postgres?

Profilbild von Nick Arden
Nick Ardenvor 2 Monaten

dynamodb is great for getting off the ground quickly, but single-table design breaks down fast when your access patterns change. relational tech is boring for a reason - it works are you moving back to standard postgres or something like supabase for the self-hosted setup?

Profilbild von DynoTable
DynoTablevor 2 Monaten

DynamoDB is truly one of the cheapest solutions out there, especially at scale. I run terabyte tables in prod for years and it is still one of the smallest lines in my aws bill. Can you throw some numbers?

Profilbild von CodeCultureCob
CodeCultureCobvor 2 Monaten

This matches my experience. The "schemaless" framing is the trap: single-table DynamoDB has a very rigid schema, it just lives in your keys instead of the DB. When access patterns are still moving, that rigidity bites hard, and Postgres is the right call there. One push-back: self-hosting trades a predictable AWS bill for ops work (failover, backups, patching), so it's less "cheaper" than "cost moved to your own time."

Profilbild von Navaneeth
Navaneethvor 2 Monaten

Don't think DynamoDB is used for main DB, isn't it mainly used for cache, KV use cases?

Profilbild von Oskar Cieślik
Oskar Cieślikvor 2 Monaten

Need to pick the right tool for the job. We’ve chosen Dynamo using multiple patterns across Sonos Radio, and it’s been great. Performance and reliability statistics have been the highest across their whole app ecosystem for the last 5 years while serving a massive number of users daily.

Profilbild von Augmenta Blake
Augmenta Blakevor 2 Monaten

Schemaless sounds great until someone else has to maintain your data.

Profilbild von Capaj
Capajvor 2 Monaten

Yeah I was dynamoDB hater ever since we were using it for analytics at @LooopCo in 2017 and it was the most expensive item on our infra bill. When we replaced it with postgres the cost to serve same amount of data was like 1/30th

Profilbild von Amit Gupta
Amit Guptavor 2 Monaten

Anything serverless starts becoming really expensive as you cross a certain threshold. Its only cheap as long as you don't have scale & have minimal use.

Profilbild von Pratik Mohapatra
Pratik Mohapatravor 2 Monaten

Awesome

Profilbild von Enlight Pixel
Enlight Pixelvor 2 Monaten

DynamoDB feels slick until you need real queries or any kind of relationships.

Profilbild von Hitesh Goel
Hitesh Goelvor 2 Monaten

I am working on Blockchain indexing data pipelines at petabyte scale - I myself migrated tonnes of usecases from DynamoDB to Clickhouse. We saved thousands of dollars and plenty of TBs in storage costs.

Profilbild von Adrian Smijulj
Adrian Smijuljvor 2 Monaten

At @WebinyCMS, we offer ddb-only setup for smaller projects, but for anything serious, ddb w/ OpenSearch is a must-have. But what’s interesting is that we’ve also started looking into, as you called it, the ‘boring tech’. Gonna have some new things out soooon 😇😇

Profilbild von Peas Vision 🫛👁️
Peas Vision 🫛👁️vor 2 Monaten

And if you have high load, very tricky to handle hot Partition keys

Profilbild von Tech MoonKey
Tech MoonKeyvor 2 Monaten

Schemaless sounds great until three sprints in and nobody remembers what the data shape should be. Been there. We moved to Postgres and the strict schema saved us weeks of debugging.

Profilbild von Nick Venturi
Nick Venturivor 2 Monaten

it feels like a cheat code until you need to query something

Profilbild von Tom 🍋
Tom 🍋vor 2 Monaten

Boring is good. Boring is stable, well documented, tested and performant. Always choose boring :)

Profilbild von David Wells
David Wellsvor 2 Monaten

interesting switch Havent had time to watch the full video yet Do you share details on your data models / primary sort key setup you were using on DDB? Ive managed to get a pretty wild single table setup working but I can see where I might run into issues later

Profilbild von Stuart Sim
Stuart Simvor 2 Monaten

Would love for you to try

Ähnliche Videos

Edward Yang on the impact of watching Aguirre, the Wrath of God (1972): "I found a job in Seattle at a research laboratory that contracted to do classified defense projects in microcomputers. I was among the first generation of designers and applicators for microcomputers and microprocessors. By the time I turned thirty I was pretty well established, with a team of seven or eight guys working on some very interesting projects. Later on I made the association that designing is like writing, and I realized that this background helped me a lot. After a couple of years as an engineer, of course, the routine bored me. One night, I was driving after work in downtown Seattle, and I saw a billboard outside a movie theater with the words, German New Wave, and the title, Aguirre: The Wrath of God. It made me curious, so I went in. I was fortunate. I came out a different person. That two hours just blew me away. It restored my sense of competence that I could be a filmmaker. This is what I thought a film should be. Film school would never teach you to make those kind of shots. That was one of the crucial moments of my life. I had turned thirty, I thought I was getting old, and three more years passed before I got the chance to work on a film project with a friend who asked me to write a script for him. I went back to Taipei, and also visited Hong Kong for the first time, and the film was shot in Japan. I got an offer to write and direct a made-for-TV movie in Taiwan, so I didn't go back to Seattle." — The Engineer of Modern Perplexity: An Interview with Edward Yang by Robert Sklar, published in Cineaste, Vol. 25, No. 3 in 2000

RadiantFilm

97,385 Aufrufe • vor 10 Monaten

James McAvoy admits he lied to his agent and pretended to love the X-Men script before accepting the role "X-Men came in. I went, 'Where's it filming?' They went, 'Pinewood.'" "It's 40 minutes from my front door. I was like, awesome. And I was also like, X-Men, great, I loved the cartoon when I was a kid, that'd be brilliant." "I loved the movies that came out in 2000, Bryan Singer's original movies, they were brilliant.And I was like, what part? And they were like, it's Charles. And I was like, great, I get to be fucking Jean-Luc Xavier, it's gonna be brilliant." "They said the script is under wraps, so you need to go to this restaurant and they'll give it to you, and you read it, and then you have to give them an answer quick." "So I went, it was like a chain restaurant, it wasn't even fancy, not like a McDonald's, but it was like, you know, like a Burger King." "And I go in and I meet Matthew Vaughn, and he has a quick chat with me, and then I sit and read the script." "Nobody tells me that there's only like 60 pages of it at this point, and I feel like it's good, Jane Goldman did a great job, it's good, but it's incomplete, really. Don't know where it's going." "But I was like, this is a three-picture deal, they're paying well, it's 40 minutes from my front door, I'm a fan of the original material, I get to be young Jean-Luc Xavier. I was like, this is a no-brainer." "So my agent called me, and she was like, what do you think? And I was like, it's a work of genius, we're doing it."

crest.

150,134 Aufrufe • vor 24 Tagen