Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

LSMs are fun because they combine a bunch of data structures into one! Trees / skip-lists as the storage format. Bloom filters for faster lookups. Priority queues for efficient merges. A little clip from last week's stream showing how the latter works for LSM chunk merging.

Ben Dicken

41,943 subscribers

89,180 views • 6 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Who'd have thought a slight variation of linked lists would make them... useful for databases! Skip lists are multi-level linked lists. The insert performance of an LL with much faster search. Are they useful? Yes! RocksDB uses them for it's LSM memtable.

Who'd have thought a slight variation of linked lists would make them... useful for databases! Skip lists are multi-level linked lists. The insert performance of an LL with much faster search. Are they useful? Yes! RocksDB uses them for it's LSM memtable.

Ben Dicken

43,555 views • 6 months ago

Bloom filters: a simple structure for speeding up searches in sets, hash maps, and trees. They're a great tool for avoiding unnecessary disk reads in databases, as they can quickly confirm that a key does not exist in a data set. Clip from yesterday's stream.

Bloom filters: a simple structure for speeding up searches in sets, hash maps, and trees. They're a great tool for avoiding unnecessary disk reads in databases, as they can quickly confirm that a key does not exist in a data set. Clip from yesterday's stream.

Ben Dicken

36,102 views • 6 months ago

BREAKING How £100 BILLION has been wasted by the Tories in the last 4 years... They are a reckless, greedy, gaslighting bunch of.....(Fill in as you prefer) Data thanks to ⁦Best for Britain⁩

BREAKING How £100 BILLION has been wasted by the Tories in the last 4 years... They are a reckless, greedy, gaslighting bunch of.....(Fill in as you prefer) Data thanks to ⁦Best for Britain⁩

Carol Vorderman

356,375 views • 2 years ago

Chris Camillo explains how Bloom Energy is solving AI data center energy usage problems… “ $BE is one of the only companies in the world that has a method to essentially bring almost an infinite amount of energy to these data centers." And we won't get into all the technology, but they are now working with hyperscalers and they are a resource for energy that will allow a data center to get ramped up quicker. "So, even though it costs a little bit more money today to put an energy cell from Bloom, an energy box from Bloom, which are energy cells, it essentially takes things like natural gas, but instead of burning the natural gas, there is a chemical process that turns that natural gas into energy for the data center."

Chris Camillo explains how Bloom Energy is solving AI data center energy usage problems… “ $BE is one of the only companies in the world that has a method to essentially bring almost an infinite amount of energy to these data centers." And we won't get into all the technology, but they are now working with hyperscalers and they are a resource for energy that will allow a data center to get ramped up quicker. "So, even though it costs a little bit more money today to put an energy cell from Bloom, an energy box from Bloom, which are energy cells, it essentially takes things like natural gas, but instead of burning the natural gas, there is a chemical process that turns that natural gas into energy for the data center."

The Iced Coffee Hour

277,703 views • 3 months ago

Texas School Voucher Reality: Sold as a life preserver for poor students, new application data is showing that the majority applying for vouchers are already in private schools. And just 12% of applicants fall into into priority categories for disabled students, or under $165,000/yr for family of four. #TxLege #TxEd

Texas School Voucher Reality: Sold as a life preserver for poor students, new application data is showing that the majority applying for vouchers are already in private schools. And just 12% of applicants fall into into priority categories for disabled students, or under $165,000/yr for family of four. #TxLege #TxEd

HOUmanitarian ™

16,977 views • 4 months ago

Tourists from Punjab were plucking apricots as well as branches from trees in district. They Started quarreling with locals when prohibited. Remembered the source of income for the residents here are these trees, from which we get fruit for one month in a year & we protect

Tourists from Punjab were plucking apricots as well as branches from trees in district. They Started quarreling with locals when prohibited. Remembered the source of income for the residents here are these trees, from which we get fruit for one month in a year & we protect

Ijaz Shigri

162,315 views • 3 years ago

6ix9ine showing his mom after she came back from church on NEON’s stream for the first time was one of the cutest moments, you can really tell how close they are ❤️

6ix9ine showing his mom after she came back from church on NEON’s stream for the first time was one of the cutest moments, you can really tell how close they are ❤️

Woody

198,732 views • 9 months ago

One of the fun micro-moments from today’s column: throwback Maxi Kleber clear-out screens for Luka…with Dončić showing appreciation for rare easy layups by returning the favor with a lob for Kleber after the last one👇

One of the fun micro-moments from today’s column: throwback Maxi Kleber clear-out screens for Luka…with Dončić showing appreciation for rare easy layups by returning the favor with a lob for Kleber after the last one👇

Iztok Franko

53,666 views • 5 months ago

Mom teaches her little cubs how to swim and gives each one a kiss for encouragement as they dive into the water!

Mom teaches her little cubs how to swim and gives each one a kiss for encouragement as they dive into the water!

.RW🦦

76,826 views • 3 months ago

Wild interview clip from former Taoiseach, Leo Varadkar. Describing himself as a huge advocate for trans participation in Sport, he says the reason authoritarians have chosen to oppose this issue is because the people don't support it. It is amazing how brazen these FG retirees are when they leave office, showing how detached they are from ordinary people on the issues. They never had the courage to say it when they were looking for your vote. #HowIrelandWorks

Wild interview clip from former Taoiseach, Leo Varadkar. Describing himself as a huge advocate for trans participation in Sport, he says the reason authoritarians have chosen to oppose this issue is because the people don't support it. It is amazing how brazen these FG retirees are when they leave office, showing how detached they are from ordinary people on the issues. They never had the courage to say it when they were looking for your vote. #HowIrelandWorks

Luke O' Connor

140,492 views • 19 days ago

“Christian conservatives themselves are making these appeals to the Bible as justification for their actions and justifications for the laws they want to pass, without engaging with science or data as an explanation for those laws. Versus when you look at progressive candidates, for instance, there is typically: Here’s the data. Here’s what we know. Here’s why we’re proposing this, and this is how it works.” No. The idea that a man can become a woman - or that a baby doesn’t have value - isn’t a factual one, it’s a religious one.

“Christian conservatives themselves are making these appeals to the Bible as justification for their actions and justifications for the laws they want to pass, without engaging with science or data as an explanation for those laws. Versus when you look at progressive candidates, for instance, there is typically: Here’s the data. Here’s what we know. Here’s why we’re proposing this, and this is how it works.” No. The idea that a man can become a woman - or that a baby doesn’t have value - isn’t a factual one, it’s a religious one.

Allie Beth Stuckey

59,174 views • 13 days ago

A little girl carries her younger sister on her back for 2 kms because they are orphans, because they are injured, because they are desperate, because they need help and no one cares enough to help stop the Zio-Nazis from ethnically cleansing them.

A little girl carries her younger sister on her back for 2 kms because they are orphans, because they are injured, because they are desperate, because they need help and no one cares enough to help stop the Zio-Nazis from ethnically cleansing them.

Hend F Q

15,782 views • 1 year ago

Friends! Mum made something special for you! It’s a video, filmed over a period of time, showing you how Breakfast Time works in our house for the Kittens. It took a while to work out a Good System, because the Kittens were so desperate to eat in the mornings that they would knock their dishes over and crash into each other. Our System is now Foolproof and Efficient. Baby Dog and I are the SUPERVISORS. Enjoy! #BreakfastTime #Malcy #BabyDog #Ron #Percy #Cleo #CaturdayEve #CatsofX #KittensofX #FridayFeeling

Friends! Mum made something special for you! It’s a video, filmed over a period of time, showing you how Breakfast Time works in our house for the Kittens. It took a while to work out a Good System, because the Kittens were so desperate to eat in the mornings that they would knock their dishes over and crash into each other. Our System is now Foolproof and Efficient. Baby Dog and I are the SUPERVISORS. Enjoy! #BreakfastTime #Malcy #BabyDog #Ron #Percy #Cleo #CaturdayEve #CatsofX #KittensofX #FridayFeeling

Malcolm & Baby Dog

61,334 views • 1 year ago

🚀 Arweave: The Epic Journey Towards Timeless Data Storage Embark on a journey with me as we unravel the marvel that is Arweave, a project meticulously crafted to safeguard data for an eternity without compromise. Let's dive into the intricacies that make this revolutionary endeavor a beacon of #permanence . 🌐 How Does #Arweave Achieve Timeless Data Storage? ✨ Cryptographic Proofs: Imagine a world where data integrity is not just a promise but a #cryptographic reality. Arweave's #foundation lies in cryptographic proofs, ensuring that every new block added to the network is not just stored but validated with unyielding certainty. 🏰 Storage Endowment: Arweave doesn't just store data; it endows it with longevity. Through a groundbreaking approach, data stored on Arweave is prepaid for 20 replicas spanning the next 200 years. This is not a mere estimate; it's a conservative projection, fortifying Arweave's commitment to #securing your data for the long term. 💡 Incentivized Evolution: The #world evolves, and so does Arweave. The #protocol is open, ready for change, and embraces an incentivized evolution model. Arweave positions itself not just as a #platform but as a versatile framework, encouraging innovative forks rewarded through a fair fork methodology. The beauty lies in the compatibility of these forks at the protocol layer, fostering cooperation over competition. 🌍 Unified Dataset for Permanence: Arweave isn't just about storing data; it's about unity. The encouragement of forks aligns seamlessly with the mission of permanent data storage. Keeping the dataset unified is in everyone's best interest, ensuring a collective stride towards a future where data stands the test of time. 🔍 Breaking It Down: Cryptographic Proofs: Ensuring the replication and secure storage of substantial parts of the Arweave dataset. Storage Endowment: A commitment to safeguarding data for a minimum of 200 years. Innovative Forks: Encouraging a continuous stream of innovation for permanent data storage. 📖 For those seeking a deeper understanding, explore DRAFT 17. Delve into the intricacies of Arweave's design, where proofs drive replication, the endowment fortifies storage, and the approach to forks sparks innovation. Join us on this odyssey towards a future where your data remains eternally secure and unaltered. Türkçe için : Arweave Ecosystem Only Arweave ar.io WeaveVM is now Load Network (@useload)

🚀 Arweave: The Epic Journey Towards Timeless Data Storage Embark on a journey with me as we unravel the marvel that is Arweave, a project meticulously crafted to safeguard data for an eternity without compromise. Let's dive into the intricacies that make this revolutionary endeavor a beacon of #permanence . 🌐 How Does #Arweave Achieve Timeless Data Storage? ✨ Cryptographic Proofs: Imagine a world where data integrity is not just a promise but a #cryptographic reality. Arweave's #foundation lies in cryptographic proofs, ensuring that every new block added to the network is not just stored but validated with unyielding certainty. 🏰 Storage Endowment: Arweave doesn't just store data; it endows it with longevity. Through a groundbreaking approach, data stored on Arweave is prepaid for 20 replicas spanning the next 200 years. This is not a mere estimate; it's a conservative projection, fortifying Arweave's commitment to #securing your data for the long term. 💡 Incentivized Evolution: The #world evolves, and so does Arweave. The #protocol is open, ready for change, and embraces an incentivized evolution model. Arweave positions itself not just as a #platform but as a versatile framework, encouraging innovative forks rewarded through a fair fork methodology. The beauty lies in the compatibility of these forks at the protocol layer, fostering cooperation over competition. 🌍 Unified Dataset for Permanence: Arweave isn't just about storing data; it's about unity. The encouragement of forks aligns seamlessly with the mission of permanent data storage. Keeping the dataset unified is in everyone's best interest, ensuring a collective stride towards a future where data stands the test of time. 🔍 Breaking It Down: Cryptographic Proofs: Ensuring the replication and secure storage of substantial parts of the Arweave dataset. Storage Endowment: A commitment to safeguarding data for a minimum of 200 years. Innovative Forks: Encouraging a continuous stream of innovation for permanent data storage. 📖 For those seeking a deeper understanding, explore DRAFT 17. Delve into the intricacies of Arweave's design, where proofs drive replication, the endowment fortifies storage, and the approach to forks sparks innovation. Join us on this odyssey towards a future where your data remains eternally secure and unaltered. Türkçe için : Arweave Ecosystem Only Arweave ar.io WeaveVM is now Load Network (@useload)

𝚊𝚛://𝚟𝚎𝚟𝚒𝚟𝚘 🐘

26,390 views • 2 years ago

Trump wants Greenland not because of the rare earth minerals, but because of the high local magnetic anomalies that are present there. The USA recently acquired the rights for development and mining in one of those places. I pointed to the exact same coordinates two weeks before the deal was made public. They will have an abundance of water, cold storage for their databases, and protection during the Grand Solar Minimum and the extreme radiation. Greenland is a priority, but there are other places where they are building bunkers, and one by one, I will reveal them all...

Trump wants Greenland not because of the rare earth minerals, but because of the high local magnetic anomalies that are present there. The USA recently acquired the rights for development and mining in one of those places. I pointed to the exact same coordinates two weeks before the deal was made public. They will have an abundance of water, cold storage for their databases, and protection during the Grand Solar Minimum and the extreme radiation. Greenland is a priority, but there are other places where they are building bunkers, and one by one, I will reveal them all...

Open Minded Approach

45,077 views • 3 months ago

Why is Redis Fast? Redis is fast for in-memory data storage. Its speed has made it popular for caching, session storage, and real-time analytics. But what gives Redis its blazing speed? Let's explore: RAM-Based Storage At its core, Redis primarily uses main memory for storing data. Accessing data from RAM is orders of magnitude faster than from disk. This is a major reason for Redis's speed. However, RAM is volatile. To persist data, Redis supports disk snapshots and append-only file logging. This combines RAM's performance with disk's permanence. There is a tradeoff though - recovery from disk is slow. If a Redis instance fails, restarting from disk can be slow compared to failing over to a replica instance fully in memory. So while Redis offers durability via disk, it comes at the cost of slower recovery. A better solution is Redis replication. With a synchronized replica kept in memory, failover is instant with no rehydration. This maintains speed and near-instant recovery. IO Multiplexing & Single-threaded Read/Write Redis uses an event-driven, single-threaded model for its core operations. A main event loop handles all client requests and data operations sequentially. This single-threaded execution avoids context switching and synchronization overhead typical of multi-threaded systems. Redis uses non-blocking I/O to handle multiple connections asynchronously. This allows it to support many client connections with very low overhead, Redis does leverage threading in certain areas: - Background tasks like taking snapshots. - I/O threads are used for certain operations. - Modules can use threads. - Since Redis 6.0, it supports multi-threaded I/O for network communication, improving performance on multi-core systems. Redis also uses pipelining for high throughput. Clients pipeline commands without waiting for each response. This allows more efficient network round trips, boosting overall performance. Efficient Data Structures Redis supports various optimized data structures, from linked lists, zip lists, and skip lists to sets, hashes, and sorted sets, among others. Each is carefully designed for specific use cases for quick and efficient data access. Over to you: With Redis now supporting some multi-threading, how should we configure it to fully utilize all the CPU cores of modern hardware when deploying in production? – Subscribe to our weekly newsletter to get a Free System Design PDF (158 pages):

Why is Redis Fast? Redis is fast for in-memory data storage. Its speed has made it popular for caching, session storage, and real-time analytics. But what gives Redis its blazing speed? Let's explore: RAM-Based Storage At its core, Redis primarily uses main memory for storing data. Accessing data from RAM is orders of magnitude faster than from disk. This is a major reason for Redis's speed. However, RAM is volatile. To persist data, Redis supports disk snapshots and append-only file logging. This combines RAM's performance with disk's permanence. There is a tradeoff though - recovery from disk is slow. If a Redis instance fails, restarting from disk can be slow compared to failing over to a replica instance fully in memory. So while Redis offers durability via disk, it comes at the cost of slower recovery. A better solution is Redis replication. With a synchronized replica kept in memory, failover is instant with no rehydration. This maintains speed and near-instant recovery. IO Multiplexing & Single-threaded Read/Write Redis uses an event-driven, single-threaded model for its core operations. A main event loop handles all client requests and data operations sequentially. This single-threaded execution avoids context switching and synchronization overhead typical of multi-threaded systems. Redis uses non-blocking I/O to handle multiple connections asynchronously. This allows it to support many client connections with very low overhead, Redis does leverage threading in certain areas: - Background tasks like taking snapshots. - I/O threads are used for certain operations. - Modules can use threads. - Since Redis 6.0, it supports multi-threaded I/O for network communication, improving performance on multi-core systems. Redis also uses pipelining for high throughput. Clients pipeline commands without waiting for each response. This allows more efficient network round trips, boosting overall performance. Efficient Data Structures Redis supports various optimized data structures, from linked lists, zip lists, and skip lists to sets, hashes, and sorted sets, among others. Each is carefully designed for specific use cases for quick and efficient data access. Over to you: With Redis now supporting some multi-threading, how should we configure it to fully utilize all the CPU cores of modern hardware when deploying in production? – Subscribe to our weekly newsletter to get a Free System Design PDF (158 pages):

Sahn Lam

46,910 views • 2 years ago

WOAH 🚨 California court system had to disqualify more than 450,000 people from jury duty because they didn’t qualify. “They didn't qualify because THEY WEREN’T CITIZENS” The list to summon jurors comes from THE VOTER ROLLS PASS THE SAVE ACT “The California court system is running into a little bit of an issue. See, they have a lot of court. So because of that, they need a lot of juries. But here's the problem they keep running into. Last year alone, they brought in people for jury duty and found that more than 450,000 of them didn't qualify. Do you know why they didn't qualify? They didn't qualify because they weren't citizens. Now, that doesn't sound like a big deal to you. It's because you don't know how jury selection works. Because do you know where they get the list of people to bring in as a jury? The registered voter rolls. That's how you register for jury duty. When you register to vote, are determined to be eligible to vote, you are then eligible for jury duty. So what that means is that California had at least 450,000 people who were registered to vote, but We're not citizens, meaning that's 450,000 people in California who are illegally registered to vote.”

WOAH 🚨 California court system had to disqualify more than 450,000 people from jury duty because they didn’t qualify. “They didn't qualify because THEY WEREN’T CITIZENS” The list to summon jurors comes from THE VOTER ROLLS PASS THE SAVE ACT “The California court system is running into a little bit of an issue. See, they have a lot of court. So because of that, they need a lot of juries. But here's the problem they keep running into. Last year alone, they brought in people for jury duty and found that more than 450,000 of them didn't qualify. Do you know why they didn't qualify? They didn't qualify because they weren't citizens. Now, that doesn't sound like a big deal to you. It's because you don't know how jury selection works. Because do you know where they get the list of people to bring in as a jury? The registered voter rolls. That's how you register for jury duty. When you register to vote, are determined to be eligible to vote, you are then eligible for jury duty. So what that means is that California had at least 450,000 people who were registered to vote, but We're not citizens, meaning that's 450,000 people in California who are illegally registered to vote.”

Wall Street Apes

155,098 views • 7 months ago