Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Consistent Hashing Explained Simply Let's break down consistent hashing in a way that's easy to get. It's a handy technique for distributing data evenly across servers. And if you're more of a visual learner, don't miss the attached video which brings this concept to life. Here's how it works:...

sahnlam's profile picture

Sahn Lam

48,860 subscribers

36,787 Aufrufe • vor 2 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

4 Kommentare

Profilbild von Riccardo Causo
Riccardo Causovor 2 Jahren

the mother of all animations! 👍

Profilbild von Nirmalya Sengupta
Nirmalya Senguptavor 2 Jahren

The animation makes this even more retention-ready! Well done! 👍👍👍

Profilbild von Simform
Simformvor 2 Jahren

I would add that consistent hashing is a fundamental concept in distributed systems and is used in many real-world applications. For instance, it’s used in load balancing, where requests are distributed across multiple servers, and in data sharding, where data is partitioned across multiple databases.

Profilbild von Manoj Khangaonkar
Manoj Khangaonkarvor 2 Jahren

"Consistent" is a poor name choice for this technique.

Ähnliche Videos

MCP is mind-blowing. Here is a genius setup that will earn you a promotion with your manager. I have multiple data sources: data in S3, MySQL, and local files. Using Spice (an open-source project), I can co-locate all of that data behind a single SQL endpoint and augment it using MCP. Before, accessing data was slow, and I had to make multiple requests to get anything. After using Spice, I can query the data much faster (since it's mirrored locally), and I don't have to worry about where the data is coming from. Spice acts as an MCP server, so I can connect to it from my IDE or the Claude Desktop app and have access to all the data. But even more cool than that: Spice also acts as an MCP client, so it can connect to other MCP servers. This is where things get really interesting! Watch the video. I'm querying multiple data sources from my IDE and using the Google Maps MCP server for driving directions.
14:14

MCP is mind-blowing. Here is a genius setup that will earn you a promotion with your manager. I have multiple data sources: data in S3, MySQL, and local files. Using Spice (an open-source project), I can co-locate all of that data behind a single SQL endpoint and augment it using MCP. Before, accessing data was slow, and I had to make multiple requests to get anything. After using Spice, I can query the data much faster (since it's mirrored locally), and I don't have to worry about where the data is coming from. Spice acts as an MCP server, so I can connect to it from my IDE or the Claude Desktop app and have access to all the data. But even more cool than that: Spice also acts as an MCP client, so it can connect to other MCP servers. This is where things get really interesting! Watch the video. I'm querying multiple data sources from my IDE and using the Google Maps MCP server for driving directions.

Santiago

142,696 Aufrufe • vor 1 Jahr

Tony Blair and Oracle co-founder Larry Ellison plan to use digital ID to "unify" all data on each country's citizens "so it can be consumed and used by" their AI models. "We have to take all of this data... and move it into a single... unified data platform." "When we want to ask a question, we've provided that AI model with all the data they need to understand our country." "We need to unify all of the national data, put it into a database where it's easily consumable by the AI model, and then ask whatever question you like."
1:06

Tony Blair and Oracle co-founder Larry Ellison plan to use digital ID to "unify" all data on each country's citizens "so it can be consumed and used by" their AI models. "We have to take all of this data... and move it into a single... unified data platform." "When we want to ask a question, we've provided that AI model with all the data they need to understand our country." "We need to unify all of the national data, put it into a database where it's easily consumable by the AI model, and then ask whatever question you like."

Wide Awake Media

54,084 Aufrufe • vor 7 Monaten

Larry Ellison—owner of Oracle, CBS, and now TikTok—tells Tony Blair about his plan to use digital ID to "unify" all data on each country's citizens "so it can be consumed and used by" his AI models. "We have to take all of this data... and move it into a single, if you will, unified data platform." "When we want to ask a question, we've provided that AI model with all the data they need to understand our country." "We need to unify all of the national data, put it into a database where it's easily consumable by the AI model, and then ask whatever question you like."
1:14

Larry Ellison—owner of Oracle, CBS, and now TikTok—tells Tony Blair about his plan to use digital ID to "unify" all data on each country's citizens "so it can be consumed and used by" his AI models. "We have to take all of this data... and move it into a single, if you will, unified data platform." "When we want to ask a question, we've provided that AI model with all the data they need to understand our country." "We need to unify all of the national data, put it into a database where it's easily consumable by the AI model, and then ask whatever question you like."

Wide Awake Media

144,324 Aufrufe • vor 4 Monaten

what have I been working on for the last 2 weeks at OpenCode? we are bringing workspaces in as a first-class concept: agents will be able to run anywhere: local directory/container/worktree, remote sandbox, or anything. instead of having a single server that only knows about local directories, the server will act as a "control plane" that routes prompts to where they should go it will manage all of the sessions across these environments and provide a unified layer for all clients to interact with them we will be smart about this: it's not *only* about routing. we will sync all data from remote environments into the local control plane server. this means the remote env can be destroyed, and we will be able to later recreate a new env with exactly the same state. it's reproducible note: this is very early and experimental, the UI you see the video is just a prototype and not guaranteed to make it to prod. We hope to start shipping something soon-ish though!
1:29

what have I been working on for the last 2 weeks at OpenCode? we are bringing workspaces in as a first-class concept: agents will be able to run anywhere: local directory/container/worktree, remote sandbox, or anything. instead of having a single server that only knows about local directories, the server will act as a "control plane" that routes prompts to where they should go it will manage all of the sessions across these environments and provide a unified layer for all clients to interact with them we will be smart about this: it's not *only* about routing. we will sync all data from remote environments into the local control plane server. this means the remote env can be destroyed, and we will be able to later recreate a new env with exactly the same state. it's reproducible note: this is very early and experimental, the UI you see the video is just a prototype and not guaranteed to make it to prod. We hope to start shipping something soon-ish though!

James Long

170,530 Aufrufe • vor 3 Monaten

React tip: "use client" misconceptions (2/5) 🚫 "You cannot nest Server Components inside Client Components because "use client" turns everything into Client Components." ✅ We can pass the rendered result of Server Components to Client Components as props. Simple example: (Server Component) (Client Component) (Server Component) is designed for the client. It needs to instantly open and close when clicked. is designed for the server. It uses packages that don't work in the browser and needs to fetch data close to where it's stored without exposing credentials. So, how can we nest a component that uses server APIs inside a component that uses client APIs... without using `import`? React props to the rescue! --- (0:00) 1-4: Reminder: Importing code forms a module dependency graph. Adding dependencies to a server or client bundle. (0:23) 5-6: Reminder: Using components eventually forms a rendered component tree. (0:37) 9: Oh no! We get an error when trying to `import` a client API (useState) into a server module. (0:44) 10: We know the trick by now: Add "use client" to mark `2.js` as a client entry point. This moves the module to the client bundle and allows us to use client APIs like `useState.` (0:51) 11: But we get a new error! "use client" moved all imported dependencies into the client bundle, including our ORM package, which doesn't work in the browser. (0:59) 13: Let's refactor without changing our rendered component hierarchy. First, we move the `Cart` import to the parent file that imports `Modal`. This moves `Cart` outside the "use client" boundary and consequently the client bundle. (1:11) 15: Then, we pass down the rendered result of `Cart` as a prop to `Modal`. This allows `Cart` to be entirely rendered on the server as a Server Component before being passed down. `Modal` has no knowledge of what the `cart` prop is. Its only responsibility is placing whatever it receives into the `{cart}` slot. (1:15) 16: Finally, it's common to use the special `children` prop for a component's primary content. The key insight is that we were able to use props to retain our desired component hierarchy even though we changed our module dependency graph.
1:24

React tip: "use client" misconceptions (2/5) 🚫 "You cannot nest Server Components inside Client Components because "use client" turns everything into Client Components." ✅ We can pass the rendered result of Server Components to Client Components as props. Simple example: (Server Component) (Client Component) (Server Component) is designed for the client. It needs to instantly open and close when clicked. is designed for the server. It uses packages that don't work in the browser and needs to fetch data close to where it's stored without exposing credentials. So, how can we nest a component that uses server APIs inside a component that uses client APIs... without using `import`? React props to the rescue! --- (0:00) 1-4: Reminder: Importing code forms a module dependency graph. Adding dependencies to a server or client bundle. (0:23) 5-6: Reminder: Using components eventually forms a rendered component tree. (0:37) 9: Oh no! We get an error when trying to `import` a client API (useState) into a server module. (0:44) 10: We know the trick by now: Add "use client" to mark `2.js` as a client entry point. This moves the module to the client bundle and allows us to use client APIs like `useState.` (0:51) 11: But we get a new error! "use client" moved all imported dependencies into the client bundle, including our ORM package, which doesn't work in the browser. (0:59) 13: Let's refactor without changing our rendered component hierarchy. First, we move the `Cart` import to the parent file that imports `Modal`. This moves `Cart` outside the "use client" boundary and consequently the client bundle. (1:11) 15: Then, we pass down the rendered result of `Cart` as a prop to `Modal`. This allows `Cart` to be entirely rendered on the server as a Server Component before being passed down. `Modal` has no knowledge of what the `cart` prop is. Its only responsibility is placing whatever it receives into the `{cart}` slot. (1:15) 16: Finally, it's common to use the special `children` prop for a component's primary content. The key insight is that we were able to use props to retain our desired component hierarchy even though we changed our module dependency graph.

Delba

43,989 Aufrufe • vor 2 Jahren

Which one is our priority for securing a digital future for Zimbabwe? The Honourable Speaker's position while providing a clear, logical, and data-informed counter-argument we appreciate his efforts and submission. Let us have a conversation on our priorities in the current Zimbabwean context which we presented yesterday: This is a critical national conversation on our digital future. The proposition of a Google data centre is undoubtedly appealing. Building a centre of Technological Excellence that houses multiple Tech companies and a Start-up Ecosystem is also prudent, though we are calling it a Technology Park. However, I was of the following view which I am willing to be criticised and guided on. The strategic prioritisation of a national ICT Park ecosystem currently is the foundational path to sustainable, sovereign growth and capacity for Zimbabwe. We are reaching out to every province through the Digital Centres, Innovation Hubs at Universities and Colleges. Infrastructure which we need to capacitate better. This is a decentralised system utilising and expanding the infrastructure we have. The central question is not if we want major players like Google; that is not questionable, but when, how and on what terms. Why are we building our own foundation, house, techno park and mini ICT Parks in the provinces and districts? We absolutely need at least a one hyperscale data centre, but centralisation in the current and future environment can be restrictive. This was our plan: 1.The Foundation Before the Skyscraper: Capacity and Traffic We need to increase our national data volumes and internet traffic . Our urgent priority should be upgrading our national backbone, specifically the Optical Fibre on Power Transmission Lines (e.g., Powertel's network from Insukamini to Johannesburg), to peer efficiently with global giants. This builds the foundational "digital highway" we manage. 2.Generating Traffic Through Digitalization A data centre is a response to demand, not a creator of it. We must first drive digitalization aggressively through digital payments, process automation, and e-governance to generate the significant local traffic that would make a data centre viable. Furthermore, we must incorporate Edge Computing strategies to process data closer to the source, a more efficient model for our current needs and in compliance to our Cyber and Data Protection Act which we can amend if need be. Being a regional internet and cybersecurity hub is crucial as the Speaker alluded to me mentioning it to SADC Parliamentary Forum, this is the ultimate goal. 3.PPPs are key to lessen the burden to the fiscus and we are ready to accommodate organisations willing to assist government.(Cont)
3:05

Which one is our priority for securing a digital future for Zimbabwe? The Honourable Speaker's position while providing a clear, logical, and data-informed counter-argument we appreciate his efforts and submission. Let us have a conversation on our priorities in the current Zimbabwean context which we presented yesterday: This is a critical national conversation on our digital future. The proposition of a Google data centre is undoubtedly appealing. Building a centre of Technological Excellence that houses multiple Tech companies and a Start-up Ecosystem is also prudent, though we are calling it a Technology Park. However, I was of the following view which I am willing to be criticised and guided on. The strategic prioritisation of a national ICT Park ecosystem currently is the foundational path to sustainable, sovereign growth and capacity for Zimbabwe. We are reaching out to every province through the Digital Centres, Innovation Hubs at Universities and Colleges. Infrastructure which we need to capacitate better. This is a decentralised system utilising and expanding the infrastructure we have. The central question is not if we want major players like Google; that is not questionable, but when, how and on what terms. Why are we building our own foundation, house, techno park and mini ICT Parks in the provinces and districts? We absolutely need at least a one hyperscale data centre, but centralisation in the current and future environment can be restrictive. This was our plan: 1.The Foundation Before the Skyscraper: Capacity and Traffic We need to increase our national data volumes and internet traffic . Our urgent priority should be upgrading our national backbone, specifically the Optical Fibre on Power Transmission Lines (e.g., Powertel's network from Insukamini to Johannesburg), to peer efficiently with global giants. This builds the foundational "digital highway" we manage. 2.Generating Traffic Through Digitalization A data centre is a response to demand, not a creator of it. We must first drive digitalization aggressively through digital payments, process automation, and e-governance to generate the significant local traffic that would make a data centre viable. Furthermore, we must incorporate Edge Computing strategies to process data closer to the source, a more efficient model for our current needs and in compliance to our Cyber and Data Protection Act which we can amend if need be. Being a regional internet and cybersecurity hub is crucial as the Speaker alluded to me mentioning it to SADC Parliamentary Forum, this is the ultimate goal. 3.PPPs are key to lessen the burden to the fiscus and we are ready to accommodate organisations willing to assist government.(Cont)

Hon Tatenda.A. Mavetera

490,229 Aufrufe • vor 7 Monaten

Our retired data center hardware has a second life. The Amazon Web Services reverse logistics hubs use circular economy principles to test, repair, and reuse demanufactured server racks, all while maintaining the highest level of data security. One of our reverse logistics operations managers says it well, “The components we repair are small, but they have the potential to make a big impact for our company, our customers, and our planet.” #Circularity23 #AWS
1:34

Our retired data center hardware has a second life. The Amazon Web Services reverse logistics hubs use circular economy principles to test, repair, and reuse demanufactured server racks, all while maintaining the highest level of data security. One of our reverse logistics operations managers says it well, “The components we repair are small, but they have the potential to make a big impact for our company, our customers, and our planet.” #Circularity23 #AWS

Adam Selipsky

25,368 Aufrufe • vor 3 Jahren

You can connect your Supabase database via MCP server to Cursor! The Cursor agent can get the schema and any data from your database through the official Postgres MCP server! This helps Cursor understand your database better when it needs to modify it to add a new feature!
0:45

You can connect your Supabase database via MCP server to Cursor! The Cursor agent can get the schema and any data from your database through the official Postgres MCP server! This helps Cursor understand your database better when it needs to modify it to add a new feature!

Tyler Shukert

203,451 Aufrufe • vor 1 Jahr

Twelve years ago we asked the question: how can we put public data "on wheels"? Datawheel was born from vision that data alone doesn't get far. It needs vehicles to reach hearts and minds. Vehicles that make data easy to find, explore, and understand. Today, Datawheel turns twelve. In these twelve years, we have built dozens of solutions that are helping define the state of the art in public data distribution. Today we celebrate this journey. A journey with a great team and amazing clients. The journey to make public data all it can be. are some of the tools defining all that public data can be. Thank you!!!
1:00

Twelve years ago we asked the question: how can we put public data "on wheels"? Datawheel was born from vision that data alone doesn't get far. It needs vehicles to reach hearts and minds. Vehicles that make data easy to find, explore, and understand. Today, Datawheel turns twelve. In these twelve years, we have built dozens of solutions that are helping define the state of the art in public data distribution. Today we celebrate this journey. A journey with a great team and amazing clients. The journey to make public data all it can be. are some of the tools defining all that public data can be. Thank you!!!

César A. Hidalgo

12,925 Aufrufe • vor 1 Jahr

We successfully launched a sensor into a tornado with good data back! Here is the first drop of the 3D data!!!! Check out more of our science data on (we are working on better analytics for the site.) This dataset is from the Blue Rapids KS tornado on 5/18/26
0:30

We successfully launched a sensor into a tornado with good data back! Here is the first drop of the 3D data!!!! Check out more of our science data on (we are working on better analytics for the site.) This dataset is from the Blue Rapids KS tornado on 5/18/26

Will Clay

15,115 Aufrufe • vor 28 Tagen

Robots enter data centers! 💽 SeRo developed by NAVER LABS, is built for one of the most overlooked but critical tasks in a data center: managing servers in the IT warehouse. It can autonomously load and unload servers, identify their asset numbers, and log their lifecycle data. Physically, SeRo is designed tall to handle racks up to three meters high, maximizing storage density. SeRo also works as part of a larger system. It hands assets to GaRo, an autonomous transport robot, for seamless movement between warehouse and server room. More AI ops, more data centers, more data centers ops... Perfect market for robotics! 🦾
0:36

Robots enter data centers! 💽 SeRo developed by NAVER LABS, is built for one of the most overlooked but critical tasks in a data center: managing servers in the IT warehouse. It can autonomously load and unload servers, identify their asset numbers, and log their lifecycle data. Physically, SeRo is designed tall to handle racks up to three meters high, maximizing storage density. SeRo also works as part of a larger system. It hands assets to GaRo, an autonomous transport robot, for seamless movement between warehouse and server room. More AI ops, more data centers, more data centers ops... Perfect market for robotics! 🦾

Lukas Ziegler

30,311 Aufrufe • vor 9 Monaten

Introducing the #WELL3Ring: Elevating Health Data to On-Chain Assets🔘 At #WELL3, we are leading a transformative shift in how health data is valued and monetized. We cordially invite our #WELLID holders to be the first to experience the benefits of this DePIN wearable. By donning the WELL3 Ring and sharing your health data, you will gain access to unlimited and exclusive rewards🧵
0:40

Introducing the #WELL3Ring: Elevating Health Data to On-Chain Assets🔘 At #WELL3, we are leading a transformative shift in how health data is valued and monetized. We cordially invite our #WELLID holders to be the first to experience the benefits of this DePIN wearable. By donning the WELL3 Ring and sharing your health data, you will gain access to unlimited and exclusive rewards🧵

WELL3

223,003 Aufrufe • vor 2 Jahren

We have data in abundance now. The real value isn't within the RAW Data, but is this data validated and verified? More value in data refinement. We have a solution for this which is validated by 6 years of research and development with the Department of Defense Now securing and validating commercial data from partners like Common Crawl and Panasonic
1:03

We have data in abundance now. The real value isn't within the RAW Data, but is this data validated and verified? More value in data refinement. We have a solution for this which is validated by 6 years of research and development with the Department of Defense Now securing and validating commercial data from partners like Common Crawl and Panasonic

Constellation Network

10,534 Aufrufe • vor 1 Jahr

Phil Waldron, ex-military data expert, found Frankfurt Server & Dominion-Smartmatic Network tied to the 2020 election with election data sent to foreign servers through internet connected machines. U.S. election data packets from multiple states were routed to a SCYTL server in Frankfurt tied to Dominion/Smartmatic. Traffic surged massively on Nov 3-4, then the server went dark on Nov 9. "We have the Frankfurt traffic and data packets," Waldron said, backed by a German analyst tracking the flow. Logs also show massive traffic coming and going from U.S. 2020 election precincts to foreign countries including China, Iran, and Serbia. After the election Dominion sent reps all across the country to wipe machines of all logs and data to cover up foreign ties and election interference. Tina Peters is one of the only people who preserved data before they erased it and why she was thrown in prison. Leaked Panama docs reveal SGO, Smartmatic, and Dominion share the same tiny Barbados HQ. Dominion's code traces back to Smartmatic, licensed to both Dominion and ES&S, same vulnerable DNA. Plus, a mysterious $400M transaction to Dominion just before the election.
3:54

Phil Waldron, ex-military data expert, found Frankfurt Server & Dominion-Smartmatic Network tied to the 2020 election with election data sent to foreign servers through internet connected machines. U.S. election data packets from multiple states were routed to a SCYTL server in Frankfurt tied to Dominion/Smartmatic. Traffic surged massively on Nov 3-4, then the server went dark on Nov 9. "We have the Frankfurt traffic and data packets," Waldron said, backed by a German analyst tracking the flow. Logs also show massive traffic coming and going from U.S. 2020 election precincts to foreign countries including China, Iran, and Serbia. After the election Dominion sent reps all across the country to wipe machines of all logs and data to cover up foreign ties and election interference. Tina Peters is one of the only people who preserved data before they erased it and why she was thrown in prison. Leaked Panama docs reveal SGO, Smartmatic, and Dominion share the same tiny Barbados HQ. Dominion's code traces back to Smartmatic, licensed to both Dominion and ES&S, same vulnerable DNA. Plus, a mysterious $400M transaction to Dominion just before the election.

The SCIF

23,013 Aufrufe • vor 2 Monaten

WATCH: While local election returns received by the Comelec are already at 60 percent as of writing, PPCRV and KBP said they have not received any data on their servers. PPCRV spokesperson Ana Singson said this was "unusual and we are concerned." PPCRV spox Ana Singson: "The sad news is that we have not had access to any of that data, so it is of concern to us. We have been in constant touch with Comelec. We have not yet received our response. The only data file that we got in PPCRV is a file with the header 'title.' "I have to say that this is quite unusual and that this has not happened since 2010, that we have not received even a first dump when over 1/3 of the data has already been transmitted. "We understand that Comelec is meeting right now. We pray we pray for quick resolution and most importantly we pray for quick access to that data." KBP, which also has access to the elections transparency server, said it also did not receive any transmission of votes. #VotePH2025 | Dexter Cabalza /PDI •⁠ ⁠Follow election coverage at · Follow our live updates at
2:20

WATCH: While local election returns received by the Comelec are already at 60 percent as of writing, PPCRV and KBP said they have not received any data on their servers. PPCRV spokesperson Ana Singson said this was "unusual and we are concerned." PPCRV spox Ana Singson: "The sad news is that we have not had access to any of that data, so it is of concern to us. We have been in constant touch with Comelec. We have not yet received our response. The only data file that we got in PPCRV is a file with the header 'title.' "I have to say that this is quite unusual and that this has not happened since 2010, that we have not received even a first dump when over 1/3 of the data has already been transmitted. "We understand that Comelec is meeting right now. We pray we pray for quick resolution and most importantly we pray for quick access to that data." KBP, which also has access to the elections transparency server, said it also did not receive any transmission of votes. #VotePH2025 | Dexter Cabalza /PDI •⁠ ⁠Follow election coverage at · Follow our live updates at

Inquirer

109,110 Aufrufe • vor 1 Jahr

“we’ll have to have some sort of Universal Basic Income (UBI)” Elon Musk But who is going to pay? We believe our data! HUDI = Human Data Income We are building a Universal Basic Income based on our data. Our data is our asset, the new oil, but we have no transparency nor profit from it. Help us build the Human Data Income: we made great progress, but it’s just the beginning!
0:32

“we’ll have to have some sort of Universal Basic Income (UBI)” Elon Musk But who is going to pay? We believe our data! HUDI = Human Data Income We are building a Universal Basic Income based on our data. Our data is our asset, the new oil, but we have no transparency nor profit from it. Help us build the Human Data Income: we made great progress, but it’s just the beginning!

HUDI

11,400,256 Aufrufe • vor 2 Jahren

✨ I made a new thing today: 📑 Whenever I need to quickly copy paste a raw JSON data dump from my app and view it I'd always use json . parser . online . fr but it seems unmaintained, keeps going down, doesn't have HTTPS, and other JSON viewers are full of spyware/malware/tracking scripts So I made this today with a lot of help from ChatGPT to solve it for me and everyone else: visualizes raw JSON data for you, and does it 100% on the client without sending any data to the server But it also secretly supports a lot of other data formats like XML, PHP serialized data, hexadecimal, base64 encoded data, and even binary! And it also works well on mobile! Another one of my little hack projects :D If you want me to add other data types, let me know and I'll add them
1:32

✨ I made a new thing today: 📑 Whenever I need to quickly copy paste a raw JSON data dump from my app and view it I'd always use json . parser . online . fr but it seems unmaintained, keeps going down, doesn't have HTTPS, and other JSON viewers are full of spyware/malware/tracking scripts So I made this today with a lot of help from ChatGPT to solve it for me and everyone else: visualizes raw JSON data for you, and does it 100% on the client without sending any data to the server But it also secretly supports a lot of other data formats like XML, PHP serialized data, hexadecimal, base64 encoded data, and even binary! And it also works well on mobile! Another one of my little hack projects :D If you want me to add other data types, let me know and I'll add them

@levelsio

882,610 Aufrufe • vor 1 Jahr

Once we started to work with large global retailers, we needed a better way to scale this process. Ideally, the staff at the store could do this themselves — rather than us flying our team across the world — and then we could lower the cost and timelines. So we built a self-serve version of our survey app, with a tutorial mode designed for beginners. Over time, we collected millions of data points, and so we were able to develop an algorithm which would auto-correct mistakes. In other words, if the surveyor accidentally placed their ground-truth location in the wrong place on the map, we could use our algorithms to detect it, and correct it. So now we have WiFi, and with and our efforts on producing a high quality survey, we have the best WiFi positioning available. With WiFi on its own, it’s achieving 3 meter accuracy. This is a great foundation to build on. WiFi + Motion data To refine this down to 1-meter accuracy, we realised that we could combine WiFi with the same technology behind self-driving cars and robotics: a motion system called SLAM (Simultaneous Localization and Mapping). SLAM uses the accelerometer, gyroscope and camera system to understand precise device motion. Imagine a car driving through a tunnel, using the motion since its last GPS ping to keep location accurate until it comes out the other side. On a phone, this technology is very reliable, and measures device motion with high precision. But SLAM is measuring motion within its own coordinate space, it’s not aligned with the real world. SLAM tracks the user’s relative motion, like “moved forward 2 meters, then turned left”, but does “forward” mean “north”, or some other direction? It’s not calibrated, so it could mean any location, any direction. We can’t rely on the compass to help us out with this, because phone compasses are notoriously incorrect — everyone knows the frustration of being sent the wrong way down a street. So our job was to align this motion data with the triangulation data we were receiving from WiFi. We designed an algorithm that could simulate every possibility, filter the unlikely scenarios, and hone in your location, using WiFi as an anchor. So WiFi gives us the initial blue dot, SLAM gives us motion, and as the user starts walking and we receive more data, our algorithms can refine location accuracy down to a consistent 1-meter accuracy. We’ve tested these algorithms in many locations, on hundreds of hours of ground-truth data:
0:47

Once we started to work with large global retailers, we needed a better way to scale this process. Ideally, the staff at the store could do this themselves — rather than us flying our team across the world — and then we could lower the cost and timelines. So we built a self-serve version of our survey app, with a tutorial mode designed for beginners. Over time, we collected millions of data points, and so we were able to develop an algorithm which would auto-correct mistakes. In other words, if the surveyor accidentally placed their ground-truth location in the wrong place on the map, we could use our algorithms to detect it, and correct it. So now we have WiFi, and with and our efforts on producing a high quality survey, we have the best WiFi positioning available. With WiFi on its own, it’s achieving 3 meter accuracy. This is a great foundation to build on. WiFi + Motion data To refine this down to 1-meter accuracy, we realised that we could combine WiFi with the same technology behind self-driving cars and robotics: a motion system called SLAM (Simultaneous Localization and Mapping). SLAM uses the accelerometer, gyroscope and camera system to understand precise device motion. Imagine a car driving through a tunnel, using the motion since its last GPS ping to keep location accurate until it comes out the other side. On a phone, this technology is very reliable, and measures device motion with high precision. But SLAM is measuring motion within its own coordinate space, it’s not aligned with the real world. SLAM tracks the user’s relative motion, like “moved forward 2 meters, then turned left”, but does “forward” mean “north”, or some other direction? It’s not calibrated, so it could mean any location, any direction. We can’t rely on the compass to help us out with this, because phone compasses are notoriously incorrect — everyone knows the frustration of being sent the wrong way down a street. So our job was to align this motion data with the triangulation data we were receiving from WiFi. We designed an algorithm that could simulate every possibility, filter the unlikely scenarios, and hone in your location, using WiFi as an anchor. So WiFi gives us the initial blue dot, SLAM gives us motion, and as the user starts walking and we receive more data, our algorithms can refine location accuracy down to a consistent 1-meter accuracy. We’ve tested these algorithms in many locations, on hundreds of hours of ground-truth data:

Andrew Hart

90,946 Aufrufe • vor 10 Monaten

Lori Chavez-DeRemer on jobs data: "Sometimes it's too late to get accurate data points ... we don't have that accurate data for the Fed to make a good decision, but I believe the Fed needs to cut interest rates again in December to really prop up this economy."
1:36

Lori Chavez-DeRemer on jobs data: "Sometimes it's too late to get accurate data points ... we don't have that accurate data for the Fed to make a good decision, but I believe the Fed needs to cut interest rates again in December to really prop up this economy."

Aaron Rupar

158,278 Aufrufe • vor 7 Monaten