Loading video...

Video Failed to Load

Go Home

visualizing text splitting & chunking strategies ChunkViz .com I thought I remembered a tool to visualize text chunking, but I couldn't find it, so I built one I didn't realize it would be so visually pleasing to tinker with 4 different splitters featured

GregKamradt's profile picture

Greg Kamradt

49,690 subscribers

116,225 views • 2 years ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Traditional Chunking can lose context between chunks. (Let's explore a better way!) Enter Late Chunking… Here's how it works: Traditional Chunking • Split the text into chunks • Embed each chunk separately Late Chunking • Embed the entire text first • Split it into chunks after the embedding Advantages of Late Chunking • Maintains connections between segments • Reduces the need for complex chunking strategies • Cost-effective: extremely similar cost to regular chunking methods Late Chunking is a promising alternative to traditional methods like ColBERT and naive chunking. It's particularly useful for applications where the documents are long, and context needs to be retained across many pages of text when retrieving information. Want to learn more? • Blog post: • Notebook: Special thanks to Daniel Williams for his invaluable collaboration on this one! 🔥
1:19

Traditional Chunking can lose context between chunks. (Let's explore a better way!) Enter Late Chunking… Here's how it works: Traditional Chunking • Split the text into chunks • Embed each chunk separately Late Chunking • Embed the entire text first • Split it into chunks after the embedding Advantages of Late Chunking • Maintains connections between segments • Reduces the need for complex chunking strategies • Cost-effective: extremely similar cost to regular chunking methods Late Chunking is a promising alternative to traditional methods like ColBERT and naive chunking. It's particularly useful for applications where the documents are long, and context needs to be retained across many pages of text when retrieving information. Want to learn more? • Blog post: • Notebook: Special thanks to Daniel Williams for his invaluable collaboration on this one! 🔥

Femke Plantinga

19,792 views • 1 year ago

Remember Fruit Ninja? I wanted to play it. So I built my own via Text messages. And downloaded it directly to my phone...
0:27

Remember Fruit Ninja? I wanted to play it. So I built my own via Text messages. And downloaded it directly to my phone...

Ansh Nanda

12,642 views • 1 month ago

“I mean, i didn't even know that. So, if they told me to get off for McDavid, i would have. But, i think i just went out there because i thought i was the one who had to take it.”
1:17

“I mean, i didn't even know that. So, if they told me to get off for McDavid, i would have. But, i think i just went out there because i thought i was the one who had to take it.”

Willmack Updates

202,351 views • 4 months ago

I always see "Unedited VS Edited" videos on twitter. So I thought it would be a fun idea to do one. So uh here's a trailer I edited.
1:49

I always see "Unedited VS Edited" videos on twitter. So I thought it would be a fun idea to do one. So uh here's a trailer I edited.

Jedlark

130,658 views • 1 year ago

I thought it was going to be a wholesome game but I was so wrong...
1:00

Sensitive content

I thought it was going to be a wholesome game but I was so wrong...

Fallen Eros (NTR / Netorase)

12,677 views • 1 year ago

"There was so much build to Page winning [the title], of course there's a point where he can lose it but I didn't think it would be to Joe and I didn't think it would be November. I was surprised." - Dave Meltzer
1:03

"There was so much build to Page winning [the title], of course there's a point where he can lose it but I didn't think it would be to Joe and I didn't think it would be November. I was surprised." - Dave Meltzer

Wrestling Observer

23,179 views • 7 months ago

💬: how would you like to be remembered in the history of kpop? 🐖🐇: like tablo hyung said "i just hope we'll be remembered" ㅎㅎ 🐖🐇: "skz is different" "skz really felt refreshing" "they couldn't be replaced" "they're one of a kind" i hope these keywords come to mind when people think of us 🦊: "what's with these guys?" i feel like there's something like that about us so i kinda like it because it makes us look special. i hope to be remembered with this keyword "what's with these guys?"
0:34

💬: how would you like to be remembered in the history of kpop? 🐖🐇: like tablo hyung said "i just hope we'll be remembered" ㅎㅎ 🐖🐇: "skz is different" "skz really felt refreshing" "they couldn't be replaced" "they're one of a kind" i hope these keywords come to mind when people think of us 🦊: "what's with these guys?" i feel like there's something like that about us so i kinda like it because it makes us look special. i hope to be remembered with this keyword "what's with these guys?"

비니

56,083 views • 5 months ago

DRALLY PLAY WITH WILLIAMEST #DrAllyTimetoPlayxWilliamEst #WilliamEst 🦈: actually, red white & royal blue is a series i already like, so i wanted to do it because i thought it would be fun. at first, i thought it would be too difficult because the outfit really had to get stained with cake. but then phi said it could be done, so we rented a studio ourselves and set everything up as one big production
0:33

DRALLY PLAY WITH WILLIAMEST #DrAllyTimetoPlayxWilliamEst #WilliamEst 🦈: actually, red white & royal blue is a series i already like, so i wanted to do it because i thought it would be fun. at first, i thought it would be too difficult because the outfit really had to get stained with cake. but then phi said it could be done, so we rented a studio ourselves and set everything up as one big production

𝑛𝑎𝑛𝑎 ◡̈

127,600 views • 1 year ago

Trump: The Congressional Medal of Honor. I wanted to give it to myself, but I was informed I couldn't do it and I couldn't find anything where I was actually worthy so here we are,
0:38

Trump: The Congressional Medal of Honor. I wanted to give it to myself, but I was informed I couldn't do it and I couldn't find anything where I was actually worthy so here we are,

Acyn

86,427 views • 23 days ago

Kyle Daukaus on what went wrong in his initial UFC stint & the road back after being released in 2022: "I just took everything for granted, to be honest. I got to the UFC, and I was like, 'Man, I'm here. I made it.' But what I didn't realize was that it would be so short-term."
5:58

Kyle Daukaus on what went wrong in his initial UFC stint & the road back after being released in 2022: "I just took everything for granted, to be honest. I got to the UFC, and I was like, 'Man, I'm here. I made it.' But what I didn't realize was that it would be so short-term."

Ariel Helwani

23,022 views • 7 months ago

The display stand I ship our Copland Supply keycaps in was also designed to double as protection during shipping! Only thing is I didn't realize how CRAZY strong it would be and I needed to also install a keycap removal tool so you could actually get it out lol
0:52

The display stand I ship our Copland Supply keycaps in was also designed to double as protection during shipping! Only thing is I didn't realize how CRAZY strong it would be and I needed to also install a keycap removal tool so you could actually get it out lol

Quinn Nelson

13,598 views • 7 months ago

💌 10.37PM Tada Complete It’s been a while since I edited a video… so I feel like it could’ve been a lot better But still I hope you listen to it and enjoy it ㅎㅎ I was originally just going to send the audio but I thought it would be nice to make a video to go with it ㅋㅋㅋ
4:32

💌 10.37PM Tada Complete It’s been a while since I edited a video… so I feel like it could’ve been a lot better But still I hope you listen to it and enjoy it ㅎㅎ I was originally just going to send the audio but I thought it would be nice to make a video to go with it ㅋㅋㅋ

🐹

38,461 views • 1 year ago

Looking through old files, I found this thing. It was an experimental game I tried to make. I thought it would be a fun game. It turned out to be frustrating to play, so I dumped it. #missinghalloween
0:48

Looking through old files, I found this thing. It was an experimental game I tried to make. I thought it would be a fun game. It turned out to be frustrating to play, so I dumped it. #missinghalloween

Mike Inel

247,246 views • 2 years ago

I built a chatbot to talk to my friends Blog post instead of reading it 🫣-> Okay so Alistair posted a post about the ChatGPT api, but I didn't want to read it all 🤣. So I built a chat bot in Promptable.js to talk with his article:
1:04

I built a chatbot to talk to my friends Blog post instead of reading it 🫣-> Okay so Alistair posted a post about the ChatGPT api, but I didn't want to read it all 🤣. So I built a chat bot in Promptable.js to talk with his article:

Colin

41,746 views • 3 years ago

🦊: I worked hard for 8 years &rested for 6 months, I know I shouldn't be doing anything but it was so hard. I lied down but knew I shouldn't, yet I didn't know what to do that I started comparing myself with my peers. But I didn't know what to do so I started doing part-time
0:22

🦊: I worked hard for 8 years &rested for 6 months, I know I shouldn't be doing anything but it was so hard. I lied down but knew I shouldn't, yet I didn't know what to do that I started comparing myself with my peers. But I didn't know what to do so I started doing part-time

kit 킷 🐺

45,141 views • 5 months ago

Was experimenting with ink style for the text. Didn't make to final product but i really liked it. #aftereffects
0:33

Was experimenting with ink style for the text. Didn't make to final product but i really liked it. #aftereffects

Seter | DOKOMI 2026

17,111 views • 3 months ago

Here comes the final episode of M&M series experimentation. Received good feedback all throughout. But I noticed not much value add to large audience. And tbh I didn't have fun doing it, though I thought I would. So, maybe sometime in the future if I find some value to add.
0:48

Here comes the final episode of M&M series experimentation. Received good feedback all throughout. But I noticed not much value add to large audience. And tbh I didn't have fun doing it, though I thought I would. So, maybe sometime in the future if I find some value to add.

PRAFUL KULKARNI

28,551 views • 1 year ago

I thought it was a poor the girl in the red shirt couldn't do it, but after I saw her leg I thought she was injured, so I wanted to say you're great, proud of you ❤️
1:34

I thought it was a poor the girl in the red shirt couldn't do it, but after I saw her leg I thought she was injured, so I wanted to say you're great, proud of you ❤️

Fellana

57,116 views • 9 months ago

I hope you spent a beautiful Holy Week. This text is so beautiful I wanted to share it with you. Christ is Risen! ✝️
1:14

I hope you spent a beautiful Holy Week. This text is so beautiful I wanted to share it with you. Christ is Risen! ✝️

Ada Lluch

28,964 views • 3 months ago