Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

visualizing text splitting & chunking strategies ChunkViz .com I thought I remembered a tool to visualize text chunking, but I couldn't find it, so I built one I didn't realize it would be so visually pleasing to tinker with 4 different splitters featured

GregKamradt's profile picture

Greg Kamradt

50,017 subscribers

116,228 Aufrufe • vor 2 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Traditional Chunking can lose context between chunks. (Let's explore a better way!) Enter Late Chunking… Here's how it works: Traditional Chunking • Split the text into chunks • Embed each chunk separately Late Chunking • Embed the entire text first • Split it into chunks after the embedding Advantages of Late Chunking • Maintains connections between segments • Reduces the need for complex chunking strategies • Cost-effective: extremely similar cost to regular chunking methods Late Chunking is a promising alternative to traditional methods like ColBERT and naive chunking. It's particularly useful for applications where the documents are long, and context needs to be retained across many pages of text when retrieving information. Want to learn more? • Blog post: • Notebook: Special thanks to Daniel Williams for his invaluable collaboration on this one! 🔥
1:19

Traditional Chunking can lose context between chunks. (Let's explore a better way!) Enter Late Chunking… Here's how it works: Traditional Chunking • Split the text into chunks • Embed each chunk separately Late Chunking • Embed the entire text first • Split it into chunks after the embedding Advantages of Late Chunking • Maintains connections between segments • Reduces the need for complex chunking strategies • Cost-effective: extremely similar cost to regular chunking methods Late Chunking is a promising alternative to traditional methods like ColBERT and naive chunking. It's particularly useful for applications where the documents are long, and context needs to be retained across many pages of text when retrieving information. Want to learn more? • Blog post: • Notebook: Special thanks to Daniel Williams for his invaluable collaboration on this one! 🔥

Femke Plantinga

19,793 Aufrufe • vor 1 Jahr

Remember Fruit Ninja? I wanted to play it. So I built my own via Text messages. And downloaded it directly to my phone...
0:27

Remember Fruit Ninja? I wanted to play it. So I built my own via Text messages. And downloaded it directly to my phone...

Ansh Nanda

12,642 Aufrufe • vor 3 Monaten

“I mean, i didn't even know that. So, if they told me to get off for McDavid, i would have. But, i think i just went out there because i thought i was the one who had to take it.”
1:17

“I mean, i didn't even know that. So, if they told me to get off for McDavid, i would have. But, i think i just went out there because i thought i was the one who had to take it.”

Willmack Updates

202,351 Aufrufe • vor 6 Monaten

I always see "Unedited VS Edited" videos on twitter. So I thought it would be a fun idea to do one. So uh here's a trailer I edited.
1:49

I always see "Unedited VS Edited" videos on twitter. So I thought it would be a fun idea to do one. So uh here's a trailer I edited.

Jedlark

130,763 Aufrufe • vor 1 Jahr

"There was so much build to Page winning [the title], of course there's a point where he can lose it but I didn't think it would be to Joe and I didn't think it would be November. I was surprised." - Dave Meltzer
1:03

"There was so much build to Page winning [the title], of course there's a point where he can lose it but I didn't think it would be to Joe and I didn't think it would be November. I was surprised." - Dave Meltzer

Wrestling Observer

23,179 Aufrufe • vor 9 Monaten

💬: how would you like to be remembered in the history of kpop? 🐖🐇: like tablo hyung said "i just hope we'll be remembered" ㅎㅎ 🐖🐇: "skz is different" "skz really felt refreshing" "they couldn't be replaced" "they're one of a kind" i hope these keywords come to mind when people think of us 🦊: "what's with these guys?" i feel like there's something like that about us so i kinda like it because it makes us look special. i hope to be remembered with this keyword "what's with these guys?"
0:34

💬: how would you like to be remembered in the history of kpop? 🐖🐇: like tablo hyung said "i just hope we'll be remembered" ㅎㅎ 🐖🐇: "skz is different" "skz really felt refreshing" "they couldn't be replaced" "they're one of a kind" i hope these keywords come to mind when people think of us 🦊: "what's with these guys?" i feel like there's something like that about us so i kinda like it because it makes us look special. i hope to be remembered with this keyword "what's with these guys?"

비니

56,083 Aufrufe • vor 7 Monaten

DRALLY PLAY WITH WILLIAMEST #DrAllyTimetoPlayxWilliamEst #WilliamEst 🦈: actually, red white & royal blue is a series i already like, so i wanted to do it because i thought it would be fun. at first, i thought it would be too difficult because the outfit really had to get stained with cake. but then phi said it could be done, so we rented a studio ourselves and set everything up as one big production
0:33

DRALLY PLAY WITH WILLIAMEST #DrAllyTimetoPlayxWilliamEst #WilliamEst 🦈: actually, red white & royal blue is a series i already like, so i wanted to do it because i thought it would be fun. at first, i thought it would be too difficult because the outfit really had to get stained with cake. but then phi said it could be done, so we rented a studio ourselves and set everything up as one big production

𝑛𝑎𝑛𝑎 ◡̈

130,695 Aufrufe • vor 1 Jahr

Trump: The Congressional Medal of Honor. I wanted to give it to myself, but I was informed I couldn't do it and I couldn't find anything where I was actually worthy so here we are,
0:38

Trump: The Congressional Medal of Honor. I wanted to give it to myself, but I was informed I couldn't do it and I couldn't find anything where I was actually worthy so here we are,

Acyn

86,453 Aufrufe • vor 2 Monaten

Kyle Daukaus on what went wrong in his initial UFC stint & the road back after being released in 2022: "I just took everything for granted, to be honest. I got to the UFC, and I was like, 'Man, I'm here. I made it.' But what I didn't realize was that it would be so short-term."
5:58

Kyle Daukaus on what went wrong in his initial UFC stint & the road back after being released in 2022: "I just took everything for granted, to be honest. I got to the UFC, and I was like, 'Man, I'm here. I made it.' But what I didn't realize was that it would be so short-term."

Ariel Helwani

23,022 Aufrufe • vor 9 Monaten

The display stand I ship our Copland Supply keycaps in was also designed to double as protection during shipping! Only thing is I didn't realize how CRAZY strong it would be and I needed to also install a keycap removal tool so you could actually get it out lol
0:52

The display stand I ship our Copland Supply keycaps in was also designed to double as protection during shipping! Only thing is I didn't realize how CRAZY strong it would be and I needed to also install a keycap removal tool so you could actually get it out lol

Quinn Nelson

13,598 Aufrufe • vor 9 Monaten

Looking through old files, I found this thing. It was an experimental game I tried to make. I thought it would be a fun game. It turned out to be frustrating to play, so I dumped it. #missinghalloween
0:48

Looking through old files, I found this thing. It was an experimental game I tried to make. I thought it would be a fun game. It turned out to be frustrating to play, so I dumped it. #missinghalloween

Mike Inel

247,246 Aufrufe • vor 2 Jahren

I built a chatbot to talk to my friends Blog post instead of reading it 🫣-> Okay so Alistair posted a post about the ChatGPT api, but I didn't want to read it all 🤣. So I built a chat bot in Promptable.js to talk with his article:
1:04

I built a chatbot to talk to my friends Blog post instead of reading it 🫣-> Okay so Alistair posted a post about the ChatGPT api, but I didn't want to read it all 🤣. So I built a chat bot in Promptable.js to talk with his article:

Colin

41,795 Aufrufe • vor 3 Jahren

🦊: I worked hard for 8 years &rested for 6 months, I know I shouldn't be doing anything but it was so hard. I lied down but knew I shouldn't, yet I didn't know what to do that I started comparing myself with my peers. But I didn't know what to do so I started doing part-time
0:22

🦊: I worked hard for 8 years &rested for 6 months, I know I shouldn't be doing anything but it was so hard. I lied down but knew I shouldn't, yet I didn't know what to do that I started comparing myself with my peers. But I didn't know what to do so I started doing part-time

kit 킷 🐺

45,141 Aufrufe • vor 7 Monaten

Here comes the final episode of M&M series experimentation. Received good feedback all throughout. But I noticed not much value add to large audience. And tbh I didn't have fun doing it, though I thought I would. So, maybe sometime in the future if I find some value to add.
0:48

Here comes the final episode of M&M series experimentation. Received good feedback all throughout. But I noticed not much value add to large audience. And tbh I didn't have fun doing it, though I thought I would. So, maybe sometime in the future if I find some value to add.

PRAFUL KULKARNI

28,551 Aufrufe • vor 1 Jahr

Was experimenting with ink style for the text. Didn't make to final product but i really liked it. #aftereffects
0:33

Was experimenting with ink style for the text. Didn't make to final product but i really liked it. #aftereffects

Seter | DOKOMI 2026

17,111 Aufrufe • vor 4 Monaten

I hope you spent a beautiful Holy Week. This text is so beautiful I wanted to share it with you. Christ is Risen! ✝️
1:14

I hope you spent a beautiful Holy Week. This text is so beautiful I wanted to share it with you. Christ is Risen! ✝️

Ada Lluch

28,964 Aufrufe • vor 5 Monaten

"why didn't u text me back? why did u screen my call? i was alone & so scared i couldn't tell everyone, u, why did u do it? i was worried about mom & dad, i pondered hard whether to tell u or not" bawled my eyes out😭 #LoveNextDoor #LoveNextDoorEp10
1:11

"why didn't u text me back? why did u screen my call? i was alone & so scared i couldn't tell everyone, u, why did u do it? i was worried about mom & dad, i pondered hard whether to tell u or not" bawled my eyes out😭 #LoveNextDoor #LoveNextDoorEp10

☘∆

423,146 Aufrufe • vor 2 Jahren