Video yükleniyor...
Video Yüklenemedi
We released invent a dataset. Today we release the technical report that goes with it. Huge shoutout to everyone Shivalika Singh Andrija Djurisic Leke Onilude Sudip Roy 🔥 This tackles the hardest setting. How do you go from zero data regime to a training set for a capability.
41,860 görüntüleme • 1 ay önce •via X (Twitter)
18 Yorum

Full technical report @askalphaxiv: 🔥🔥 You can just start inventing here:

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y Hi Sara, you might want to check out our TMLR work on seedless synthetic data generation: Also featured here:

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y Happy to take a look, and will make sure we reference if we don’t already do so. Seems extremely relevant.

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y 🙏 — also; congrats on the launch!

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y 🔥🔥

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y very cool

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y I used it twice already: a São Paulo-specific conversation dataset becoming a Gemma finetuning, and one specific to Brazilian innovation laws which still needs to be used in finetuning. Recommended!

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y 🔥

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y Congrats 🎉

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y Thank you Sophia! Congrats to you too on your new chapter. 🔥

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y 🫶🫶🥰

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y speechless at how fast this generates 😭😭😭

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y cool, congrats on the launch!

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y cool direction. curious how you check coverage when there are no real examples to compare against

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y synthetic data quality is the hard part. how did you validate the invented examples before using them for training?

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y Data being the biggest bottleneck feels underrated, curious to dig into this.

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y @grok is this thing opensource?

@singhshiviii @andrijazzz @lekeonilude @sudip_r0y it's basically a llm agent with a harness accessed via a paid api endpoint
