Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

introducing rd-signal-2: a frontier classification model that is 1600x cheaper than GPT 5.6 Sol. free to try in Raindrop, and available via a new API for training/hosting custom classifiers with Zero Data Retention.

162,078 Aufrufe • vor 1 Monat •via X (Twitter)

57 Kommentare

Profilbild von ben hylak
ben hylakvor 1 Monat

read more at: rd-signal-2 balances precision/recall at a price that is still 280x lower than GPT-5.6 Luna xhigh. it powers signals and real-time issue detection in raindrop, allowing our customers to detect and accurately track sparse behaviors.

Profilbild von ben hylak
ben hylakvor 1 Monat

most LLM observability providers require customers to sample a very small % of traffic (and pay for the judges!) but agent failures are often rare. it's common for a behavioral anomaly to be < 1% of traffic. sampling can completely hide the problem.

Profilbild von ben hylak
ben hylakvor 1 Monat

you can say "the agent saying it transferred to a human, but didn't call the tool" or "the user complaining that web search results were stale" @raindrop_ai signals will write the code, assemble the context, train a custom classification head for your task, and self-improve.

Profilbild von ben hylak
ben hylakvor 1 Monat

rd-signal-2 also powers @raindrop_ai's real-time issue detection. many emerging failures are detected in under 5 minutes. because they share the same foundation, any raindrop issue can be instantly converted to a signal, compared in experiments, and more.

Profilbild von ben hylak
ben hylakvor 1 Monat

rd-signal-2 already processes around 20 billion traces a month. members of the @raindrop_ai team: - invented fraud transformer models at robinhood - built the first recommender system at pinterest - have built agents that have millions of customers - and more dm me to join

Profilbild von ben hylak
ben hylakvor 1 Monat

stop paying for judges. starting using signals. try the agent observability platform trusted by vercel, speak, and the fortune 100. read more at

Profilbild von eric provencher
eric provenchervor 1 Monat

@raindrop_ai Damn your motion design is on point! Looks awesome

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai thank you!

Profilbild von gian
gianvor 1 Monat

@raindrop_ai sweeet, great job! adaptive online observability is basically table stakes at this point

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai we agree.

Profilbild von Soleio
Soleiovor 1 Monat

@raindrop_ai “Stop paying for judges. Start using signals.” :chefs_kiss:

Profilbild von Eduard Faus Gil
Eduard Faus Gilvor 1 Monat

@raindrop_ai Typical raindrop W so glad I told @orchid_hq to use you guys

Profilbild von Logan Ford
Logan Fordvor 1 Monat

@raindrop_ai very excited to try this out!

Profilbild von Dev
Devvor 1 Monat

@raindrop_ai hey @alialobai1 @hegargarcia 👀

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai @alialobai1 @hegargarcia would love your feedback :)

Profilbild von bani
banivor 1 Monat

@raindrop_ai huge

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai thanks bani! :)

Profilbild von Nizzy
Nizzyvor 1 Monat

@raindrop_ai woahhh

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai give it a try!

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 1 Monat

@raindrop_ai very cool

Profilbild von Christian
Christianvor 1 Monat

@raindrop_ai Very interesting 🤔🤔🤔

Profilbild von Eric
Ericvor 1 Monat

@raindrop_ai well shit that sure is a lot cheaper

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai indeed

Profilbild von Jackson Grove
Jackson Grovevor 1 Monat

@raindrop_ai this is huge

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai thank you - please give us any/all feedback :)

Profilbild von Jackson Grove
Jackson Grovevor 1 Monat

@raindrop_ai will do excited for this :)

Profilbild von Rohanth Marem
Rohanth Maremvor 1 Monat

@raindrop_ai interested how this is implemented, really cool

Profilbild von Jeff Barg
Jeff Bargvor 1 Monat

@raindrop_ai Very cool!

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai thanks jeff!

Profilbild von any
anyvor 1 Monat

@raindrop_ai thats crazy but nobody uses frontier models for classifiers anyway?

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai yes, so then you get very bad precision/recall. you can also see a comparison to 5.6 Luna (which is a good classifier)

Profilbild von Alim
Alimvor 1 Monat

@raindrop_ai dang this is good

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai thanks friend!

Profilbild von ray arayilakath ‎.߆
ray arayilakath ‎.߆vor 1 Monat

@rsdgpt @raindrop_ai smart play!

Profilbild von Nick
Nickvor 1 Monat

@raindrop_ai very impressive!

Profilbild von Jeremy
Jeremyvor 1 Monat

@raindrop_ai Wait. This. FUCKING BANGS......

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai thank you! which part resonated the most ooc

Profilbild von Aggroed Lighthacker- Peace, Prosperity, & Freedom
Aggroed Lighthacker- Peace, Prosperity, & Freedomvor 1 Monat

@raindrop_ai @Teknium @NousResearch @yeahfortommy this seems promising

Profilbild von Adhyaay Karnwal
Adhyaay Karnwalvor 1 Monat

@raindrop_ai sick dude

Profilbild von daksh
dakshvor 1 Monat

@raindrop_ai whoa this wasn’t on my bingo card but so excited and happy for ben :)

Profilbild von jacob
jacobvor 1 Monat

@raindrop_ai oo this is cool

Profilbild von ras
rasvor 1 Monat

@raindrop_ai oh my god i have a very good use case for this if feasible

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai dm me!

Profilbild von René Sultan
René Sultanvor 1 Monat

@raindrop_ai oss?

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai not this time! we do have plenty of other open source work though.

Profilbild von Prabal
Prabalvor 1 Monat

@raindrop_ai ngl my main question is how did you create the video. great job - looks amazing.

Profilbild von Ty
Tyvor 1 Monat

@sjwhitmore @raindrop_ai Fire

Profilbild von Jason Cameron
Jason Cameronvor 1 Monat

@raindrop_ai Super cool! Thanks for releasing it publicly

Profilbild von Manveen Koticha
Manveen Kotichavor 1 Monat

@raindrop_ai Cool stuff! @raindrop_ai team!!

Profilbild von toolshed
toolshedvor 1 Monat

@raindrop_ai 1600x cheaper only matters if the error rate holds. A classifier two points worse costs more in human review time than it ever saves in tokens, at any price per call. What does the confusion matrix look like against Sol on the same eval set?

Profilbild von Reid Christian
Reid Christianvor 1 Monat

@raindrop_ai Whoa

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai agreed!

Profilbild von pidš
pidšvor 1 Monat

@raindrop_ai I see that your Triage boy is free to try, saw someone made a token with royalities to your github. So you can claim the trading fees from it, if you want. GL chad

Profilbild von Clipur.com
Clipur.comvor 1 Monat

@raindrop_ai cheap inference meta

Profilbild von Dan McAteer
Dan McAteervor 1 Monat

@raindrop_ai 1600x cheaper? Didn't even know a price could go that low.

Profilbild von ben hylak
ben hylakvor 1 Monat

@raindrop_ai constraining the problem to binary classification helps re: cost a lot.

Profilbild von Dan McAteer
Dan McAteervor 1 Monat

@raindrop_ai Makes sense to me.

Ähnliche Videos