Loading video...

Video Failed to Load

Go Home

introducing rd-signal-2: a frontier classification model that is 1600x cheaper than GPT 5.6 Sol. free to try in Raindrop, and available via a new API for training/hosting custom classifiers with Zero Data Retention.

162,078 views • 1 month ago •via X (Twitter)

57 Comments

ben hylak's profile picture
ben hylak1 month ago

read more at: rd-signal-2 balances precision/recall at a price that is still 280x lower than GPT-5.6 Luna xhigh. it powers signals and real-time issue detection in raindrop, allowing our customers to detect and accurately track sparse behaviors.

ben hylak's profile picture
ben hylak1 month ago

most LLM observability providers require customers to sample a very small % of traffic (and pay for the judges!) but agent failures are often rare. it's common for a behavioral anomaly to be < 1% of traffic. sampling can completely hide the problem.

ben hylak's profile picture
ben hylak1 month ago

you can say "the agent saying it transferred to a human, but didn't call the tool" or "the user complaining that web search results were stale" @raindrop_ai signals will write the code, assemble the context, train a custom classification head for your task, and self-improve.

ben hylak's profile picture
ben hylak1 month ago

rd-signal-2 also powers @raindrop_ai's real-time issue detection. many emerging failures are detected in under 5 minutes. because they share the same foundation, any raindrop issue can be instantly converted to a signal, compared in experiments, and more.

ben hylak's profile picture
ben hylak1 month ago

rd-signal-2 already processes around 20 billion traces a month. members of the @raindrop_ai team: - invented fraud transformer models at robinhood - built the first recommender system at pinterest - have built agents that have millions of customers - and more dm me to join

ben hylak's profile picture
ben hylak1 month ago

stop paying for judges. starting using signals. try the agent observability platform trusted by vercel, speak, and the fortune 100. read more at

eric provencher's profile picture
eric provencher1 month ago

@raindrop_ai Damn your motion design is on point! Looks awesome

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai thank you!

gian's profile picture
gian1 month ago

@raindrop_ai sweeet, great job! adaptive online observability is basically table stakes at this point

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai we agree.

Soleio's profile picture
Soleio1 month ago

@raindrop_ai “Stop paying for judges. Start using signals.” :chefs_kiss:

Eduard Faus Gil's profile picture
Eduard Faus Gil1 month ago

@raindrop_ai Typical raindrop W so glad I told @orchid_hq to use you guys

Logan Ford's profile picture
Logan Ford1 month ago

@raindrop_ai very excited to try this out!

Dev's profile picture
Dev1 month ago

@raindrop_ai hey @alialobai1 @hegargarcia 👀

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai @alialobai1 @hegargarcia would love your feedback :)

bani's profile picture
bani1 month ago

@raindrop_ai huge

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai thanks bani! :)

Nizzy's profile picture
Nizzy1 month ago

@raindrop_ai woahhh

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai give it a try!

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸1 month ago

@raindrop_ai very cool

Christian's profile picture
Christian1 month ago

@raindrop_ai Very interesting 🤔🤔🤔

Eric's profile picture
Eric1 month ago

@raindrop_ai well shit that sure is a lot cheaper

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai indeed

Jackson Grove's profile picture
Jackson Grove1 month ago

@raindrop_ai this is huge

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai thank you - please give us any/all feedback :)

Jackson Grove's profile picture
Jackson Grove1 month ago

@raindrop_ai will do excited for this :)

Rohanth Marem's profile picture
Rohanth Marem1 month ago

@raindrop_ai interested how this is implemented, really cool

Jeff Barg's profile picture
Jeff Barg1 month ago

@raindrop_ai Very cool!

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai thanks jeff!

any's profile picture
any1 month ago

@raindrop_ai thats crazy but nobody uses frontier models for classifiers anyway?

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai yes, so then you get very bad precision/recall. you can also see a comparison to 5.6 Luna (which is a good classifier)

Alim's profile picture
Alim1 month ago

@raindrop_ai dang this is good

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai thanks friend!

ray arayilakath ‎.߆'s profile picture
ray arayilakath ‎.߆1 month ago

@rsdgpt @raindrop_ai smart play!

Nick's profile picture
Nick1 month ago

@raindrop_ai very impressive!

Jeremy's profile picture
Jeremy1 month ago

@raindrop_ai Wait. This. FUCKING BANGS......

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai thank you! which part resonated the most ooc

Aggroed Lighthacker- Peace, Prosperity, & Freedom's profile picture
Aggroed Lighthacker- Peace, Prosperity, & Freedom1 month ago

@raindrop_ai @Teknium @NousResearch @yeahfortommy this seems promising

Adhyaay Karnwal's profile picture
Adhyaay Karnwal1 month ago

@raindrop_ai sick dude

daksh's profile picture
daksh1 month ago

@raindrop_ai whoa this wasn’t on my bingo card but so excited and happy for ben :)

jacob's profile picture
jacob1 month ago

@raindrop_ai oo this is cool

ras's profile picture
ras1 month ago

@raindrop_ai oh my god i have a very good use case for this if feasible

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai dm me!

René Sultan's profile picture
René Sultan1 month ago

@raindrop_ai oss?

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai not this time! we do have plenty of other open source work though.

Prabal's profile picture
Prabal1 month ago

@raindrop_ai ngl my main question is how did you create the video. great job - looks amazing.

Ty's profile picture
Ty1 month ago

@sjwhitmore @raindrop_ai Fire

Jason Cameron's profile picture
Jason Cameron1 month ago

@raindrop_ai Super cool! Thanks for releasing it publicly

Manveen Koticha's profile picture
Manveen Koticha1 month ago

@raindrop_ai Cool stuff! @raindrop_ai team!!

toolshed's profile picture
toolshed1 month ago

@raindrop_ai 1600x cheaper only matters if the error rate holds. A classifier two points worse costs more in human review time than it ever saves in tokens, at any price per call. What does the confusion matrix look like against Sol on the same eval set?

Reid Christian's profile picture
Reid Christian1 month ago

@raindrop_ai Whoa

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai agreed!

pidš's profile picture
pidš1 month ago

@raindrop_ai I see that your Triage boy is free to try, saw someone made a token with royalities to your github. So you can claim the trading fees from it, if you want. GL chad

Clipur.com's profile picture
Clipur.com1 month ago

@raindrop_ai cheap inference meta

Dan McAteer's profile picture
Dan McAteer1 month ago

@raindrop_ai 1600x cheaper? Didn't even know a price could go that low.

ben hylak's profile picture
ben hylak1 month ago

@raindrop_ai constraining the problem to binary classification helps re: cost a lot.

Dan McAteer's profile picture
Dan McAteer1 month ago

@raindrop_ai Makes sense to me.

Related Videos