Загрузка видео...

Не удалось загрузить видео

На главную

introducing rd-signal-2: a frontier classification model that is 1600x cheaper than GPT 5.6 Sol. free to try in Raindrop, and available via a new API for training/hosting custom classifiers with Zero Data Retention.

162,078 просмотров • 1 месяц назад •via X (Twitter)

Комментарии: 57

Фото профиля ben hylak
ben hylak1 месяц назад

read more at: rd-signal-2 balances precision/recall at a price that is still 280x lower than GPT-5.6 Luna xhigh. it powers signals and real-time issue detection in raindrop, allowing our customers to detect and accurately track sparse behaviors.

Фото профиля ben hylak
ben hylak1 месяц назад

most LLM observability providers require customers to sample a very small % of traffic (and pay for the judges!) but agent failures are often rare. it's common for a behavioral anomaly to be < 1% of traffic. sampling can completely hide the problem.

Фото профиля ben hylak
ben hylak1 месяц назад

you can say "the agent saying it transferred to a human, but didn't call the tool" or "the user complaining that web search results were stale" @raindrop_ai signals will write the code, assemble the context, train a custom classification head for your task, and self-improve.

Фото профиля ben hylak
ben hylak1 месяц назад

rd-signal-2 also powers @raindrop_ai's real-time issue detection. many emerging failures are detected in under 5 minutes. because they share the same foundation, any raindrop issue can be instantly converted to a signal, compared in experiments, and more.

Фото профиля ben hylak
ben hylak1 месяц назад

rd-signal-2 already processes around 20 billion traces a month. members of the @raindrop_ai team: - invented fraud transformer models at robinhood - built the first recommender system at pinterest - have built agents that have millions of customers - and more dm me to join

Фото профиля ben hylak
ben hylak1 месяц назад

stop paying for judges. starting using signals. try the agent observability platform trusted by vercel, speak, and the fortune 100. read more at

Фото профиля eric provencher
eric provencher1 месяц назад

@raindrop_ai Damn your motion design is on point! Looks awesome

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai thank you!

Фото профиля gian
gian1 месяц назад

@raindrop_ai sweeet, great job! adaptive online observability is basically table stakes at this point

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai we agree.

Фото профиля Soleio
Soleio1 месяц назад

@raindrop_ai “Stop paying for judges. Start using signals.” :chefs_kiss:

Фото профиля Eduard Faus Gil
Eduard Faus Gil1 месяц назад

@raindrop_ai Typical raindrop W so glad I told @orchid_hq to use you guys

Фото профиля Logan Ford
Logan Ford1 месяц назад

@raindrop_ai very excited to try this out!

Фото профиля Dev
Dev1 месяц назад

@raindrop_ai hey @alialobai1 @hegargarcia 👀

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai @alialobai1 @hegargarcia would love your feedback :)

Фото профиля bani
bani1 месяц назад

@raindrop_ai huge

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai thanks bani! :)

Фото профиля Nizzy
Nizzy1 месяц назад

@raindrop_ai woahhh

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai give it a try!

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸1 месяц назад

@raindrop_ai very cool

Фото профиля Christian
Christian1 месяц назад

@raindrop_ai Very interesting 🤔🤔🤔

Фото профиля Eric
Eric1 месяц назад

@raindrop_ai well shit that sure is a lot cheaper

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai indeed

Фото профиля Jackson Grove
Jackson Grove1 месяц назад

@raindrop_ai this is huge

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai thank you - please give us any/all feedback :)

Фото профиля Jackson Grove
Jackson Grove1 месяц назад

@raindrop_ai will do excited for this :)

Фото профиля Rohanth Marem
Rohanth Marem1 месяц назад

@raindrop_ai interested how this is implemented, really cool

Фото профиля Jeff Barg
Jeff Barg1 месяц назад

@raindrop_ai Very cool!

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai thanks jeff!

Фото профиля any
any1 месяц назад

@raindrop_ai thats crazy but nobody uses frontier models for classifiers anyway?

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai yes, so then you get very bad precision/recall. you can also see a comparison to 5.6 Luna (which is a good classifier)

Фото профиля Alim
Alim1 месяц назад

@raindrop_ai dang this is good

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai thanks friend!

Фото профиля ray arayilakath ‎.߆
ray arayilakath ‎.߆1 месяц назад

@rsdgpt @raindrop_ai smart play!

Фото профиля Nick
Nick1 месяц назад

@raindrop_ai very impressive!

Фото профиля Jeremy
Jeremy1 месяц назад

@raindrop_ai Wait. This. FUCKING BANGS......

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai thank you! which part resonated the most ooc

Фото профиля Aggroed Lighthacker- Peace, Prosperity, & Freedom
Aggroed Lighthacker- Peace, Prosperity, & Freedom1 месяц назад

@raindrop_ai @Teknium @NousResearch @yeahfortommy this seems promising

Фото профиля Adhyaay Karnwal
Adhyaay Karnwal1 месяц назад

@raindrop_ai sick dude

Фото профиля daksh
daksh1 месяц назад

@raindrop_ai whoa this wasn’t on my bingo card but so excited and happy for ben :)

Фото профиля jacob
jacob1 месяц назад

@raindrop_ai oo this is cool

Фото профиля ras
ras1 месяц назад

@raindrop_ai oh my god i have a very good use case for this if feasible

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai dm me!

Фото профиля René Sultan
René Sultan1 месяц назад

@raindrop_ai oss?

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai not this time! we do have plenty of other open source work though.

Фото профиля Prabal
Prabal1 месяц назад

@raindrop_ai ngl my main question is how did you create the video. great job - looks amazing.

Фото профиля Ty
Ty1 месяц назад

@sjwhitmore @raindrop_ai Fire

Фото профиля Jason Cameron
Jason Cameron1 месяц назад

@raindrop_ai Super cool! Thanks for releasing it publicly

Фото профиля Manveen Koticha
Manveen Koticha1 месяц назад

@raindrop_ai Cool stuff! @raindrop_ai team!!

Фото профиля toolshed
toolshed1 месяц назад

@raindrop_ai 1600x cheaper only matters if the error rate holds. A classifier two points worse costs more in human review time than it ever saves in tokens, at any price per call. What does the confusion matrix look like against Sol on the same eval set?

Фото профиля Reid Christian
Reid Christian1 месяц назад

@raindrop_ai Whoa

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai agreed!

Фото профиля pidš
pidš1 месяц назад

@raindrop_ai I see that your Triage boy is free to try, saw someone made a token with royalities to your github. So you can claim the trading fees from it, if you want. GL chad

Фото профиля Clipur.com
Clipur.com1 месяц назад

@raindrop_ai cheap inference meta

Фото профиля Dan McAteer
Dan McAteer1 месяц назад

@raindrop_ai 1600x cheaper? Didn't even know a price could go that low.

Фото профиля ben hylak
ben hylak1 месяц назад

@raindrop_ai constraining the problem to binary classification helps re: cost a lot.

Фото профиля Dan McAteer
Dan McAteer1 месяц назад

@raindrop_ai Makes sense to me.

Похожие видео