Leonard Tang's banner

Leonard Tang

@leonardtang_ • 4,740 subscribers

vp of ai research @beaconholdings prev ceo @haizelabs

Shorts

First came pre-training scaling; then came inference-time scaling. Now comes judge-time scaling. Despite progress in AI through scaled inference-time compute, AI remains unreliable in open-ended, non-verifiable domains. The key limitation is not generation—it is evaluation. Therefore, the next big leap for AI comes from better judging. In service of this future, today we release Verdict, a library for scaling judge-time compute.

First came pre-training scaling; then came inference-time scaling. Now comes judge-time scaling. Despite progress in AI through scaled inference-time compute, AI remains unreliable in open-ended, non-verifiable domains. The key limitation is not generation—it is evaluation. Therefore, the next big leap for AI comes from better judging. In service of this future, today we release Verdict, a library for scaling judge-time compute.

111,341 görüntüleme

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

I am thrilled to announce that Beacon Holdings has acquired Haize Labs, with me joining as VP of AI Research. We started Haize in 2024 to enable anyone to build reliable and safe AI. Through our red-teaming and safeguards work with the frontier labs; our observability, guardrail, and evaluation platform serving the world’s largest enterprises; and our pro bono SMB work, any customer could build AI they trusted with Haize. Joining Beacon lets us deliver the same trustworthy AI to those who need it most, and those most overlooked by Silicon Valley: the essential Main Street businesses the real world depends upon. Transitioning these essential businesses through the AI revolution is one of the most consequential responsible AI problems of our time. We couldn’t be more honored to tackle it with Beacon. Thank you to our customers, investors, and team for the journey of a lifetime. And thank you to Nilam, Goutham, Mark, and the Beacon team for the trust and opportunity. It’s time to get to work.

I am thrilled to announce that Beacon Holdings has acquired Haize Labs, with me joining as VP of AI Research. We started Haize in 2024 to enable anyone to build reliable and safe AI. Through our red-teaming and safeguards work with the frontier labs; our observability, guardrail, and evaluation platform serving the world’s largest enterprises; and our pro bono SMB work, any customer could build AI they trusted with Haize. Joining Beacon lets us deliver the same trustworthy AI to those who need it most, and those most overlooked by Silicon Valley: the essential Main Street businesses the real world depends upon. Transitioning these essential businesses through the AI revolution is one of the most consequential responsible AI problems of our time. We couldn’t be more honored to tackle it with Beacon. Thank you to our customers, investors, and team for the journey of a lifetime. And thank you to Nilam, Goutham, Mark, and the Beacon team for the trust and opportunity. It’s time to get to work.

230,829 görüntüleme • 1 ay önce

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you

36,496 görüntüleme • 1 yıl önce

Daha fazla içerik yok.