🔍 Introducing BackSearch. LLMs are increasingly asked to predict the future, but a good backtest requires a snapshot of the internet at a point in time. BackSearch allows LLMs to search the web as it was on a particular date. It’s great for: 🔮 Forecasting and prediction markets. 📈... Quantitative finance. 🌍 RL environments that simulate the world. 🥶 Freezing websearch for benchmark reproducibility We’re releasing a narrow slice of our index to begin with, focused on the news domain for 2026. Based on feedback we’ll open up more of our index in subsequent releases. 👇 Try BackSearch out with the link below.show more

oh hell yeah this is gonna print

Details on how to try BackSearch out here:

Wayback machine for AI, fuck thats smart. I wonder what kind of training data we might get out of this

but upgraded?

You will still inject lookahead bias from the model if it's not completely retrain from scratch. Good for basic RL env but bad for rigorous backtesting. Check ChronosLLM:

We were just talking about this yesterday lol 🔥🔥

This is exactly what we need when we were building our frontier financial judgement benchmark - will try to integrate for v2 :)

best data product released in a minute damn

This is what we target in our paper "Hindcast: Replaying Prediction Markets to Evaluate LLM Forecasters", although we look at frozen slices of Reddit as a proxy for general markets against replayed Polymarket events.

The timing is perfect; I really needed this.

I was just looking for something like this

watch out ppl are gonna do so much prime-rl on this

this is super cool!! 🙌🏻

This is a great idea, but models are pretrained on info up to some cutoff date. Wouldn’t there still be data leakage from future events even without tool use?

Woah!

This is so cool

this looks super useful

excellent, I can totally see the hill climbing with reproducible reward on search environments going brrr @willcb

this is super cool !!!!

Searching the web from any past date changes how models get tested

Wow, this is actually so useful! Congratulations

Incredible

Will be a cool way to track various predictions made over time

Awesome, I can think of other uses for this

this is genius. always wondered why there wasn’t a benchmark for predictions. does this only work for events that happened after a model’s training date?

unreal, we’re working on a benchmark this would be useful for. Excited to give it a try

Wow, so cool!

Google should be doing this

super cool! and very useful

This is new. I like the general idea. Great one!

Need this

is this way back machine but for AI agent?

great idea

@teortaxesTex This is very useful utility

Beautiful - thank you for this