正在加载视频...

视频加载失败

Vibe coding is cool. But have you tried vibe-tuning? Here’s Claude Code using the Lightning Rod Labs SDK to turn messy Fed PDFs into a small, specialized economic forecaster. The agent: - parses raw historical PDFs - builds a training set - fine-tunes a smaller model - evaluates it...

423,562 次观看 • 6 个月前 •via X (Twitter)

7 条评论

Ben Turtel 的头像
Ben Turtel6 个月前

Try it: Read the Fed Beige Book case study:

America 的头像
America5 个月前

@lightningrodai Gay

philherman 的头像
philherman5 个月前

@lightningrodai whoo more AI bullshit

L.vue 的头像
L.vue6 个月前

@lightningrodai wait, "beats gpt-5" on what benchmark though? always suspicious of these claims without seeing the eval. that said, the workflow is clean - pdf to training data to fine-tuned model in one loop.

Ben Turtel 的头像
Ben Turtel6 个月前

@lightningrodai Beats GPT-5 on the economic forecasting task. The agent held out a forward-looking test set to measure accuracy from all models tested. You can see a deeper breakdown of this particular example here:

Liquidity Sniper 的头像
Liquidity Sniper5 个月前

@lightningrodai Love this, good on ya! Turning messy Fed PDFs into a tidy econ forecaster is brilliant. Cheering from Sydney. How small is the final model and how well does it perform?

Ben Turtel 的头像
Ben Turtel5 个月前

@lightningrodai The final model has a Brier Skill Score of 6.2%, compared to -27% for the base and -21% for GPT-5 (both worse than guessing base rates). Beats GPT-5 by 22% on raw and 84% on calibration.

相关视频