
Ramp Labs
@RampLabs • 14,969 subscribers
Shorts
Videos

Introducing Ramp Accounting Bench. We partnered with accounting professionals to create 137 tasks and grading rubrics grounded in everyday accounting workflows. Even with three attempts, the best model achieved only 21% accuracy. Reliable agentic accounting remains an open challenge.
Ramp Labs88,328 次观看 • 1 个月前

We’re open-sourcing PorTAL, our framework for shared task representations and cross model LoRA adaptation. It now spans from hybrid attention models to multimodal systems including Gemma 4 E2B, Mistral 7B & Thinking Machines' Inkling. Code: ramp-public/portallib Models: Hugging Face /RampPublic
Ramp Labs171,845 次观看 • 3 个月前

Introducing PorTAL: Portable Task Adapters for LLMs. A novel recipe to cheaply port fine-tuning between models. It matches per task LoRA accuracy at half the cost, lowering the switching overhead of adapting tasks across LLMs. At Ramp, every new model release used to mean retraining our fine-tunes from scratch. PorTAL learns the task once, then efficiently refits it onto any new base model, even across model families.
Ramp Labs173,290 次观看 • 3 个月前

We had early access to NVIDIA AI Nemotron 3.5 Super VL and post-trained it for one of our highest-volume workflows: receipt extraction. One epoch of supervised fine-tuning on 10,000 examples made it competitive with leading open and closed-source models on our receipt benchmark.
Ramp Labs16,168 次观看 • 12 天前

AI spend is measured in tokens, model calls, and dollars. However, none of these fields describe the actual work being done. At Ramp, we built a semantic layer that attributes agent spend to objectives and outcomes. This allowed us to go from monitoring AI spend to understanding AI ROI. Here's how we built it 🧵
Ramp Labs44,997 次观看 • 1 个月前

Recent KV cache compression research has focused on small models with dense attention. We scaled these techniques to GLM 5.3, a frontier sparse attention model. We adapted KVzip and Attention Matching, reducing KV cache size by 80% while retaining over 90% of full-context accuracy on the QuALITY benchmark.
Ramp Labs22,064 次观看 • 29 天前

A finance team just sent us this. They ran a full budget vs. actuals analysis in under 5 minutes. Uploaded their budget P&L and 10 months of GL actuals. Ramp Sheets matched every line item, calculated variances, and flagged problem areas. This used to take half a day.
Ramp Labs141,898 次观看 • 9 个月前