We’re open-sourcing PorTAL, our framework for shared task representations and cross model LoRA adaptation. It now spans from hybrid attention models to multimodal systems including Gemma 4 E2B, Mistral 7B & Thinking Machines' Inkling. Code: ramp-public/portallib Models: Hugging Face /RampPublic

Code: Models + data: PyPI:

@thinkymachines OPEN IT UP

@thinkymachines OSS is short for ossome

@thinkymachines @miramurati you seeing what I'm seeing?

@thinkymachines You're telling me a portal trained this Lora?

@thinkymachines Ramp Labs ♥️ OSS

@thinkymachines Is this still the credit card company? 😟

@thinkymachines Cross model adaptation, open sourced for everyone.

@thinkymachines lfg

@thinkymachines based based based

@thinkymachines Shared representations could simplify model adaptation

@thinkymachines Ahh yes the AI lab for finance

@thinkymachines running this tonight instead of sleeping

@thinkymachines Open source everything.

@thinkymachines @b_geist did you a try a LoRA for you posts?

@thinkymachines Cross-model LoRA adaptation is a huge unlock. Really curious to see how the shared task representations handle the gap between hybrid attention and multimodal systems like Gemma.

@thinkymachines huge

@thinkymachines This is huge for the open-source ecosystem 🔥

@thinkymachines cross-model lora usually breaks on tokenizer drift before attention differences show up

@thinkymachines 跨模型 LoRA 这块终于有人系统搞了

@thinkymachines Did they pivot to AI company?

@thinkymachines PorTAL is interesting because Ramp has production pain behind it. infra launches land better when the use case is not imaginary

@thinkymachines If PorTAL unifies adapters across model families, my fine-tuning costs collapse. Big if true. Any vision-language benchmarks yet?

@thinkymachines Freezing the task representation and core decoder and recalibrating only the aligner is a clean split. What I'd want to know is how far the aligner stretches before it breaks - Mistral 7B to a multimodal base like Gemma 4 E2B is a big jump in representation geometry.