templar's banner
templar's profile picture

templar

@tplr_ai • 13,108 subscribers

incentivised internet-wide training - an order of @covenant_ai

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

On the The All-In Podcast this week, Chamath Palihapitiya asked NVIDIA CEO Jensen Huang about decentralized AI training, calling our Covenant-72B run "a pretty crazy technical accomplishment." One correction: it's 72 billion parameters, not four. Trained permissionlessly across 70+ contributors on commodity internet. The largest model ever pre-trained on fully decentralized infrastructure. Jensen's answer is worth hearing too.
1:21
tplr_ai's profile picture

On the The All-In Podcast this week, Chamath Palihapitiya asked NVIDIA CEO Jensen Huang about decentralized AI training, calling our Covenant-72B run "a pretty crazy technical accomplishment." One correction: it's 72 billion parameters, not four. Trained permissionlessly across 70+ contributors on commodity internet. The largest model ever pre-trained on fully decentralized infrastructure. Jensen's answer is worth hearing too.

templar

473,946 görüntüleme • 4 ay önce

"Challenges the political economy of AI." That's how Jack Clark ( Jack Clark), co-founded Anthropic, ran policy at OpenAI, described what Templar is doing. He's now featured it in Import AI twice. 1/n
0:33
tplr_ai's profile picture

"Challenges the political economy of AI." That's how Jack Clark ( Jack Clark), co-founded Anthropic, ran policy at OpenAI, described what Templar is doing. He's now featured it in Import AI twice. 1/n

templar

70,110 görüntüleme • 4 ay önce

New research from the team officially drops tomorrow: scaling decentralized training from 72B to frontier models. SparseLoCo solved gradient sync. Heterogenous SparseLoCo solves activation transmission between pipeline stages. What's it mean? The internet can be your datacenter. Inter-datacenter training that connects datacenters with consumer GPUs, university clusters, and distributed infrastructure worldwide. Join us for a TGIF deep dive with Distributed State and the research team.
0:27
tplr_ai's profile picture

New research from the team officially drops tomorrow: scaling decentralized training from 72B to frontier models. SparseLoCo solved gradient sync. Heterogenous SparseLoCo solves activation transmission between pipeline stages. What's it mean? The internet can be your datacenter. Inter-datacenter training that connects datacenters with consumer GPUs, university clusters, and distributed infrastructure worldwide. Join us for a TGIF deep dive with Distributed State and the research team.

templar

10,047 görüntüleme • 7 ay önce

Daha fazla içerik yok.