Samuel Zeng's banner

Samuel Zeng

@SamuelZengML • 3,463 subscribers

Founder, https://t.co/rfLQ050cr0 | On-device foundation models. High intelligence, low memory, low power | MIT TR35 https://t.co/WQ9mrGQA21

Shorts

How does Edge0 run a 35B model with only 1–2.5 GB of peak memory? In simple terms: • The full model stays in storage. • Only the parameters needed for the current step are loaded into memory. • The next parameters are prepared while the current step is running. • Memory is reused instead of loading the entire model at once. Large model. Small working set. Fully on-device.

How does Edge0 run a 35B model with only 1–2.5 GB of peak memory? In simple terms: • The full model stays in storage. • Only the parameters needed for the current step are loaded into memory. • The next parameters are prepared while the current step is running. • Memory is reused instead of loading the entire model at once. Large model. Small working set. Fully on-device.

13,556 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

A 35B language model running on an iPhone using only 1–2.5 GB of peak memory. No cloud. No remote server. No desktop GPU. Today, we’re open-sourcing Edge0 — a framework for running large AI models fully on-device.

A 35B language model running on an iPhone using only 1–2.5 GB of peak memory. No cloud. No remote server. No desktop GPU. Today, we’re open-sourcing Edge0 — a framework for running large AI models fully on-device.

586,666 Aufrufe • vor 1 Tag

Over the past two months, we’ve open-sourced multiple generations of on-device Audio models to the community through Audio8. The current portfolio includes: • ASR: 0.1B, 0.3B, 0.6B, and 3B • TTS: 0.1B, 0.3B, and 0.6B These releases are designed for practical local inference, with deployment targets spanning phones, PCs, and other resource-constrained devices.

Over the past two months, we’ve open-sourced multiple generations of on-device Audio models to the community through Audio8. The current portfolio includes: • ASR: 0.1B, 0.3B, 0.6B, and 3B • TTS: 0.1B, 0.3B, and 0.6B These releases are designed for practical local inference, with deployment targets spanning phones, PCs, and other resource-constrained devices.

88,338 Aufrufe • vor 3 Tagen

What can you build with Edge0? Playable games, entirely on-device. Start with a natural-language idea. Edge0 can generate the game logic, write the code, and refine the result locally. Around 2 GB of peak memory. No cloud calls.

What can you build with Edge0? Playable games, entirely on-device. Start with a natural-language idea. Edge0 can generate the game logic, write the code, and refine the result locally. Around 2 GB of peak memory. No cloud calls.

24,757 Aufrufe • vor 1 Tag

3D scenes, built locally. Describe what you want in plain language. Edge0 can generate a structured 3D scene, then modify and refine it on your phone or PC. No project data leaves the device.

3D scenes, built locally. Describe what you want in plain language. Edge0 can generate a structured 3D scene, then modify and refine it on your phone or PC. No project data leaves the device.

21,642 Aufrufe • vor 1 Tag

Interactive web experiences, generated on-device. Edge0 can turn natural-language requirements into frontend structure, logic, and interactions, then iterate on the result locally. From the first prototype to the final refinement, the workflow stays on-device.

Interactive web experiences, generated on-device. Edge0 can turn natural-language requirements into frontend structure, logic, and interactions, then iterate on the result locally. From the first prototype to the final refinement, the workflow stays on-device.

20,673 Aufrufe • vor 1 Tag

Keine weiteren Inhalte verfügbar