Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Long video generation usually results in context increasing/scaling during chunk/frame-wise rollout. Considering context scaling may require context selection, we thus introduce the idea of MoE into long context modelling and propose Mixture of Contexts. All previous context/memory is considered while the chosen ones are computed in a data-driven manner....

CeyuanY's profile picture

Ceyuan Yang

2,180 subscribers

22,141 Aufrufe • vor 10 Monaten •via X (Twitter)

Gesundheit & WellnessWissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Jeff Dean says models hallucinate because their training data is “squishy.” But what’s in the context window is sharp, the exact text or video frame right in front of them. The goal is to bring more of the world into that context. Compression gives it intuition. Context gives it precision.
2:00

Jeff Dean says models hallucinate because their training data is “squishy.” But what’s in the context window is sharp, the exact text or video frame right in front of them. The goal is to bring more of the world into that context. Compression gives it intuition. Context gives it precision.

vitrupo

41,352 Aufrufe • vor 2 Monaten

Long Context Tuning for Video Generation
1:07

Long Context Tuning for Video Generation

AK

38,271 Aufrufe • vor 1 Jahr

How do we generate videos on the scale of minutes, without drifting or forgetting about the historical context? We introduce Mixture of Contexts. Every minute-long video below is the direct output of our model in a single pass, with no post-processing, stitching, or editing. 1/4
1:31

How do we generate videos on the scale of minutes, without drifting or forgetting about the historical context? We introduce Mixture of Contexts. Every minute-long video below is the direct output of our model in a single pass, with no post-processing, stitching, or editing. 1/4

Gordon Wetzstein

158,208 Aufrufe • vor 9 Monaten

So much of dev work happens in the context of a larger team, and now you can bring all of that work context into the GitHub Copilot CLI with Work IQ.
2:02

So much of dev work happens in the context of a larger team, and now you can bring all of that work context into the GitHub Copilot CLI with Work IQ.

Satya Nadella

75,945 Aufrufe • vor 5 Monaten

A deep conversation with Nikolay Savinov, the Gemini long context pre-training co-lead… We go from the basics to what is needed to scale to infinite context to long context best practices for devs:
59:32

A deep conversation with Nikolay Savinov, the Gemini long context pre-training co-lead… We go from the basics to what is needed to scale to infinite context to long context best practices for devs:

Logan Kilpatrick

252,322 Aufrufe • vor 1 Jahr

Geometric Context Transformer for Streaming 3D Reconstruction Contributions: • We introduce LingBot-Map, a streaming 3D foundation model built around Geometric Context Attention (GCA), which maintains three complementary context types – anchor, pose-reference window, and trajectory memory – for efficient and consistent long-sequence streaming inference. • We propose an efficient training recipe based on progressive training and context parallelism with a relative loss formulation for stable long-sequence optimization. • We demonstrate that LingBot-Map achieves state-of-the-art performance on multiple benchmarks (Oxford Spires, Tanks and Temples, ETH3D, and 7-Scenes), significantly outperforming existing streaming approaches in reconstruction quality and inference speed.
1:10

Geometric Context Transformer for Streaming 3D Reconstruction Contributions: • We introduce LingBot-Map, a streaming 3D foundation model built around Geometric Context Attention (GCA), which maintains three complementary context types – anchor, pose-reference window, and trajectory memory – for efficient and consistent long-sequence streaming inference. • We propose an efficient training recipe based on progressive training and context parallelism with a relative loss formulation for stable long-sequence optimization. • We demonstrate that LingBot-Map achieves state-of-the-art performance on multiple benchmarks (Oxford Spires, Tanks and Temples, ETH3D, and 7-Scenes), significantly outperforming existing streaming approaches in reconstruction quality and inference speed.

MrNeRF

24,623 Aufrufe • vor 2 Monaten

We propose Long Context Tuning (LCT) for scene-level video generation to bridge the gap between current single-shot generation and real-world narrative video productions. Homepage: Report:
4:29

We propose Long Context Tuning (LCT) for scene-level video generation to bridge the gap between current single-shot generation and real-world narrative video productions. Homepage: Report:

Ceyuan Yang

46,813 Aufrufe • vor 1 Jahr

FramePack is out Packing Input Frame Context in Next-Frame Prediction Models for Video Generation
0:56

FramePack is out Packing Input Frame Context in Next-Frame Prediction Models for Video Generation

AK

31,486 Aufrufe • vor 1 Jahr

Out Of Context Football context : Galatasaray is the champion of Turkish Süper Lig in this season.
0:43

Out Of Context Football context : Galatasaray is the champion of Turkish Süper Lig in this season.

Kore Aslan🇰🇷

11,908 Aufrufe • vor 1 Jahr

I love making these out of context videos Context is in the 🧵‼️‼️
0:40

I love making these out of context videos Context is in the 🧵‼️‼️

RitoBandito |

81,787 Aufrufe • vor 2 Jahren

This is just as funny in context as it is out of context.
0:21

This is just as funny in context as it is out of context.

Mousey 💙 (#1 StarStace Fan)

32,574 Aufrufe • vor 1 Monat

Introducing HydraDB. The graph native context infrastructure for agents. Purpose built to deliver precise context & observability into why agents act the way they do. We've always believed graphs are the best way to manage AI context, but they've been too expensive to scale or impractical for storing full context. Until now. HydraDB combines in memory, NVMe, and object storage into a single graph layer, making context delivery faster, cheaper, and more precise. We want context delivery to be extremely fast, 1000x cheap, and highly precise. Give your agents a brain.
1:18

Introducing HydraDB. The graph native context infrastructure for agents. Purpose built to deliver precise context & observability into why agents act the way they do. We've always believed graphs are the best way to manage AI context, but they've been too expensive to scale or impractical for storing full context. Until now. HydraDB combines in memory, NVMe, and object storage into a single graph layer, making context delivery faster, cheaper, and more precise. We want context delivery to be extremely fast, 1000x cheap, and highly precise. Give your agents a brain.

Nishkarsh

2,287,729 Aufrufe • vor 24 Tagen

The Context Cloud for agents is here. Introducing the new supermemory. A new way to do context, for your agents Everything you need for context - Memory, RAG, Filesystems, Profiles, are now available as blocks you can compose to build something for your use case
5:27

The Context Cloud for agents is here. Introducing the new supermemory. A new way to do context, for your agents Everything you need for context - Memory, RAG, Filesystems, Profiles, are now available as blocks you can compose to build something for your use case

Dhravya Shah

88,275 Aufrufe • vor 1 Monat

It's not only about how long your context is, but how well you use it. Great to see Gemini 2.5 models dominating MRCR and other benchmarks on long context! See 2.5 Pro tackle a complex coding task by reasoning over an entire repo (>500k tokens). Performance and effective use of the (loooong) context windows are what really matter!
1:11

It's not only about how long your context is, but how well you use it. Great to see Gemini 2.5 models dominating MRCR and other benchmarks on long context! See 2.5 Pro tackle a complex coding task by reasoning over an entire repo (>500k tokens). Performance and effective use of the (loooong) context windows are what really matter!

Oriol Vinyals

27,008 Aufrufe • vor 1 Jahr

Introducing Claude Code Hook - Context Timeline (Saving this to try later) Install with: npx claude-code-templates@latest --hook monitoring/context-timeline Managing the context window and the subagents running in Claude Code is hard to keep track of That's why I built this hook... It starts the moment you open a session and shows a timeline with the main agent's context window and how subagents start working in their own separate context Every subagent you have running will show up in real time This way you can manage the context and the subagents you run, and see everything in a much simpler way than in the console
0:40

Introducing Claude Code Hook - Context Timeline (Saving this to try later) Install with: npx claude-code-templates@latest --hook monitoring/context-timeline Managing the context window and the subagents running in Claude Code is hard to keep track of That's why I built this hook... It starts the moment you open a session and shows a timeline with the main agent's context window and how subagents start working in their own separate context Every subagent you have running will show up in real time This way you can manage the context and the subagents you run, and see everything in a much simpler way than in the console

Daniel San

51,228 Aufrufe • vor 2 Monaten

Question we get constantly: "How does Cline handle context limits in long-running tasks?" Here's how users can manage their context: /newtask: Creates a detailed handoff summary and starts fresh context. Like handing off work to a new engineer with full background. more 👇
0:21

Question we get constantly: "How does Cline handle context limits in long-running tasks?" Here's how users can manage their context: /newtask: Creates a detailed handoff summary and starts fresh context. Like handing off work to a new engineer with full background. more 👇

Cline

21,739 Aufrufe • vor 11 Monaten

Advent of Claude Day 17 - @ Mentions @ mentions in Claude Code may be overpowered: * Add one or many files into context instantly * Quickly list directories * Enable/disable/invoke MCP servers and subagents @ is the fastest path from "I need context" to "Claude has context."
0:27

Advent of Claude Day 17 - @ Mentions @ mentions in Claude Code may be overpowered: * Add one or many files into context instantly * Quickly list directories * Enable/disable/invoke MCP servers and subagents @ is the fastest path from "I need context" to "Claude has context."

Ado

27,634 Aufrufe • vor 6 Monaten

Here is a short video. Without context. Context — later)
0:41

Here is a short video. Without context. Context — later)

Denys Shtilierman

206,209 Aufrufe • vor 4 Monaten

Context in the video~
0:39

Context in the video~

✶ 🎀 𝐻𝑒𝓁𝓁o¿ 🎀 ✶

42,740 Aufrufe • vor 1 Jahr