Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

$INFQ GPU + CPU + QPU Frontier models are hitting saturation on tokens (data volume) and context windows (memory). $INFQ CTO walks through how they and $NVDA are working together to add a Quantum Processing Unit to the chain as the next inflection point.

Yeah_Dave's profile picture

YeahDave

32,111 subscribers

57,181 Aufrufe • vor 1 Monat •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

"Quantum is here, and it's time to make sure we are capitalized to address the opportunity that's ahead of us," Infleqtion CEO Matt Kinsella says on going public on the New York Stock Exchange under the ticker $INFQ.
6:45

"Quantum is here, and it's time to make sure we are capitalized to address the opportunity that's ahead of us," Infleqtion CEO Matt Kinsella says on going public on the New York Stock Exchange under the ticker $INFQ.

Yahoo Finance

25,920 Aufrufe • vor 4 Monaten

🎞️ Curious to learn more about Match Chain? Take a look at this helpful explainer that walks us through how Match ID and Match Hub are working together to power the internet’s evolution from web2 to web3. Read more 👉
1:03

🎞️ Curious to learn more about Match Chain? Take a look at this helpful explainer that walks us through how Match ID and Match Hub are working together to power the internet’s evolution from web2 to web3. Read more 👉

Matchain

254,531 Aufrufe • vor 2 Jahren

In 2025, I told you to buy quantum and we made millions together. In 2026, I told you to buy quantum AGAIN. This time, you'll retire within the next 4 years. Here are the BEST quantum stocks to buy right now: 1. IonQ $IONQ 2. International Business Machines $IBM 3. Infleqtion $INFQ 4. Rigetti Computing $RGTI 5. D-Wave Quantum $QBTS 6. Xanadu $XNDU 7. Quantum Computing $QUBT 8. Arqit Quantum $ARQQ 9. Horizon Quantum $HQ All my buy and sell signals in Discord @
3:49

In 2025, I told you to buy quantum and we made millions together. In 2026, I told you to buy quantum AGAIN. This time, you'll retire within the next 4 years. Here are the BEST quantum stocks to buy right now: 1. IonQ $IONQ 2. International Business Machines $IBM 3. Infleqtion $INFQ 4. Rigetti Computing $RGTI 5. D-Wave Quantum $QBTS 6. Xanadu $XNDU 7. Quantum Computing $QUBT 8. Arqit Quantum $ARQQ 9. Horizon Quantum $HQ All my buy and sell signals in Discord @

StockWhale

149,791 Aufrufe • vor 1 Monat

$NVDA is entering the consumer PC chip market with RTX Spark, an $ARM based CPU/GPU/AI chip for Windows laptops and mini-PCs. The flagship version includes 20 CPU cores, 6,144 GPU cores, and up to 128GB of unified LPDDR5X memory, aimed at local AI agents, creators, developers, and gaming. Nvidia says 30+ laptops and 10+ desktops are already in development with partners including Microsoft, Dell, HP, Asus, Lenovo, MSI, Acer, and Gigabyte.
2:05

$NVDA is entering the consumer PC chip market with RTX Spark, an $ARM based CPU/GPU/AI chip for Windows laptops and mini-PCs. The flagship version includes 20 CPU cores, 6,144 GPU cores, and up to 128GB of unified LPDDR5X memory, aimed at local AI agents, creators, developers, and gaming. Nvidia says 30+ laptops and 10+ desktops are already in development with partners including Microsoft, Dell, HP, Asus, Lenovo, MSI, Acer, and Gigabyte.

Wall St Engine

108,823 Aufrufe • vor 1 Monat

The models we use every day are brilliant strangers. They forget your organization the moment a chat ends, then relearn it on the next query. Engram fixes that. It learns your world once and reuses that memory, matching frontier systems on 1-10% of the tokens. Microsoft, Notion, and Harvey are already testing it within their organizations. Congratulations to the team, and hear directly from Dan Biderman (CEO and co-founder) and Sabri Eyuboglu (CTO and co-founder) with "Leigh Marie" Braswell ⬇️
6:00

The models we use every day are brilliant strangers. They forget your organization the moment a chat ends, then relearn it on the next query. Engram fixes that. It learns your world once and reuses that memory, matching frontier systems on 1-10% of the tokens. Microsoft, Notion, and Harvey are already testing it within their organizations. Congratulations to the team, and hear directly from Dan Biderman (CEO and co-founder) and Sabri Eyuboglu (CTO and co-founder) with "Leigh Marie" Braswell ⬇️

Kleiner Perkins

35,635 Aufrufe • vor 18 Tagen

I had to test it myself to believe this unreal inference speed. 3,000 tokens/s for 1 user on standard datacenter GPUs. They leveraged a hidden efficiency gap in how GPUs generate tokens. Kog just achieved 3,000 tokens/s on 8× AMD MI300X GPUs and 2,100 on 8× NVIDIA H200 (FP16, no speculative decoding). Their tech preview is on a 2B model, and they show how their techniques will scale to large frontier MoE models at similar speeds. That's a huge number because normal low-batch GPU decoding for 2B to 8B models is usually closer to 100 to 300 tokens/s per request, so Kog is claiming something like a 10X to 30X jump in the speed one user actually feels. Their trick: they are getting the speed by treating LLM decoding as a memory streaming problem, not mainly a math problem. For 1 user at batch size 1, the GPU is not doing big, efficient matrix-matrix work like in training or large-batch serving; it is repeatedly pulling the model’s active weights from high-bandwidth memory for each new token, so speed depends on how smoothly those weights keep flowing. Normal inference stacks keep breaking that flow. They run many separate GPU programs for different parts of the model, move intermediate results through memory, wait at synchronization points, talk back to the CPU for scheduling or sampling, and then repeat this token after token. Kog’s answer is to co-design 3 things that are usually tuned separately: the runtime, the low-level GPU code, and the model architecture. The biggest engineering move is the monokernel, where the whole decode pass runs as 1 persistent GPU-resident program, including sampling, so the system does not keep stopping for kernel launches, CPU scheduling, and intermediate memory round trips. They also rebuilt synchronization, because their own measurements say grid sync was eating around 35% of token-generation time; instead of making every compute unit wait at a broad barrier, each unit waits only for the exact data it needs. On AMD MI300X, they also map memory access around the chiplet layout, because memory latency changes depending on which die makes the request. Then their Laneformer model uses Delayed Tensor Parallelism, which lets cross-GPU communication happen in the background instead of blocking every layer.
1:08

I had to test it myself to believe this unreal inference speed. 3,000 tokens/s for 1 user on standard datacenter GPUs. They leveraged a hidden efficiency gap in how GPUs generate tokens. Kog just achieved 3,000 tokens/s on 8× AMD MI300X GPUs and 2,100 on 8× NVIDIA H200 (FP16, no speculative decoding). Their tech preview is on a 2B model, and they show how their techniques will scale to large frontier MoE models at similar speeds. That's a huge number because normal low-batch GPU decoding for 2B to 8B models is usually closer to 100 to 300 tokens/s per request, so Kog is claiming something like a 10X to 30X jump in the speed one user actually feels. Their trick: they are getting the speed by treating LLM decoding as a memory streaming problem, not mainly a math problem. For 1 user at batch size 1, the GPU is not doing big, efficient matrix-matrix work like in training or large-batch serving; it is repeatedly pulling the model’s active weights from high-bandwidth memory for each new token, so speed depends on how smoothly those weights keep flowing. Normal inference stacks keep breaking that flow. They run many separate GPU programs for different parts of the model, move intermediate results through memory, wait at synchronization points, talk back to the CPU for scheduling or sampling, and then repeat this token after token. Kog’s answer is to co-design 3 things that are usually tuned separately: the runtime, the low-level GPU code, and the model architecture. The biggest engineering move is the monokernel, where the whole decode pass runs as 1 persistent GPU-resident program, including sampling, so the system does not keep stopping for kernel launches, CPU scheduling, and intermediate memory round trips. They also rebuilt synchronization, because their own measurements say grid sync was eating around 35% of token-generation time; instead of making every compute unit wait at a broad barrier, each unit waits only for the exact data it needs. On AMD MI300X, they also map memory access around the chiplet layout, because memory latency changes depending on which die makes the request. Then their Laneformer model uses Delayed Tensor Parallelism, which lets cross-GPU communication happen in the background instead of blocking every layer.

Rohan Paul

13,148 Aufrufe • vor 1 Monat

QUANTUM IS THE NEXT FRONTIER AFTER AI -- $IONQ IS THE NEXT $NVDA 👀
0:37

QUANTUM IS THE NEXT FRONTIER AFTER AI -- $IONQ IS THE NEXT $NVDA 👀

Shay Boloor

312,061 Aufrufe • vor 1 Jahr

Preview of the upcoming Netrun metaprotocol on Solana ja walks through creating state tokens, minting assets and domains, and exploring the marketplace experience inside Netrun. Programmable systems are coming on-chain.
3:35

Preview of the upcoming Netrun metaprotocol on Solana ja walks through creating state tokens, minting assets and domains, and exploring the marketplace experience inside Netrun. Programmable systems are coming on-chain.

Netrun

69,200 Aufrufe • vor 2 Monaten

Physicists are still working on how to make general relativity and quantum mechanics consistent. But there's one problem where they are confident they've made the two theories work together: how many bits of information can you store in a black hole?
2:44

Physicists are still working on how to make general relativity and quantum mechanics consistent. But there's one problem where they are confident they've made the two theories work together: how many bits of information can you store in a black hole?

Dwarkesh Patel

29,692 Aufrufe • vor 1 Monat

Quantum computing is being hailed at the next frontier in high-performance processing. But can the technology live up to the hype? Tom Mackenzie breaks down the global race for quantum supremacy, and what comes next
1:32

Quantum computing is being hailed at the next frontier in high-performance processing. But can the technology live up to the hype? Tom Mackenzie breaks down the global race for quantum supremacy, and what comes next

Bloomberg

14,917 Aufrufe • vor 5 Monaten

Devs are using Memory Bank as a project architecture and planning tool before they write any code. "I prefer starting in Cline, using Memory Bank to build out the context files as a roadmap, and letting Cline take the wheel." How to use Memory Bank for project planning 🧵
1:16

Devs are using Memory Bank as a project architecture and planning tool before they write any code. "I prefer starting in Cline, using Memory Bank to build out the context files as a roadmap, and letting Cline take the wheel." How to use Memory Bank for project planning 🧵

Cline

96,628 Aufrufe • vor 1 Jahr

Most C Programmers don't have a clue as to how the CPU works. Here is a lecture from my course on the C Language that introduces how to visualise the CPU as a C (or general software) Programmer.... More Details are at: Being able to model the behaviour of CPU provides a solid base to reason about your code. The summary is - - The CPU is a state machine which maintains it's states in registers. - It has busses to memory for requesting data/instruction read/writes. - Interrupts to attend to events. I discuss this and more in my course on the C Language.
11:41

Most C Programmers don't have a clue as to how the CPU works. Here is a lecture from my course on the C Language that introduces how to visualise the CPU as a C (or general software) Programmer.... More Details are at: Being able to model the behaviour of CPU provides a solid base to reason about your code. The summary is - - The CPU is a state machine which maintains it's states in registers. - It has busses to memory for requesting data/instruction read/writes. - Interrupts to attend to events. I discuss this and more in my course on the C Language.

Piyush Itankar

28,019 Aufrufe • vor 1 Jahr

Paving the way for unlimited context windows. Introducing ZML /attnd: sparse logarithmic attention, on CPU, over UDP, faster than GPU.
4:33

Paving the way for unlimited context windows. Introducing ZML /attnd: sparse logarithmic attention, on CPU, over UDP, faster than GPU.

Steeve Morin

121,949 Aufrufe • vor 9 Monaten

Interesting that in three of my recent conversations with Krishna at Anthropic, Dylan Patel, and Gavin Baker, each said that frontier tokens are capturing the majority of the economic value. Gavin: "An overwhelming amount of the economic returns to AI at the model layer have been at the frontier. That's surprising to me, and I think it's been surprising to a lot of people. This is one of the most important questions to be answered, and you need to have a hypothesis on it as an investor." Krishna: "We think the returns to frontier intelligence are extremely high. Customers invest really heavily in more tokens with the newer models. The ones at the frontier clearly are capturing this economic value, driving meaningful ROI for customers. The returns to frontier intelligence are not slowing down." Dylan: "No one gives a crap about GPT-4 class models. They want the frontier because the frontier lets them create the economically valuable things."
2:08

Interesting that in three of my recent conversations with Krishna at Anthropic, Dylan Patel, and Gavin Baker, each said that frontier tokens are capturing the majority of the economic value. Gavin: "An overwhelming amount of the economic returns to AI at the model layer have been at the frontier. That's surprising to me, and I think it's been surprising to a lot of people. This is one of the most important questions to be answered, and you need to have a hypothesis on it as an investor." Krishna: "We think the returns to frontier intelligence are extremely high. Customers invest really heavily in more tokens with the newer models. The ones at the frontier clearly are capturing this economic value, driving meaningful ROI for customers. The returns to frontier intelligence are not slowing down." Dylan: "No one gives a crap about GPT-4 class models. They want the frontier because the frontier lets them create the economically valuable things."

Patrick OShaughnessy

121,110 Aufrufe • vor 1 Monat

Three layers keep DAC running: the Synchro Chain, the Master Chain, and the Shard Chain. Each handles a different job, and together they keep the network fast without trading away security. davide_costa walks through how all three connect. ↓
1:05

Three layers keep DAC running: the Synchro Chain, the Master Chain, and the Shard Chain. Each handles a different job, and together they keep the network fast without trading away security. davide_costa walks through how all three connect. ↓

DAC | Quantum Chain

21,748 Aufrufe • vor 1 Monat

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!
0:56

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

elvis

261,622 Aufrufe • vor 2 Jahren

J.P. Morgan JUST said that quantum computing is, "a core focus" for them and they are, "investing BILLIONS." If you want to become a multi-billionaire this year, you need to go all-in on quantum right now - there's no waiting. Here's the best quantum stocks to buy: 1. IonQ $IONQ 2. D-Wave Quantum $QBTS 3. Rigetti Computing $RGTI 4. Quantum Computing $QUBT 5. Infleqtion $INFQ 6. Xanadu $XNDU 7. Arqit Quantum $ARQQ 8. Horizon Quantum $HQ 9. X-Energy (honorable mention) $XE 10. ETF's include: $QTUM, $QNTM, and $CHPX All my buy and sell signals in Discord @
6:34

J.P. Morgan JUST said that quantum computing is, "a core focus" for them and they are, "investing BILLIONS." If you want to become a multi-billionaire this year, you need to go all-in on quantum right now - there's no waiting. Here's the best quantum stocks to buy: 1. IonQ $IONQ 2. D-Wave Quantum $QBTS 3. Rigetti Computing $RGTI 4. Quantum Computing $QUBT 5. Infleqtion $INFQ 6. Xanadu $XNDU 7. Arqit Quantum $ARQQ 8. Horizon Quantum $HQ 9. X-Energy (honorable mention) $XE 10. ETF's include: $QTUM, $QNTM, and $CHPX All my buy and sell signals in Discord @

StockWhale

147,530 Aufrufe • vor 2 Monaten

Floki Trading Bot is currently hosting a massive RICE AI ( ◉ - ◉ ) trading competition on BNB Chain, with 2M $RICE tokens in rewards. This video walks you through how the competition works, how to earn points, and how to climb the leaderboard! 👉
1:10

Floki Trading Bot is currently hosting a massive RICE AI ( ◉ - ◉ ) trading competition on BNB Chain, with 2M $RICE tokens in rewards. This video walks you through how the competition works, how to earn points, and how to climb the leaderboard! 👉

Floki Trading Bot

16,433 Aufrufe • vor 9 Monaten