Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Epic is working on a way for you to quickly clear the games cache manually! Once you clear the cache it does point out that some games will take longer to load after cache has been cleared as it needs to download/cache again.

Hybrid

10,794 subscribers

18,239 Aufrufe • vor 1 Jahr •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

You asked for it, so here it is. Visualizing CPU cache speeds relative to RAM. Cache optimization is important too!

You asked for it, so here it is. Visualizing CPU cache speeds relative to RAM. Cache optimization is important too!

Ben Dicken

1,474,400 Aufrufe • vor 1 Jahr

Some of the biggest news today is Cloudflare Worker's Cache. So I built this small catalog to experience it. It allows you to purge the cache for certain pages, or the entire catalog. It also shows you the exact caching headers used. See it in action or try it yourself:

Some of the biggest news today is Cloudflare Worker's Cache. So I built this small catalog to experience it. It allows you to purge the cache for certain pages, or the entire catalog. It also shows you the exact caching headers used. See it in action or try it yourself:

Jilles Soeters

17,920 Aufrufe • vor 27 Tagen

I don't think anyone realizes yet how powerful Convex + Next.js 'use cache' is going to be You are able to get completely dynamic sites at the speed of static, with no flashes of incorrect data Also you will never have to think about what cache keys to set, it just works

I don't think anyone realizes yet how powerful Convex + Next.js 'use cache' is going to be You are able to get completely dynamic sites at the speed of static, with no flashes of incorrect data Also you will never have to think about what cache keys to set, it just works

Rhys

27,547 Aufrufe • vor 11 Monaten

You can solo boost to shroud in the new Cache ‼️ They made it very easy too, no need to use the door

You can solo boost to shroud in the new Cache ‼️ They made it very easy too, no need to use the door

Ozzny

451,783 Aufrufe • vor 3 Monaten

Day 11/90 of Inference Engineering How does vLLM work and how is it used in production? Before we discuss how vLLM works internally, it helps to understand what vLLM is. At a high level, vLLM is an inference engine that is designed to serve LLMs to thousands of concurrent users efficiently while managing scarce compute and memory. The goal for vLLM is to maximize throughput and minimize latency; optimizing for the best inference economics and experience for end users. With every request from the end user, it eventually ends up in the engine core, gets scheduled alongside other requests from other concurrent users, executes on the GPU, and updates the KV cache with the new key and value vectors, and streams the tokens back to the user. The Scheduler decides what requests should execute next while continuously batching requests together to maximize GPU utilization. Continuous batching is an inference optimization that allows new requests to join a running batch as other requests finish generating tokens. This helps with keeping the GPU utilization high instead of letting it sit idle waiting for an entire batch to complete generating. After the scheduler dispatches the selected batch to the Model Executor, the Model Executor prepares the tensors and metadata required for inference, retrieves each request’s block table from KV Cache Manager, launches the optimized transformer forward pass on the GPU, computes the logits, updates the KV cache with the new key and value vectors, and finally returns the results for sampling and streaming. The KV Cache Manager uses the PagedAttention memory layout to allocate fixed-size cache blocks on demand and maintains a Free Block Queue on the CPU that tracks which blocks in the GPU’s Paged KV Cache are currently free. When a request needs additional KV cache space, the KV Cache manager takes a free block from the queue and assigns it to that request, thus avoiding an expensive search through GPU memory for available cache blocks. All of these components form the core of vLLM’s inference engine. The Scheduler determines what requests are executed, the Model Executor determines how those requests are executed, the KV Cache Manager determines where each request’s KV cache lives using the PagedAttention Memory Layout. This architecture enables vLLM to serve thousands of concurrent requests with high throughput, low latency, and efficient GPU memory utilization. Heres a little animation that visualizes everything! - I've also completed the forward pass for my mnist.c project. I had a nice chat with shrey birmiwal, such a knowledgeable guy. Excited to learn more about vLLM and implement a tiny-vLLM one day.

Day 11/90 of Inference Engineering How does vLLM work and how is it used in production? Before we discuss how vLLM works internally, it helps to understand what vLLM is. At a high level, vLLM is an inference engine that is designed to serve LLMs to thousands of concurrent users efficiently while managing scarce compute and memory. The goal for vLLM is to maximize throughput and minimize latency; optimizing for the best inference economics and experience for end users. With every request from the end user, it eventually ends up in the engine core, gets scheduled alongside other requests from other concurrent users, executes on the GPU, and updates the KV cache with the new key and value vectors, and streams the tokens back to the user. The Scheduler decides what requests should execute next while continuously batching requests together to maximize GPU utilization. Continuous batching is an inference optimization that allows new requests to join a running batch as other requests finish generating tokens. This helps with keeping the GPU utilization high instead of letting it sit idle waiting for an entire batch to complete generating. After the scheduler dispatches the selected batch to the Model Executor, the Model Executor prepares the tensors and metadata required for inference, retrieves each request’s block table from KV Cache Manager, launches the optimized transformer forward pass on the GPU, computes the logits, updates the KV cache with the new key and value vectors, and finally returns the results for sampling and streaming. The KV Cache Manager uses the PagedAttention memory layout to allocate fixed-size cache blocks on demand and maintains a Free Block Queue on the CPU that tracks which blocks in the GPU’s Paged KV Cache are currently free. When a request needs additional KV cache space, the KV Cache manager takes a free block from the queue and assigns it to that request, thus avoiding an expensive search through GPU memory for available cache blocks. All of these components form the core of vLLM’s inference engine. The Scheduler determines what requests are executed, the Model Executor determines how those requests are executed, the KV Cache Manager determines where each request’s KV cache lives using the PagedAttention Memory Layout. This architecture enables vLLM to serve thousands of concurrent requests with high throughput, low latency, and efficient GPU memory utilization. Heres a little animation that visualizes everything! - I've also completed the forward pass for my mnist.c project. I had a nice chat with shrey birmiwal, such a knowledgeable guy. Excited to learn more about vLLM and implement a tiny-vLLM one day.

max fu

70,024 Aufrufe • vor 16 Tagen

Like all Telegram apps, Telegram Desktop needs no extra storage space to run. You can use the 'Manage Local Storage' settings to clear your cache and set size limits, or check your Telegram Desktop folder and remove old copies of media that you saved locally. #TelegramTips

Like all Telegram apps, Telegram Desktop needs no extra storage space to run. You can use the 'Manage Local Storage' settings to clear your cache and set size limits, or check your Telegram Desktop folder and remove old copies of media that you saved locally. #TelegramTips

Telegram Messenger

92,942 Aufrufe • vor 3 Jahren

shroud shared his actual thoughts on new version of Cache: "Yeah, I don't love it. I wasn't expecting to not love it, but it definitely needs some work for sure, I don't hate it either."

shroud shared his actual thoughts on new version of Cache: "Yeah, I don't love it. I wasn't expecting to not love it, but it definitely needs some work for sure, I don't hate it either."

Counter-Strike News

285,605 Aufrufe • vor 1 Jahr

Submitted Easy Vertex Anim for #UE5.8 too. You can create pivot painter 2 effects and bake chaos cache to vat, 100% NO AI, check it out!

Submitted Easy Vertex Anim for #UE5.8 too. You can create pivot painter 2 effects and bake chaos cache to vat, 100% NO AI, check it out!

Inu Games

10,373 Aufrufe • vor 1 Monat

Want the latest, flashiest skins? Lucky Cache is here for you every week! Every Friday to Sunday, Step into the Lucky Cache and challenge destiny! (level 80 needed) 🎁 One free draw every week A single draw could change everything and rewards can refresh 3 times a week — are you ready? Luck doesn't wait!

Want the latest, flashiest skins? Lucky Cache is here for you every week! Every Friday to Sunday, Step into the Lucky Cache and challenge destiny! (level 80 needed) 🎁 One free draw every week A single draw could change everything and rewards can refresh 3 times a week — are you ready? Luck doesn't wait!

Call of Odin's Chosen

121,198 Aufrufe • vor 7 Monaten

For those who missed it, here's the mysterious video that Lorde tweeted then quickly deleted 🤔 sorry i don't get a proper save while it was up, but it was still in the cache on my phone so i managed to make a screen recording "Break the silence for good reason"

For those who missed it, here's the mysterious video that Lorde tweeted then quickly deleted 🤔 sorry i don't get a proper save while it was up, but it was still in the cache on my phone so i managed to make a screen recording "Break the silence for good reason"

Lorde fix 🩻🧬⛓️

12,292 Aufrufe • vor 1 Jahr

I really love the fact that you can do smokes like these, I always thought that this is something that the original Cache was missing, I can't wait to see what else people come up with.

I really love the fact that you can do smokes like these, I always thought that this is something that the original Cache was missing, I can't wait to see what else people come up with.

mind

161,473 Aufrufe • vor 3 Monaten

Fun Fact: At some point in 2021, Epic Games were working on a ‘Singin’ in the rain’ #Fortnite emote, inspired by Gene Kelly & Stanley Donen’s film of the same name. However, seeing as it’s been 4 years since it got leaked, it’s safe to say that it had been scrapped 🤷‍♂️

Fun Fact: At some point in 2021, Epic Games were working on a ‘Singin’ in the rain’ #Fortnite emote, inspired by Gene Kelly & Stanley Donen’s film of the same name. However, seeing as it’s been 4 years since it got leaked, it’s safe to say that it had been scrapped 🤷‍♂️

FN News

53,249 Aufrufe • vor 1 Jahr

Turkish President Erdogan on the SDF/YPG: It is not possible for the terrorist organization to sustain its presence in the areas where it has been cornered. From this point on, it is very clear that resorting to provocations would amount to suicide.

Turkish President Erdogan on the SDF/YPG: It is not possible for the terrorist organization to sustain its presence in the areas where it has been cornered. From this point on, it is very clear that resorting to provocations would amount to suicide.

Clash Report

13,738 Aufrufe • vor 6 Monaten

Mvlogs he has 4.4 million followers on Insta & he posted about us! ❤️⚽️ Limited Period Offer to Mint FAFC #NFTs at 0.01 ETH ⚽️✨ Hurry Up! Now or Never Offer ⚽️Mint Now! : Mint Price : 0.01 ETH ⚽️🔥 (Clear your cache if you are seeing the same price)

Mvlogs he has 4.4 million followers on Insta & he posted about us! ❤️⚽️ Limited Period Offer to Mint FAFC #NFTs at 0.01 ETH ⚽️✨ Hurry Up! Now or Never Offer ⚽️Mint Now! : Mint Price : 0.01 ETH ⚽️🔥 (Clear your cache if you are seeing the same price)

Football Ape Fan Club | P-1 Mint is live

125,733 Aufrufe • vor 3 Jahren

Regardless of how you feel about Russ, If you don’t think that this was as clear of a foul as it gets - then you’re lying. Period. For NBA to come out & shamelessly lie 2 games in a row against the Lakers? Why is NBA trying to make sure Lakers lose? .

Regardless of how you feel about Russ, If you don’t think that this was as clear of a foul as it gets - then you’re lying. Period. For NBA to come out & shamelessly lie 2 games in a row against the Lakers? Why is NBA trying to make sure Lakers lose? .

Letting Go

979,857 Aufrufe • vor 3 Jahren

We made a significant performance improvement to Instant Validation in the Next.js 16.3 preview. If you're currently using next@preview be sure to upgrade! See video for before/after. Note: "before" was only when using cache components on next@preview. If you're on any other version that navigation is like the "after" case.

We made a significant performance improvement to Instant Validation in the Next.js 16.3 preview. If you're currently using next@preview be sure to upgrade! See video for before/after. Note: "before" was only when using cache components on next@preview. If you're on any other version that navigation is like the "after" case.

Tim

20,937 Aufrufe • vor 10 Tagen

Race Condition + Host Header Injection + Redis(Cache)= Zero Click XSS The first attempts were not successful and the reflect was not observed, but using the RACE, I saw that my sampler is displayed for the rest of the users 🫥 I will publish it after permission. #BugBounty

Race Condition + Host Header Injection + Redis(Cache)= Zero Click XSS The first attempts were not successful and the reflect was not observed, but using the RACE, I saw that my sampler is displayed for the rest of the users 🫥 I will publish it after permission. #BugBounty

Sina

24,157 Aufrufe • vor 1 Jahr

Twitter has implemented a login redirect for visitors that aren't signed in, it's across all devices. It also seems to affect Googlebot, which may mean your Twitter profile pages cease to rank very soon... I'm already seeing errors from Google's cache of certain profiles.

Charles Floate 📈

19,275 Aufrufe • vor 3 Jahren

It is clear as day that Matt Petgrave intentionally killed Adam Johnson. Not only should he never be allowed to play hockey again…he needs to go to jail for manslaughter. I’m shocked the other team didn’t kick the shit out of him for it right on the spot, honestly.

It is clear as day that Matt Petgrave intentionally killed Adam Johnson. Not only should he never be allowed to play hockey again…he needs to go to jail for manslaughter. I’m shocked the other team didn’t kick the shit out of him for it right on the spot, honestly.

Mindy MF Robinson 🦄

183,947 Aufrufe • vor 2 Jahren

gemma-4-12B-agentic-fable5-composer2.5 V2 is out. the agentic upgrade to the model trained on Fable 5's reasoning. Running it now with TurboQuant llama.cpp on a single RTX 4060( 8 GB VRAM) at 30 tokens/second with full 25000 context and reasoning: # The benchmarks v2 is built for coding + agentic work. writing code, running commands, using tools, debugging, multi step technical tasks. The clearest signal is tau2 bench telecom, an agentic tool use benchmark whose diagnose → fix → verify loop mirrors real terminal/debugging work: tau2 bench telecom numbers: base Gemma 4 12B: ~15% this finetune: ~55%. (Self reported) thats a huge jump # TheTom/llama-cpp-turboquant flags: llama-server.exe -m gemma4-v2-Q4_K_M.gguf -ngl 99 -c 25000 --cache-type-k q8_0 --cache-type-v turbo3 --port 8080 Flag breakdown: -ngl 99 → full GPU offload -c 25000 → 25K context --cache-type-k q8_0 --cache-type-v turbo3 → mixed-precision KV cache — K at 8-bit, V at ~3-bit via TurboQuant (Walsh Hadamard rotated polar quant, Google's own KV-compression research). Not even merged into mainline llama.cpp. running it off a fork. No API. No cloud. Just llama.cpp. well, a fork of it and any 6gb+ GPU. If you tried yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF, check this out and share your experience with the models

gemma-4-12B-agentic-fable5-composer2.5 V2 is out. the agentic upgrade to the model trained on Fable 5's reasoning. Running it now with TurboQuant llama.cpp on a single RTX 4060( 8 GB VRAM) at 30 tokens/second with full 25000 context and reasoning: # The benchmarks v2 is built for coding + agentic work. writing code, running commands, using tools, debugging, multi step technical tasks. The clearest signal is tau2 bench telecom, an agentic tool use benchmark whose diagnose → fix → verify loop mirrors real terminal/debugging work: tau2 bench telecom numbers: base Gemma 4 12B: ~15% this finetune: ~55%. (Self reported) thats a huge jump # TheTom/llama-cpp-turboquant flags: llama-server.exe -m gemma4-v2-Q4_K_M.gguf -ngl 99 -c 25000 --cache-type-k q8_0 --cache-type-v turbo3 --port 8080 Flag breakdown: -ngl 99 → full GPU offload -c 25000 → 25K context --cache-type-k q8_0 --cache-type-v turbo3 → mixed-precision KV cache — K at 8-bit, V at ~3-bit via TurboQuant (Walsh Hadamard rotated polar quant, Google's own KV-compression research). Not even merged into mainline llama.cpp. running it off a fork. No API. No cloud. Just llama.cpp. well, a fork of it and any 6gb+ GPU. If you tried yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF, check this out and share your experience with the models

Alok

145,356 Aufrufe • vor 1 Monat