Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Hot Chips 3D DRAM session: D-Matrix says its 3D DRAM moves data 6-to-7x more efficiently than HBM4 on measured silicon "On comparing with HBM4, like we heard in the morning, we can get about 2.4 picojoules per bit energy efficiency on HBM4 of moving data into the base die."...

24,198 Aufrufe • vor 16 Tagen •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Etched is deploying two new technologies in chip design: low-voltage inference and cluster-scale memory. CEO Gavin Uberti says they'll make their chips much more power-efficient and way, way faster than today's leading GPUs. He breaks it down: "We looked at a lot of early research directions, and we realized the key things that models need are way more compute and way faster memory." "If you think about inference, there are two key parts: prefill and decode. For prefill, it's a compute-bound problem. You need to have more FLOPS, more operations per second on each of your chips." "On our GPU, the bottleneck's actually thermals. You can't really run a GPU at more than around 50% of what it could theoretically do, or it'll melt." "So we're using a new technology today called low-voltage inference to try to solve this problem. You bring the voltage of the chip down dramatically, which allows us to have way, way better efficiency in terms of how much power is drawn per unit of math, and thus fit way way more flops onto the chip..." "For decode, it's all about bandwidth. Not just bandwidth on a chip, but bandwidth across your cluster. That's why we have this technology we call cluster-scale memory. It reduces the amount of time it takes to communicate from one chip to another dramatically." "As a result we can go use all of our HBM, HBM bandwidth, SRAM, SRAM bandwidth, and our scale-up domain as a single coherent pool. And that means if you're a user, you can go get much faster tokens per second, while still keeping your costs low."

TBPN

20,404 Aufrufe • vor 2 Monaten

#WATCH | India AI Impact Summit 2026 | Delhi: Founder Chairman and CEO of Sampark Foundation & former CEO of HCL Technologies, Vineet Nayar says, "...From an employment point of view I think it is very important for us to understand that Indian companies, including Indian IT companies, are going to be profit-driven and therefore if you believe that they are going to create employment you must be dreaming. Therefore, the question is how do we create employment in this environment, and that employment comes from mass scale startups, which is what this government has already doing. So, how do we create new sets of people who are trying to solve new sets of problems not new sets of technology and if we do that we will get it right. I think we as Indians have to be very careful on who does data belong to and that is the debate we have a problem with. The LLM models which exist worldwide are far superior than the Indian models. Unfortunately, in India, we never develop products, so therefore we do not have SLMs and LLMs which are world-class. On one side, we have global LLM products which are coming to India and trading on our Indian data. Should we allowed that or should we not allowed that? But on the other side if we don't allow that then we have the data but we don't have the LLM models. So, how do we encourage technology completely to develop the LLM models. This needs radicals strategic thinking and a very important aspect otherwise we will either give up a data. So, I think it's a very critical aspect for us to think about - who does this data belong, what is the kind of incentives we are going to give to develop LLM technologies or SLM technologies fast so that we train on our data otherwise an LLM will come in with our data and we'll immediately see return and we'll celebrate and we will do all these kind of press releases but the India will lose a competitive advantage on something which is very critical for the next decade."

ANI

18,753 Aufrufe • vor 6 Monaten

This Is An American Business Owner “The majority of my employees are under the age of 25 and I was having a conversation with a few of them the other day about just their futures” The answers were “so heartbreaking, like there's no hope” We NEED leadership change She asked “What are they saving for buying a home starting families that kind of thing and it was overwhelming The responses were just what's the point? They're like we work all the time. Half of our checks just get taken to taxes and sent overseas. Like they even see it and they're young, not even paying attention. Like we can't even buy a house so we're not even gonna try to save. We can barely think about starting a family because I can barely afford to live on my own.” “Just, it's so heartbreaking. Like there's no hope. But even when I was in college and I was able to buy a home and my friends, you know, they were able to do the same and start families. It was feasible, it was doable. And it's so disgusting the damage has been done in such a short period of time and it blows my mind that people are still going to vote for it” “it's so prevalent and it's so obvious now damage the just destruction of this poor country and what it's doing to a generation that are growing up trying to do their best and there's nothing for them. There's no future for them. What are they saving for? Like if we continue, if in November this happens again, we won't make it out. Like this is, this is, I mean, this is so sad.”

Wall Street Apes

714,371 Aufrufe • vor 2 Jahren