Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

opensource community while discovering ssms work better than transformers Soon you may not even need gpus for long context portable ai.

nisten🇨🇦e/acc

17,890 subscribers

289,020 views • 2 years ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

9 Comments

nisten - e/acc2 years ago

As far as I’ve heard from openai folk they’re “looking into it”. So this is new to them too. No one knows how well it’ll perform at scale, but a 0.79B and 2.9B model trained on just 300m tokens (because of being gpupoor) coming within ballpark of llama7B is pretty cray cray.

nisten - e/acc2 years ago

If anyone has spare compute to donate the skunkworks kitchen is ready to outcook openai with it just saying

The Highly Automated Cat — e/acc ⏩2 years ago

sexting sms?

nisten - e/acc2 years ago

structured state space models

𝔠ɣ𝔟ε𝓇 𝕙ιε𝕣øթ𝕙𐊀ητ //daniel//2 years ago

Is the tech legit? Transformer-killers have flopped (get it?) in the past…

nisten - e/acc2 years ago

@ddaughertytech lk99 moment

murat 🍥2 years ago

wow the deepfates program has really grown

Jamison 🏕️☃️2 years ago

banger song

Tyr2 years ago

Whatd I miss?

Related Videos

Sam Altman says "AGI soon" is too vague for what is really coming A clearer way to say it: AI may soon do more of the world's total thinking than humans That could cause major short-term job disruption if most intellectual work shifts to GPUs "so we need to start designing an economy that works for everyone"

Sam Altman says "AGI soon" is too vague for what is really coming A clearer way to say it: AI may soon do more of the world's total thinking than humans That could cause major short-term job disruption if most intellectual work shifts to GPUs "so we need to start designing an economy that works for everyone"

Haider.

31,897 views • 2 months ago

Finally, Google has dropped AI for work. It runs your emails, meetings, docs, and even understands your data in context. Here’s everything you need to know:

Finally, Google has dropped AI for work. It runs your emails, meetings, docs, and even understands your data in context. Here’s everything you need to know:

Pearl AI

20,739 views • 10 months ago

Yet more Transformers arriving today at Giga Texas! Kekius Maximus has mentioned transformers as one of the critical path items for AI data centers, along with power generation & GPUs, so stockpiling so many may be Tesla getting ahead of this limitation!

Yet more Transformers arriving today at Giga Texas! Kekius Maximus has mentioned transformers as one of the critical path items for AI data centers, along with power generation & GPUs, so stockpiling so many may be Tesla getting ahead of this limitation!

Joe Tegtmeyer 🚀 🤠🛸😎

31,953 views • 1 year ago

OpenAI Co-founder Andrej Karpathy predicts transformers may soon surpass the human brain in capabilities "Transformers have the potential to surpass the human brain in efficiency and memorization capabilities, despite current limitations in data availability and training. As AI technology advances, transformers may become more efficient learners than the human brain, which operates under various limitations"

OpenAI Co-founder Andrej Karpathy predicts transformers may soon surpass the human brain in capabilities "Transformers have the potential to surpass the human brain in efficiency and memorization capabilities, despite current limitations in data availability and training. As AI technology advances, transformers may become more efficient learners than the human brain, which operates under various limitations"

Haider.

133,777 views • 1 year ago

Your car may be more than meets the eye 👀 #Transformers #RiseOfTheBeasts

Your car may be more than meets the eye 👀 #Transformers #RiseOfTheBeasts

Transformers

352,705 views • 3 years ago

Imagine discovering your girlfriend is on dating sites after being together for so long 🤦🏿‍♂️ Cheaterbuster AI is really doing great work! 👏🏻

Imagine discovering your girlfriend is on dating sites after being together for so long 🤦🏿‍♂️ Cheaterbuster AI is really doing great work! 👏🏻

𐌌

2,651,912 views • 1 year ago

Cardi B Lol it's not Ai 🤔 no need for community note

Cardi B Lol it's not Ai 🤔 no need for community note

Mpumi Seroe

181,702 views • 3 months ago

Need more powerful GPUs in Jupyter notebooks? The new Hyperbolic AI Cloud Cursor extension lets you use H100 GPUs for $0.99/hr. Watch the demo to see how we can accelerate your AI/ML workloads.

Need more powerful GPUs in Jupyter notebooks? The new Hyperbolic AI Cloud Cursor extension lets you use H100 GPUs for $0.99/hr. Watch the demo to see how we can accelerate your AI/ML workloads.

Hyperbolic

21,506 views • 1 year ago

Sharing is Sharing. Somebody may need the refresher.... Auntee gonna show you better than she can tell you.

Sharing is Sharing. Somebody may need the refresher.... Auntee gonna show you better than she can tell you.

Inspirenaire

121,682 views • 8 months ago

Introducing Ambient Context Aware AI on your computer. I have just scraped the whole Discord with it and made a summary of pain points ppl have Features: - Sees the whole screen ( even parts you need to scroll to) - long context window - Has memory Link:

Introducing Ambient Context Aware AI on your computer. I have just scraped the whole Discord with it and made a summary of pain points ppl have Features: - Sees the whole screen ( even parts you need to scroll to) - long context window - Has memory Link:

Robert Lukoszko

15,383 views • 1 year ago

Lisa Su explains why GPUs from $AMD & $NVDA will continue to dominate AI accelerators for years since developers need programmability & flexibility that ASICs like $GOOGL TPUs can’t match. Even as ASICs improve for inference, GPUs remain the default platform.

Lisa Su explains why GPUs from $AMD & $NVDA will continue to dominate AI accelerators for years since developers need programmability & flexibility that ASICs like $GOOGL TPUs can’t match. Even as ASICs improve for inference, GPUs remain the default platform.

Shay Boloor

78,745 views • 5 months ago

We may not be able to do much about the weather, but we do need a better plan for putting out a burning city than waiting for rain.

We may not be able to do much about the weather, but we do need a better plan for putting out a burning city than waiting for rain.

Bill Maher

5,375,627 views • 1 year ago

1/ Introducing MemSync — Portable AI Memory for Personalization MemSync (MemSync) turns your digital footprint into an AI-friendly database, allowing you to port your context over to other AI apps for instant personalization. Built by the OpenGradient (∇, ∇) team

1/ Introducing MemSync — Portable AI Memory for Personalization MemSync (MemSync) turns your digital footprint into an AI-friendly database, allowing you to port your context over to other AI apps for instant personalization. Built by the OpenGradient (∇, ∇) team

Matthew (∇, ∇)

87,499 views • 11 months ago

Prompting AI is harder than it seems. Learn why context is key for writing better prompts with new features in Microsoft Copilot for Microsoft 365:

Prompting AI is harder than it seems. Learn why context is key for writing better prompts with new features in Microsoft Copilot for Microsoft 365:

Microsoft 365

33,954 views • 2 years ago

5⃣ things you may not know about WONHO Official's single “Better Than Me" 👀 #WONHO

5⃣ things you may not know about WONHO Official's single “Better Than Me" 👀 #WONHO

iHeartRadio

38,621 views • 11 months ago

“Maybe we are at the last model that humans could have figured out.” Ex-OpenAI researcher Jerry Tworek says AI agents may soon design better models than humans. The search space may be too large for us alone.

“Maybe we are at the last model that humans could have figured out.” Ex-OpenAI researcher Jerry Tworek says AI agents may soon design better models than humans. The search space may be too large for us alone.

vitrupo

77,272 views • 4 months ago

This is a step forward for long-context video tuning, which has already unlocked impressive multi-shot video generation pipelines from . Generating minutes- or even hour-long videos without drifting or forgetting is not "coming soon" -- it is already here. 3/4

This is a step forward for long-context video tuning, which has already unlocked impressive multi-shot video generation pipelines from . Generating minutes- or even hour-long videos without drifting or forgetting is not "coming soon" -- it is already here. 3/4

Gordon Wetzstein

27,473 views • 9 months ago

Stop doing this Copy → Paste → Write long prompts → Wait → Repeat This is NOT how AI should work. Introducing Clico The AI that works with you, not against you. Imagine this: You’re reading a webpage… and instead of switching tabs, explaining context, or writing prompts — Clico already understands everything on your screen. You just click… and it writes, summarizes, explains, or executes instantly. No friction. No context loss. Just pure productivity This changes everything: → Creators write faster → Founders move quicker → Students understand better Basically… you think it. Clico does it. This is the future of browsing. Support & explore here: Full details: If you’ve ever used AI before… you NEED to try this. #AI #Productivity #ChromeExtension #Startups #BuildInPublic #TechTwitter

Stop doing this Copy → Paste → Write long prompts → Wait → Repeat This is NOT how AI should work. Introducing Clico The AI that works with you, not against you. Imagine this: You’re reading a webpage… and instead of switching tabs, explaining context, or writing prompts — Clico already understands everything on your screen. You just click… and it writes, summarizes, explains, or executes instantly. No friction. No context loss. Just pure productivity This changes everything: → Creators write faster → Founders move quicker → Students understand better Basically… you think it. Clico does it. This is the future of browsing. Support & explore here: Full details: If you’ve ever used AI before… you NEED to try this. #AI #Productivity #ChromeExtension #Startups #BuildInPublic #TechTwitter

smrati tiwari

133,124 views • 2 months ago