Загрузка видео...

Не удалось загрузить видео

На главную

Pixel Aligned Language Models Proposes PixelLLM to equip LLMs with localization capability proj: abs:

arankomatsuzaki's profile picture

Aran Komatsuzaki

168,429 subscribers

24,663 просмотров • 2 лет назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Automating the Search for Artificial Life with Foundation Models Presents ASAL, the first use of vision-language models in Artificial Life, discovering diverse, novel simulations across substrates proj: abs:
0:16

Automating the Search for Artificial Life with Foundation Models Presents ASAL, the first use of vision-language models in Artificial Life, discovering diverse, novel simulations across substrates proj: abs:

Aran Komatsuzaki

39,180 просмотров • 1 год назад

Major AI breakthrough: Diffusion Large Language Models are here! They're 10x faster and 10x cheaper than traditional LLMs. Here's everything you need to know:
0:19

Major AI breakthrough: Diffusion Large Language Models are here! They're 10x faster and 10x cheaper than traditional LLMs. Here's everything you need to know:

Matthew Berman

429,139 просмотров • 1 год назад

Wouldn’t it be nice if ChatGPT could find your missing keys for you? Our latest research from Berkeley AI Research + Google AI suggests that robots can use large language models (LLMs) to find hidden objects faster. 🧵👇
0:15

Wouldn’t it be nice if ChatGPT could find your missing keys for you? Our latest research from Berkeley AI Research + Google AI suggests that robots can use large language models (LLMs) to find hidden objects faster. 🧵👇

Kaushik Shivakumar

58,523 просмотров • 3 лет назад

Laika AI x Nuklai Excited to announce our partnership with Nuklai Nuklai is an innovative data ecosystem that will fuel the next generation of AI and Large Language Models (LLMs). Together, we're revolutionizing on-chain data accessibility and monetization. By combining Laika AI's blockchain analytics with Nuklai's ecosystem, we're creating new opportunities for data utilization powered by $LKI.
0:10

Laika AI x Nuklai Excited to announce our partnership with Nuklai Nuklai is an innovative data ecosystem that will fuel the next generation of AI and Large Language Models (LLMs). Together, we're revolutionizing on-chain data accessibility and monetization. By combining Laika AI's blockchain analytics with Nuklai's ecosystem, we're creating new opportunities for data utilization powered by $LKI.

Laika AI

29,901 просмотров • 1 год назад

Finishing 2024 with one more research result! We’ve trained small language agents to do hard sci tasks: engineering proteins, manipulating DNA, and working with sci literature in a new library called Aviary. We beat humans and frontier LLMs on these tasks!
0:13

Finishing 2024 with one more research result! We’ve trained small language agents to do hard sci tasks: engineering proteins, manipulating DNA, and working with sci literature in a new library called Aviary. We beat humans and frontier LLMs on these tasks!

Andrew White 🐦‍⬛

86,332 просмотров • 1 год назад

We found a new way to get language models to reason. 🤯 No RL, no training, no verifiers, no prompting. ❌ With better sampling, base models can achieve single-shot reasoning on par with (or better than!) GRPO while avoiding its characteristic loss in generation diversity.
0:11

We found a new way to get language models to reason. 🤯 No RL, no training, no verifiers, no prompting. ❌ With better sampling, base models can achieve single-shot reasoning on par with (or better than!) GRPO while avoiding its characteristic loss in generation diversity.

Aayush Karan

277,680 просмотров • 9 месяцев назад

LongWriter Unleashing 10,000+ Word Generation from Long Context LLMs discuss: Current long context large language models (LLMs) can process inputs up to 100,000 tokens, yet struggle to generate outputs exceeding even a modest length of 2,000 words. Through controlled experiments, we find that the model's effective generation length is inherently bounded by the sample it has seen during supervised fine-tuning (SFT). In other words, their output limitation is due to the scarcity of long-output examples in existing SFT datasets. To address this, we introduce AgentWrite, an agent-based pipeline that decomposes ultra-long generation tasks into subtasks, enabling off-the-shelf LLMs to generate coherent outputs exceeding 20,000 words. Leveraging AgentWrite, we construct LongWriter-6k, a dataset containing 6,000 SFT data with output lengths ranging from 2k to 32k words. By incorporating this dataset into model training, we successfully scale the output length of existing models to over 10,000 words while maintaining output quality. We also develop LongBench-Write, a comprehensive benchmark for evaluating ultra-long generation capabilities. Our 9B parameter model, further improved through DPO, achieves state-of-the-art performance on this benchmark, surpassing even much larger proprietary models. In general, our work demonstrates that existing long context LLM already possesses the potential for a larger output window--all you need is data with extended output during model alignment to unlock this capability.
0:12

LongWriter Unleashing 10,000+ Word Generation from Long Context LLMs discuss: Current long context large language models (LLMs) can process inputs up to 100,000 tokens, yet struggle to generate outputs exceeding even a modest length of 2,000 words. Through controlled experiments, we find that the model's effective generation length is inherently bounded by the sample it has seen during supervised fine-tuning (SFT). In other words, their output limitation is due to the scarcity of long-output examples in existing SFT datasets. To address this, we introduce AgentWrite, an agent-based pipeline that decomposes ultra-long generation tasks into subtasks, enabling off-the-shelf LLMs to generate coherent outputs exceeding 20,000 words. Leveraging AgentWrite, we construct LongWriter-6k, a dataset containing 6,000 SFT data with output lengths ranging from 2k to 32k words. By incorporating this dataset into model training, we successfully scale the output length of existing models to over 10,000 words while maintaining output quality. We also develop LongBench-Write, a comprehensive benchmark for evaluating ultra-long generation capabilities. Our 9B parameter model, further improved through DPO, achieves state-of-the-art performance on this benchmark, surpassing even much larger proprietary models. In general, our work demonstrates that existing long context LLM already possesses the potential for a larger output window--all you need is data with extended output during model alignment to unlock this capability.

AK

50,995 просмотров • 2 лет назад

We're partnering with xAI to bring Grok to Cloudflare AI Gateway. • Grok LLMs, audio, image, and video models are now available through AI Gateway • Billed directly through Cloudflare • No additional auth, env, API keys needed 𝚎𝚗𝚟.𝙰𝙸.𝚛𝚞𝚗("𝚡𝚊𝚒/𝚐𝚛𝚘𝚔-𝚒𝚖𝚊𝚐𝚒𝚗𝚎-𝚟𝚒𝚍𝚎𝚘-𝟷.𝟻-𝚙𝚛𝚎𝚟𝚒𝚎𝚠")
0:10

We're partnering with xAI to bring Grok to Cloudflare AI Gateway. • Grok LLMs, audio, image, and video models are now available through AI Gateway • Billed directly through Cloudflare • No additional auth, env, API keys needed 𝚎𝚗𝚟.𝙰𝙸.𝚛𝚞𝚗("𝚡𝚊𝚒/𝚐𝚛𝚘𝚔-𝚒𝚖𝚊𝚐𝚒𝚗𝚎-𝚟𝚒𝚍𝚎𝚘-𝟷.𝟻-𝚙𝚛𝚎𝚟𝚒𝚎𝚠")

Cloudflare Developers

9,728,906 просмотров • 2 месяцев назад

Today, Nesa is excited to announce cross-chain support with Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.
0:16

Today, Nesa is excited to announce cross-chain support with Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.

Nesa

79,668 просмотров • 2 лет назад

We’re not just training models anymore. We’re deploying intelligence at scale. On the latest episode of Advanced Insights, AMD CTO MarkPapermaster sits down with Oracle's Chris Gandolfo to talk AI, infrastructure, and what it really takes to train and deploy LLMs at scale.
0:16

We’re not just training models anymore. We’re deploying intelligence at scale. On the latest episode of Advanced Insights, AMD CTO MarkPapermaster sits down with Oracle's Chris Gandolfo to talk AI, infrastructure, and what it really takes to train and deploy LLMs at scale.

AMD

16,961 просмотров • 1 год назад

Inspired by Andrej Karpathy and the idea of using games to compare LLMs, I've built a version of the game Codenames where different models are paired in teams to play the game with each other. Fun to see o3-mini team with R1 against Grok and Gemini! Link and repo below.
0:15

Inspired by Andrej Karpathy and the idea of using games to compare LLMs, I've built a version of the game Codenames where different models are paired in teams to play the game with each other. Fun to see o3-mini team with R1 against Grok and Gemini! Link and repo below.

Ilya Abyzov

378,744 просмотров • 1 год назад

Coming to Pixel later this year, we’ll be introducing our latest model, Gemini Nano with Multimodality. This means your phone will not just be able to process text input but also understand more information in context like sights, sounds and spoken language. #GoogleIO
0:13

Coming to Pixel later this year, we’ll be introducing our latest model, Gemini Nano with Multimodality. This means your phone will not just be able to process text input but also understand more information in context like sights, sounds and spoken language. #GoogleIO

Made by Google

75,595 просмотров • 2 лет назад

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇
0:14

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇

Varun Shenoy

166,167 просмотров • 2 лет назад

F3D-Gaus: Feed-forward 3D-aware Generation on ImageNet with Cycle-Consistent Gaussian Splatting Contributions: • We pioneer 3D-aware generation using generalizable feed-forward Gaussian Splatting representation, achieving significant efficiency and favorable rendering quality on monocular datasets. • We significantly advance the capability of pixel-aligned Gaussian Splatting representations by designing a self-supervised cycle training strategy specifically tailored for monocular datasets. • We further mitigate the artifacts of 3D-aware representations caused by large viewpoint shifts by introducing geometry-aware video priors.
0:16

F3D-Gaus: Feed-forward 3D-aware Generation on ImageNet with Cycle-Consistent Gaussian Splatting Contributions: • We pioneer 3D-aware generation using generalizable feed-forward Gaussian Splatting representation, achieving significant efficiency and favorable rendering quality on monocular datasets. • We significantly advance the capability of pixel-aligned Gaussian Splatting representations by designing a self-supervised cycle training strategy specifically tailored for monocular datasets. • We further mitigate the artifacts of 3D-aware representations caused by large viewpoint shifts by introducing geometry-aware video priors.

MrNeRF

14,229 просмотров • 1 год назад

🤯 Nexus will launch with free access to powerful LLMs via io.net — no paid API keys, no infra setup. Create agents using models like Qwen-235B and DeepSeek R1 from day one. 📖 Learn more about the integration here: $NAI 🤝 $IO #NexusCountdown
0:15

🤯 Nexus will launch with free access to powerful LLMs via io.net — no paid API keys, no infra setup. Create agents using models like Qwen-235B and DeepSeek R1 from day one. 📖 Learn more about the integration here: $NAI 🤝 $IO #NexusCountdown

Nuklai

31,142 просмотров • 1 год назад

AI is not limited by capability anymore. It’s limited by trust. When data and models remain protected during execution, experimentation becomes safer, audits can occur without threat to user data, and real-world applications can scale with confidence. This is true adoption.
0:12

AI is not limited by capability anymore. It’s limited by trust. When data and models remain protected during execution, experimentation becomes safer, audits can occur without threat to user data, and real-world applications can scale with confidence. This is true adoption.

Nesa

10,098 просмотров • 4 месяцев назад

Want to bring open-source vision language models to the edge? 💻 Check out our Hugging Face article on deploying NVIDIA Cosmos Reasoning 2B across the NVIDIA Jetson family with vLLM and a Live VLM WebUI. 📖
0:17

Want to bring open-source vision language models to the edge? 💻 Check out our Hugging Face article on deploying NVIDIA Cosmos Reasoning 2B across the NVIDIA Jetson family with vLLM and a Live VLM WebUI. 📖

NVIDIA Robotics

54,057 просмотров • 5 месяцев назад

With the SAS prompt, we can now use language models like Gemini to learn from a robot's history. This allows the model to analyze parameter effects ⚡, and suggest ways to improve - similar to a real-life table tennis coach. 💡
0:08

With the SAS prompt, we can now use language models like Gemini to learn from a robot's history. This allows the model to analyze parameter effects ⚡, and suggest ways to improve - similar to a real-life table tennis coach. 💡

Google DeepMind

21,239 просмотров • 1 год назад

ESMFold2 and the ESM-C family, now available for use! We’ve partnered with biohub (the ESM team’s new home), to provide day 1 access to their newly open-sourced series of models. The family of models show best-in-class results for structure prediction, de novo design, and protein-language model tasks.
0:16

ESMFold2 and the ESM-C family, now available for use! We’ve partnered with biohub (the ESM team’s new home), to provide day 1 access to their newly open-sourced series of models. The family of models show best-in-class results for structure prediction, de novo design, and protein-language model tasks.

Deniz Kavi

15,694 просмотров • 2 месяцев назад