正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Pixel Aligned Language Models Proposes PixelLLM to equip LLMs with localization capability proj: abs:

Aran Komatsuzaki

168,429 subscribers

24,663 次观看 • 2 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Automating the Search for Artificial Life with Foundation Models Presents ASAL, the first use of vision-language models in Artificial Life, discovering diverse, novel simulations across substrates proj: abs:

Automating the Search for Artificial Life with Foundation Models Presents ASAL, the first use of vision-language models in Artificial Life, discovering diverse, novel simulations across substrates proj: abs:

Aran Komatsuzaki

39,180 次观看 • 1 年前

Major AI breakthrough: Diffusion Large Language Models are here! They're 10x faster and 10x cheaper than traditional LLMs. Here's everything you need to know:

Major AI breakthrough: Diffusion Large Language Models are here! They're 10x faster and 10x cheaper than traditional LLMs. Here's everything you need to know:

Matthew Berman

429,167 次观看 • 1 年前

Wouldn’t it be nice if ChatGPT could find your missing keys for you? Our latest research from Berkeley AI Research + Google AI suggests that robots can use large language models (LLMs) to find hidden objects faster. 🧵👇

Wouldn’t it be nice if ChatGPT could find your missing keys for you? Our latest research from Berkeley AI Research + Google AI suggests that robots can use large language models (LLMs) to find hidden objects faster. 🧵👇

Kaushik Shivakumar

58,523 次观看 • 3 年前

Laika AI x Nuklai Excited to announce our partnership with Nuklai Nuklai is an innovative data ecosystem that will fuel the next generation of AI and Large Language Models (LLMs). Together, we're revolutionizing on-chain data accessibility and monetization. By combining Laika AI's blockchain analytics with Nuklai's ecosystem, we're creating new opportunities for data utilization powered by $LKI.

Laika AI x Nuklai Excited to announce our partnership with Nuklai Nuklai is an innovative data ecosystem that will fuel the next generation of AI and Large Language Models (LLMs). Together, we're revolutionizing on-chain data accessibility and monetization. By combining Laika AI's blockchain analytics with Nuklai's ecosystem, we're creating new opportunities for data utilization powered by $LKI.

Laika AI

29,901 次观看 • 1 年前

SL2T is our breakthrough sign language-to-text model powering new features for Deaf and hard of hearing users on Android. Starting with American Sign Language-to-English on Pixel 11, people can sign directly into Gboard and Live Transcribe instead of typing.

SL2T is our breakthrough sign language-to-text model powering new features for Deaf and hard of hearing users on Android. Starting with American Sign Language-to-English on Pixel 11, people can sign directly into Gboard and Live Transcribe instead of typing.

Google DeepMind

364,454 次观看 • 7 天前

Finishing 2024 with one more research result! We’ve trained small language agents to do hard sci tasks: engineering proteins, manipulating DNA, and working with sci literature in a new library called Aviary. We beat humans and frontier LLMs on these tasks!

Finishing 2024 with one more research result! We’ve trained small language agents to do hard sci tasks: engineering proteins, manipulating DNA, and working with sci literature in a new library called Aviary. We beat humans and frontier LLMs on these tasks!

Andrew White 🐦‍⬛

86,332 次观看 • 1 年前

We found a new way to get language models to reason. 🤯 No RL, no training, no verifiers, no prompting. ❌ With better sampling, base models can achieve single-shot reasoning on par with (or better than!) GRPO while avoiding its characteristic loss in generation diversity.

We found a new way to get language models to reason. 🤯 No RL, no training, no verifiers, no prompting. ❌ With better sampling, base models can achieve single-shot reasoning on par with (or better than!) GRPO while avoiding its characteristic loss in generation diversity.

Aayush Karan

278,107 次观看 • 10 个月前

LongWriter Unleashing 10,000+ Word Generation from Long Context LLMs discuss: Current long context large language models (LLMs) can process inputs up to 100,000 tokens, yet struggle to generate outputs exceeding even a modest length of 2,000 words. Through controlled experiments, we find that the model's effective generation length is inherently bounded by the sample it has seen during supervised fine-tuning (SFT). In other words, their output limitation is due to the scarcity of long-output examples in existing SFT datasets. To address this, we introduce AgentWrite, an agent-based pipeline that decomposes ultra-long generation tasks into subtasks, enabling off-the-shelf LLMs to generate coherent outputs exceeding 20,000 words. Leveraging AgentWrite, we construct LongWriter-6k, a dataset containing 6,000 SFT data with output lengths ranging from 2k to 32k words. By incorporating this dataset into model training, we successfully scale the output length of existing models to over 10,000 words while maintaining output quality. We also develop LongBench-Write, a comprehensive benchmark for evaluating ultra-long generation capabilities. Our 9B parameter model, further improved through DPO, achieves state-of-the-art performance on this benchmark, surpassing even much larger proprietary models. In general, our work demonstrates that existing long context LLM already possesses the potential for a larger output window--all you need is data with extended output during model alignment to unlock this capability.

LongWriter Unleashing 10,000+ Word Generation from Long Context LLMs discuss: Current long context large language models (LLMs) can process inputs up to 100,000 tokens, yet struggle to generate outputs exceeding even a modest length of 2,000 words. Through controlled experiments, we find that the model's effective generation length is inherently bounded by the sample it has seen during supervised fine-tuning (SFT). In other words, their output limitation is due to the scarcity of long-output examples in existing SFT datasets. To address this, we introduce AgentWrite, an agent-based pipeline that decomposes ultra-long generation tasks into subtasks, enabling off-the-shelf LLMs to generate coherent outputs exceeding 20,000 words. Leveraging AgentWrite, we construct LongWriter-6k, a dataset containing 6,000 SFT data with output lengths ranging from 2k to 32k words. By incorporating this dataset into model training, we successfully scale the output length of existing models to over 10,000 words while maintaining output quality. We also develop LongBench-Write, a comprehensive benchmark for evaluating ultra-long generation capabilities. Our 9B parameter model, further improved through DPO, achieves state-of-the-art performance on this benchmark, surpassing even much larger proprietary models. In general, our work demonstrates that existing long context LLM already possesses the potential for a larger output window--all you need is data with extended output during model alignment to unlock this capability.

AK

50,995 次观看 • 2 年前

We're partnering with xAI to bring Grok to Cloudflare AI Gateway. • Grok LLMs, audio, image, and video models are now available through AI Gateway • Billed directly through Cloudflare • No additional auth, env, API keys needed 𝚎𝚗𝚟.𝙰𝙸.𝚛𝚞𝚗("𝚡𝚊𝚒/𝚐𝚛𝚘𝚔-𝚒𝚖𝚊𝚐𝚒𝚗𝚎-𝚟𝚒𝚍𝚎𝚘-𝟷.𝟻-𝚙𝚛𝚎𝚟𝚒𝚎𝚠")

We're partnering with xAI to bring Grok to Cloudflare AI Gateway. • Grok LLMs, audio, image, and video models are now available through AI Gateway • Billed directly through Cloudflare • No additional auth, env, API keys needed 𝚎𝚗𝚟.𝙰𝙸.𝚛𝚞𝚗("𝚡𝚊𝚒/𝚐𝚛𝚘𝚔-𝚒𝚖𝚊𝚐𝚒𝚗𝚎-𝚟𝚒𝚍𝚎𝚘-𝟷.𝟻-𝚙𝚛𝚎𝚟𝚒𝚎𝚠")

Cloudflare Developers

9,730,263 次观看 • 2 个月前

Today, Nesa is excited to announce cross-chain support with Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.

Today, Nesa is excited to announce cross-chain support with Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.

Nesa

79,672 次观看 • 2 年前

Inspired by Andrej Karpathy and the idea of using games to compare LLMs, I've built a version of the game Codenames where different models are paired in teams to play the game with each other. Fun to see o3-mini team with R1 against Grok and Gemini! Link and repo below.

Inspired by Andrej Karpathy and the idea of using games to compare LLMs, I've built a version of the game Codenames where different models are paired in teams to play the game with each other. Fun to see o3-mini team with R1 against Grok and Gemini! Link and repo below.

Ilya Abyzov

378,744 次观看 • 1 年前

Coming to Pixel later this year, we’ll be introducing our latest model, Gemini Nano with Multimodality. This means your phone will not just be able to process text input but also understand more information in context like sights, sounds and spoken language. #GoogleIO

Coming to Pixel later this year, we’ll be introducing our latest model, Gemini Nano with Multimodality. This means your phone will not just be able to process text input but also understand more information in context like sights, sounds and spoken language. #GoogleIO

Made by Google

75,595 次观看 • 2 年前

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇

Varun Shenoy

166,167 次观看 • 2 年前

F3D-Gaus: Feed-forward 3D-aware Generation on ImageNet with Cycle-Consistent Gaussian Splatting Contributions: • We pioneer 3D-aware generation using generalizable feed-forward Gaussian Splatting representation, achieving significant efficiency and favorable rendering quality on monocular datasets. • We significantly advance the capability of pixel-aligned Gaussian Splatting representations by designing a self-supervised cycle training strategy specifically tailored for monocular datasets. • We further mitigate the artifacts of 3D-aware representations caused by large viewpoint shifts by introducing geometry-aware video priors.

F3D-Gaus: Feed-forward 3D-aware Generation on ImageNet with Cycle-Consistent Gaussian Splatting Contributions: • We pioneer 3D-aware generation using generalizable feed-forward Gaussian Splatting representation, achieving significant efficiency and favorable rendering quality on monocular datasets. • We significantly advance the capability of pixel-aligned Gaussian Splatting representations by designing a self-supervised cycle training strategy specifically tailored for monocular datasets. • We further mitigate the artifacts of 3D-aware representations caused by large viewpoint shifts by introducing geometry-aware video priors.

MrNeRF

14,229 次观看 • 1 年前

🤯 Nexus will launch with free access to powerful LLMs via io.net — no paid API keys, no infra setup. Create agents using models like Qwen-235B and DeepSeek R1 from day one. 📖 Learn more about the integration here: $NAI 🤝 $IO #NexusCountdown

🤯 Nexus will launch with free access to powerful LLMs via io.net — no paid API keys, no infra setup. Create agents using models like Qwen-235B and DeepSeek R1 from day one. 📖 Learn more about the integration here: $NAI 🤝 $IO #NexusCountdown

Nuklai

31,142 次观看 • 1 年前

AI is not limited by capability anymore. It’s limited by trust. When data and models remain protected during execution, experimentation becomes safer, audits can occur without threat to user data, and real-world applications can scale with confidence. This is true adoption.

AI is not limited by capability anymore. It’s limited by trust. When data and models remain protected during execution, experimentation becomes safer, audits can occur without threat to user data, and real-world applications can scale with confidence. This is true adoption.

Nesa

10,098 次观看 • 5 个月前

Want to bring open-source vision language models to the edge? 💻 Check out our Hugging Face article on deploying NVIDIA Cosmos Reasoning 2B across the NVIDIA Jetson family with vLLM and a Live VLM WebUI. 📖

Want to bring open-source vision language models to the edge? 💻 Check out our Hugging Face article on deploying NVIDIA Cosmos Reasoning 2B across the NVIDIA Jetson family with vLLM and a Live VLM WebUI. 📖

NVIDIA Robotics

54,057 次观看 • 5 个月前

With the SAS prompt, we can now use language models like Gemini to learn from a robot's history. This allows the model to analyze parameter effects ⚡, and suggest ways to improve - similar to a real-life table tennis coach. 💡

With the SAS prompt, we can now use language models like Gemini to learn from a robot's history. This allows the model to analyze parameter effects ⚡, and suggest ways to improve - similar to a real-life table tennis coach. 💡

Google DeepMind

21,239 次观看 • 1 年前