Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Diffusion language models are SO FAST!! A new startup, Inception Labs, has released Mercury Coder, "the first commercial-scale diffusion large language model" It's 5-10x faster than current gen LLMs, providing high-quality responses at low costs. And you can try it now!

354,254 görüntüleme • 1 yıl önce •via X (Twitter)

11 Yorum

Tanishq Mathew Abraham, Ph.D. profil fotoğrafı
Tanishq Mathew Abraham, Ph.D.1 yıl önce

The performance is similar to small frontier models while achieving a throughput of ~1000 tokens/sec... on H100s! Reaching this level of throughput for autoregressive LLMs typically requires specialized chips.

Tanishq Mathew Abraham, Ph.D. profil fotoğrafı
Tanishq Mathew Abraham, Ph.D.1 yıl önce

It's currently tied for second place on Copilot Arena!

Tanishq Mathew Abraham, Ph.D. profil fotoğrafı
Tanishq Mathew Abraham, Ph.D.1 yıl önce

.@InceptionAILabs is a new company that is founded by some of the leading researchers in diffusion language models (@StefanoErmon, @adityagrover_, @volokuleshov)

Tanishq Mathew Abraham, Ph.D. profil fotoğrafı
Tanishq Mathew Abraham, Ph.D.1 yıl önce

You can try out Mercury Coder right now, over here:

Lucid Scientific, Inc. profil fotoğrafı
Lucid Scientific, Inc.1 yıl önce

Expand the possibilities of your metabolic research. Resipher tracks real-time cellular oxygen consumption in standard 96-well plates, delivering continuous real-time data directly from your incubator. Request a free virtual demo or quote today >>

Jonathan Whitaker profil fotoğrafı
Jonathan Whitaker1 yıl önce

Speed is cool! It did the '// This part is left as an exercise for the reader' thing on my first test though hahaha

bubble boi in NY🗽 profil fotoğrafı
bubble boi in NY🗽1 yıl önce

Reporting as spam

Tanishq Mathew Abraham, Ph.D. profil fotoğrafı
Tanishq Mathew Abraham, Ph.D.1 yıl önce

🤣🤣🤣

Joshua Popelka profil fotoğrafı
Joshua Popelka1 yıl önce

Has it helped with any of the limitations of current autoregressive models? Like hallucinations; would be super exciting then.

Tianyu Hua profil fotoğrafı
Tianyu Hua1 yıl önce

open source?

Midas 霊 👑 (kween/acc) profil fotoğrafı
Midas 霊 👑 (kween/acc)1 yıl önce

@EastlondonDev i think you're right 3 months

Benzer Videolar

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

AK

249,708 görüntüleme • 3 yıl önce

A 4-year-old child has seen 50x more information than the biggest LLMs. Yann LeCun is the Chief AI Scientist at Meta. He recently spoke on “The Expanding Universe of Generative Models” panel at the World Economic Forum in Davos. Yann highlighted the idea that a 4-year-old child is way smarter than current cutting-edge large language models (LLMs). “Think about what a child sees through vision. Put a number on how much information a 4-year-old child has seen during their life. It’s 20 Mbps going through the optical nerve for 16,000 wake hours in the first 4 years of life. 3,600 seconds per hour is 10^15 bytes. This is 50x more information than the biggest LLMs we have. A 4-year-old child is way smarter than these models having acquired an enormous amount of knowledge about how the world works.” The real constraint right now is the ability of LLMs to think. Today, LLMs are only capable of System 1 thinking. System 1 vs System 2 thinking was popularised in the book 'Thinking, Fast and Slow' by Daniel Kahneman. System 1 tasks involve quick, instinctive, automatic responses. LLMs struggle with discontinuous tasks that require a creative leap in progress as they imitate human responses. It's hard to go above human response accuracy if LLMs are only trained on humans. Models are building the track in front of them with each word being generated. What could it mean to give language models System 2 thinking? This remains a future development I'm excited about.

Alex Banks

22,958 görüntüleme • 2 yıl önce

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 görüntüleme • 2 yıl önce