Загрузка видео...
Не удалось загрузить видео
GGUF My Repo by Hugging Face Create quantum GGUF models fully online - quickly and secure. Thanks to Vaibhav (VB) Srivastav, Pedro Cuenca and team for creating this HF space! In the video below I give it a try to create a quantum 8-bit model of Gemma 2B -... show more
64,506 просмотров • 2 лет назад •via X (Twitter)
Комментарии: 10
@reach_vb @pcuenq Let's gooo! GGUF ftw!🤗
@huggingface @reach_vb @pcuenq 🔥
@huggingface @reach_vb @pcuenq Awesome. Would be cool if it could make imatrix quants and i-quants as well!
@huggingface @reach_vb @pcuenq Cool bro. Would be better to call them quantized models instead of quantum models as the use of later invites some misunderstandings.
@Saquibclimatex @huggingface @reach_vb @pcuenq "Quantum" makes more sense to me (e.g. "quantum physics", "quantum mechanical model"). But the main reason to prefer it is because the spellchecker does not like "quantized"
@huggingface @reach_vb @pcuenq Amazing!
@huggingface @reach_vb @pcuenq The GPT 5 tab 🤣
@huggingface @reach_vb @pcuenq Impressive
@huggingface @reach_vb @pcuenq This will shave a chunk of time off my current workflow. Thank you.
@huggingface @reach_vb @pcuenq This could be big. :-) Btw I suspect word 'quantum' invites hallucination. try asking LLMs about "quantum GGUF models". Wouldn't 'quantized' work better?
![There is a beautiful story that just happened in AI so let me share it for a lighter tone weekend post among all the doom stories in our AI field this week. It’s a story of people on three continents building and sharing in the open a new small efficient and state-of-the-art AI model. It started a couple of months ago when a new team in the AI scene released their first model from their headquarters in Paris (France): Mistral 7B. Impressive model, small and very strong performances in the benchmarks, better than all previous models of this size. And open source! So you could build on top of it. Lewis in Bern (Switzerland) and Ed (in Lyon, in the South of France) both from the H4 team, a team of researchers in model fine-tuning and alignment were talking about it over a coffee, in one of these gatherings that often happen at Hugging Face to break the distance between people (literal distance as HF is a remote company). What about fine-tuning it using this new DPO method that a research team from Stanford in California just posted on Arxiv, says one? Hey, that’s a great idea, replies the other. We've just build a great code base (with Nathan, Nazneen, Costa, Younes and all the H4 team and TRL community) let's use it! The next day they start diving in the datasets openly shared on the HF hub and stumble upon two interesting large and good quality fine-tuning datasets recently open-sourced by OpenBMB, a Chinese team from Tsinghua: UltraFeedback and UltraChat. A few rounds of training experiments confirm the intuition, the resulting model is super strong, by far the strongest they have ever seen in their benchmarks from Berkeley and Stanford (LMSYS and Alpaca). Join Clementine, the big boss of the open evaluation leaderboard. Her deep dive into the model capabilities confirms the results: impressive performance. But the H4 team also hosts a famous faculty member, Pr. Sasha Rush, Associate Professor at Cornell University in his daytime, hacker at HF in his nighttime. Joining the conversation, he proposes to quickly draft a research paper to organize and share all the details with the community. A few days later, the model, called Zephyr (a wind like Mistral), paper, and all details are shared with the world. Quickly other companies, everywhere in the world starts to use it. LlamaIndex, a famous data framework and community, shares how the model blew their expectations on real-life use-case benchmarks, while researchers and practitioners discuss the paper and work on the Hugging Face hub. All this happened in just a few weeks catalyzed by open access to knowledge, models, research, and datasets released all over the world (Europe, California, China) and by the idea that people can build upon one another work in AI to bring real-world value with efficient and open models. Stories like this are numerous everywhere around us and make me really proud of the AI community and see how we can build amazingly useful things together. [the video is just me reading this Friday post hahah]](https://image.24vids.com/tw-1720503998518640703/ext_tw_video_thumb/1720503027273023490/pu/img/VOLi_zPnZlb1nuWB.jpg)
