Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

My next video will be positively awesome! - Train sub-nano 0.1B language models on custom narrow tasks - Write model SDKs/APIs that run blazingly fast in client machine. I'm talking 350 tok/s with 0.3GB peak memory - How to create synthetic datasets and ship vertical SLMs

AVB

10,988 subscribers

64,720 görüntüleme • 4 ay önce •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Watch this 45 min video to learn how to create synthetic datasets and train tiny (100M params) local language models that expertise on narrow tasks. Code, datasets, models, harnesses all in comments.

Watch this 45 min video to learn how to create synthetic datasets and train tiny (100M params) local language models that expertise on narrow tasks. Code, datasets, models, harnesses all in comments.

AVB

41,103 görüntüleme • 3 ay önce

Apple built a large foundation model and fine-tuned it on multiple tasks. But they are doing something very clever: They load a single model in memory and use different adapters to specialize the model on the fly. I recorded a video to show you how to write the code to do the same thing Apple is doing. I explain everything step by step. Here is what I'll show you in the video: 1. We'll load two datasets 2. Then load a large model 3. Then, we'll fine-tune the model on both datasets I'll use LoRA to fine-tune the model. This process creates two small adapters, each specializing in solving one of the datasets. The base model's original parameters will remain unchanged. From here: 4. We'll generate a list of tasks 5. We'll load the correct adapter to solve each task The large model I'm using needs 346 MB of memory, but I only need to load it once. Each adapter is only 2.7 MB. I only need to load the base model once and pair it with any of the fine-tuned adapters. Minimum memory footprint and I can solve multiple tasks. Hope this helps!

Apple built a large foundation model and fine-tuned it on multiple tasks. But they are doing something very clever: They load a single model in memory and use different adapters to specialize the model on the fly. I recorded a video to show you how to write the code to do the same thing Apple is doing. I explain everything step by step. Here is what I'll show you in the video: 1. We'll load two datasets 2. Then load a large model 3. Then, we'll fine-tune the model on both datasets I'll use LoRA to fine-tune the model. This process creates two small adapters, each specializing in solving one of the datasets. The base model's original parameters will remain unchanged. From here: 4. We'll generate a list of tasks 5. We'll load the correct adapter to solve each task The large model I'm using needs 346 MB of memory, but I only need to load it once. Each adapter is only 2.7 MB. I only need to load the base model once and pair it with any of the fine-tuned adapters. Minimum memory footprint and I can solve multiple tasks. Hope this helps!

Santiago

84,747 görüntüleme • 2 yıl önce

finetuning LLMs will never be the same! Unsloth just launched an open-source web UI to run and fine-tune 500+ LLMs without writing any code. key features - run models locally on Mac, Windows, Linux - train 500+ models 2x faster with 70% less VRAM - supports GGUF, vision, audio, embedding models - auto-create datasets from PDF, CSV, DOCX - self-healing tool calling and code execution - compare models side by side + export to GGUF to get started, I've shared links in the next tweet.

finetuning LLMs will never be the same! Unsloth just launched an open-source web UI to run and fine-tune 500+ LLMs without writing any code. key features - run models locally on Mac, Windows, Linux - train 500+ models 2x faster with 70% less VRAM - supports GGUF, vision, audio, embedding models - auto-create datasets from PDF, CSV, DOCX - self-healing tool calling and code execution - compare models side by side + export to GGUF to get started, I've shared links in the next tweet.

Akshay 🚀

45,225 görüntüleme • 5 ay önce

Jason Calacanis: Anthropic, OpenAI and others are trying to kill OpenClaw Why? Because an open source agent platform is an existential threat to frontier model companies. @jason: “ People are going to say I'm a conspiracy theorist, but the number one goal, I believe, in the large language model, frontier model space, is to kill (OpenClaw). This is a giant movement to stop it, because this is the equivalent of having an open source Android-like player in the market, and that could be incredibly disruptive. Because, I believe, open source is going to win the day on the large language models and take 90% of the token usage, and I think the entire frontier model space could be undercut by open source. And I think they realize that SLMs, the smaller language models that are verticalized now, that will run on desktops and laptops and are even starting to run on the top ones, that is their biggest competitive threat, and I hope it happens.”

Jason Calacanis: Anthropic, OpenAI and others are trying to kill OpenClaw Why? Because an open source agent platform is an existential threat to frontier model companies. @jason: “ People are going to say I'm a conspiracy theorist, but the number one goal, I believe, in the large language model, frontier model space, is to kill (OpenClaw). This is a giant movement to stop it, because this is the equivalent of having an open source Android-like player in the market, and that could be incredibly disruptive. Because, I believe, open source is going to win the day on the large language models and take 90% of the token usage, and I think the entire frontier model space could be undercut by open source. And I think they realize that SLMs, the smaller language models that are verticalized now, that will run on desktops and laptops and are even starting to run on the top ones, that is their biggest competitive threat, and I hope it happens.”

The All-In Podcast

64,611 görüntüleme • 4 ay önce

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Harper Carroll

30,392 görüntüleme • 26 gün önce

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️

AI at Meta

163,374 görüntüleme • 1 yıl önce

Apple announces Swift Assist for Xcode 16! "Swift Assist serves as a companion for all of a developer’s coding tasks, so they can focus on higher-level problems and solutions. It’s seamlessly integrated into Xcode, and knows the latest software development kits (SDKs) and Swift language features, so developers will always get the latest code features that blend perfectly into their projects. With Swift Assist, tasks like exploring new frameworks and experimenting with new ideas are just one request away. Swift Assist uses a powerful model that runs in the cloud — and like all Apple developer services, it is built with privacy and security in mind. Developers’ code is only used to process requests and never stored on servers, and Apple will not use it to train machine learning models." Swift Assist is coming later this year to Xcode 16.

Apple announces Swift Assist for Xcode 16! "Swift Assist serves as a companion for all of a developer’s coding tasks, so they can focus on higher-level problems and solutions. It’s seamlessly integrated into Xcode, and knows the latest software development kits (SDKs) and Swift language features, so developers will always get the latest code features that blend perfectly into their projects. With Swift Assist, tasks like exploring new frameworks and experimenting with new ideas are just one request away. Swift Assist uses a powerful model that runs in the cloud — and like all Apple developer services, it is built with privacy and security in mind. Developers’ code is only used to process requests and never stored on servers, and Apple will not use it to train machine learning models." Swift Assist is coming later this year to Xcode 16.

M1

79,628 görüntüleme • 2 yıl önce

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

50,090 görüntüleme • 8 ay önce

Training robot foundation models faces two key hurdles: how to get enough data to train an effective model, and how to make sure that new skills can be acquired quickly. The team at Rhoda AI believes that the answer is training Direct Video Action models from web data. Web data is plentiful, to the point where Rhoda can train their base model on hundreds of years of video data. And then, with the addition of robot data, they can quickly adapt it to new tasks with as little as 20 hours of in-domain data, performing complex, multi-step manipulation tasks with their purpose-built video foundation model. Tongzhou Mu 🤖🦾🦿 Eric Chan and Changan Chen joined us to talk more about their approach. Watch Episode #79 of RoboPapers, with Michael Cho - Rbt/Acc, Chris Paxton, and Jiafei Duan, to learn more!

Training robot foundation models faces two key hurdles: how to get enough data to train an effective model, and how to make sure that new skills can be acquired quickly. The team at Rhoda AI believes that the answer is training Direct Video Action models from web data. Web data is plentiful, to the point where Rhoda can train their base model on hundreds of years of video data. And then, with the addition of robot data, they can quickly adapt it to new tasks with as little as 20 hours of in-domain data, performing complex, multi-step manipulation tasks with their purpose-built video foundation model. Tongzhou Mu 🤖🦾🦿 Eric Chan and Changan Chen joined us to talk more about their approach. Watch Episode #79 of RoboPapers, with Michael Cho - Rbt/Acc, Chris Paxton, and Jiafei Duan, to learn more!

RoboPapers

24,475 görüntüleme • 3 ay önce

I'm excited to introduce my AI Machine Learning Agent that built 32 ML models in 30 seconds. Today, I'll share with you how to automate building 100s of ML models with the AI ML Agent, which is available on GitHub. We'll create an ML Agent focusing on a Customer Churn Problem. I'll guide you through setting up the ML Agent, creating dozens of ML models, and loading the best model for production. This AI is a huge time-saver! Table of Contents: 00:00 Introduction to my AI Data Science Team 02:56 Setting Up AI Data Science Team 04:48 Running the ML Agent Code 07:12 Create (and Run) the AI Machine Learning Agent 09:53 Reviewing ML Model Summary 12:00 Saving and Loading Models 13:00 Next Steps + Project Roadmap + AI Bootcamp Github to AI Data Science Team (Army of Copilots): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: P.S. - Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, January 29th, I'm sharing one of my best AI Projects: Time Series Forecasting with AI Register here (1570+ registered):

I'm excited to introduce my AI Machine Learning Agent that built 32 ML models in 30 seconds. Today, I'll share with you how to automate building 100s of ML models with the AI ML Agent, which is available on GitHub. We'll create an ML Agent focusing on a Customer Churn Problem. I'll guide you through setting up the ML Agent, creating dozens of ML models, and loading the best model for production. This AI is a huge time-saver! Table of Contents: 00:00 Introduction to my AI Data Science Team 02:56 Setting Up AI Data Science Team 04:48 Running the ML Agent Code 07:12 Create (and Run) the AI Machine Learning Agent 09:53 Reviewing ML Model Summary 12:00 Saving and Loading Models 13:00 Next Steps + Project Roadmap + AI Bootcamp Github to AI Data Science Team (Army of Copilots): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: P.S. - Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, January 29th, I'm sharing one of my best AI Projects: Time Series Forecasting with AI Register here (1570+ registered):

Matt Dancho (Business Science)

242,084 görüntüleme • 1 yıl önce

I'm excited to introduce my AI Machine Learning Agent that built 32 ML models in 30 seconds. Today, I'll share with you how to automate building 100s of ML models with the AI ML Agent, which is available on GitHub. We'll create an ML Agent focusing on a Customer Churn Problem. I'll guide you through setting up the ML Agent, creating dozens of ML models, and loading the best model for production. This AI is a huge time-saver! Table of Contents: 00:00 Introduction to my AI Data Science Team 02:56 Setting Up AI Data Science Team 04:48 Running the ML Agent Code 07:12 Create (and Run) the AI Machine Learning Agent 09:53 Reviewing ML Model Summary 12:00 Saving and Loading Models 13:00 Next Steps + Project Roadmap + AI Bootcamp Github to AI Data Science Team (Data Science Agents): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: P.S. - Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, May 21st, I'm sharing one of my best AI Projects: AI Customer Segmentation Agent with Python Register here (570+ registered):

I'm excited to introduce my AI Machine Learning Agent that built 32 ML models in 30 seconds. Today, I'll share with you how to automate building 100s of ML models with the AI ML Agent, which is available on GitHub. We'll create an ML Agent focusing on a Customer Churn Problem. I'll guide you through setting up the ML Agent, creating dozens of ML models, and loading the best model for production. This AI is a huge time-saver! Table of Contents: 00:00 Introduction to my AI Data Science Team 02:56 Setting Up AI Data Science Team 04:48 Running the ML Agent Code 07:12 Create (and Run) the AI Machine Learning Agent 09:53 Reviewing ML Model Summary 12:00 Saving and Loading Models 13:00 Next Steps + Project Roadmap + AI Bootcamp Github to AI Data Science Team (Data Science Agents): Get the Code and Future Updates by Joining my Python AI/ML Tips Newsletter: P.S. - Want to learn how to build AI projects companies actually want? (live Python Code) On Wednesday, May 21st, I'm sharing one of my best AI Projects: AI Customer Segmentation Agent with Python Register here (570+ registered):

Matt Dancho (Business Science)

35,452 görüntüleme • 1 yıl önce

You can create an AI Agent that answers your email with a few clicks. 1. Go to ChatLLM ( 2. Click on AI Engineer 3. Select Create an AI Agent 4. Choose the Email Answering Agent ChatLLM will do the rest: it will code, test, and deploy the agent for you. You can also create a custom agent in English. The Agent Economy is coming (somebody should write a book and use this title.) We are going to see examples like this, times 1,000 in 2025. Just think about how many repetitive tasks you perform every day. Some of these tasks are involved enough that we couldn't automate them with pre-AI solutions. That's where we'll see agents explode, and I'm here for it.

You can create an AI Agent that answers your email with a few clicks. 1. Go to ChatLLM ( 2. Click on AI Engineer 3. Select Create an AI Agent 4. Choose the Email Answering Agent ChatLLM will do the rest: it will code, test, and deploy the agent for you. You can also create a custom agent in English. The Agent Economy is coming (somebody should write a book and use this title.) We are going to see examples like this, times 1,000 in 2025. Just think about how many repetitive tasks you perform every day. Some of these tasks are involved enough that we couldn't automate them with pre-AI solutions. That's where we'll see agents explode, and I'm here for it.

Santiago

79,974 görüntüleme • 1 yıl önce

We ran an SLM fully on an Apple Watch! (the first watch app ever to ship intelligence built into it) My team is obsessed with the question "how small can models go and still be useful?" So Shahir trained a custom model which takes advantage of Apple's Neural Engine hidden inside every Apple Watch. Full autoregressive decoding, close to 30 TPS, ON YOUR WRIST (Series 9)!! 75MB package = 70M param model. Use-Cases? purposefully fine tuning this model to get personal context, health data, run a tiny agent agent for some automation etc. This is exactly what will we be doing next! "Watch out" :P (Also sabesh 📟 exploring alt career options as a hand model)

We ran an SLM fully on an Apple Watch! (the first watch app ever to ship intelligence built into it) My team is obsessed with the question "how small can models go and still be useful?" So Shahir trained a custom model which takes advantage of Apple's Neural Engine hidden inside every Apple Watch. Full autoregressive decoding, close to 30 TPS, ON YOUR WRIST (Series 9)!! 75MB package = 70M param model. Use-Cases? purposefully fine tuning this model to get personal context, health data, run a tiny agent agent for some automation etc. This is exactly what will we be doing next! "Watch out" :P (Also sabesh 📟 exploring alt career options as a hand model)

Kautuk | Conscious Engines

43,522 görüntüleme • 16 gün önce

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 görüntüleme • 2 yıl önce

I made this $700,000,000 music video in an afternoon on part of my weed budget. No, this is not 100% AI. I wrote the song, Through The Tempest, and recorded the samples which were then layered and mixed into the song. I curated the custom styling by running thousands of images of my own art to make a custom model. That model was then iterated dozens of times to fine tune details into new models. Then from the final model I ran dozens of images to animate with the help of AI. All of this to create something I'm going to be projecting later tonight downtown bringing all of this work into the real world. Enjoy.

I made this $700,000,000 music video in an afternoon on part of my weed budget. No, this is not 100% AI. I wrote the song, Through The Tempest, and recorded the samples which were then layered and mixed into the song. I curated the custom styling by running thousands of images of my own art to make a custom model. That model was then iterated dozens of times to fine tune details into new models. Then from the final model I ran dozens of images to animate with the help of AI. All of this to create something I'm going to be projecting later tonight downtown bringing all of this work into the real world. Enjoy.

𝔹𝕃𝕍ℂ𝕂𝕃!𝔾ℍ𝕋

24,054 görüntüleme • 6 ay önce

Choose a model (any model) and build your application with it. Do not spend time swapping models early on. Do not try to optimize before you have a working system. This is one of the first recommendations I make to every new team I consult with. Eventually, it will be time to optimize the model. • You may need a cheaper model • You may need a faster model • You might need a smarter model Good luck if you stitched together 12 different APIs and SDKs from 7 different vendors. Over half of the companies I consult for run on Microsoft software and have access to Microsoft Foundry. Microsoft Foundry is a complete agentic ecosystem. If you're in that world and building AI applications, Microsoft Foundry is where everything lives: • Models (largest selection in the market) • Agentic SDK (Python, C#, JavaScript/TypeScript) • Tools • Evaluations • Monitoring They are fully integrated with GitHub and Visual Studio Code. The best part: Their agentic platform is fully agnostic of the models you use. You can integrate with any model using the same OpenAI-style API. Swapping one model for another takes 1 second.

Choose a model (any model) and build your application with it. Do not spend time swapping models early on. Do not try to optimize before you have a working system. This is one of the first recommendations I make to every new team I consult with. Eventually, it will be time to optimize the model. • You may need a cheaper model • You may need a faster model • You might need a smarter model Good luck if you stitched together 12 different APIs and SDKs from 7 different vendors. Over half of the companies I consult for run on Microsoft software and have access to Microsoft Foundry. Microsoft Foundry is a complete agentic ecosystem. If you're in that world and building AI applications, Microsoft Foundry is where everything lives: • Models (largest selection in the market) • Agentic SDK (Python, C#, JavaScript/TypeScript) • Tools • Evaluations • Monitoring They are fully integrated with GitHub and Visual Studio Code. The best part: Their agentic platform is fully agnostic of the models you use. You can integrate with any model using the same OpenAI-style API. Swapping one model for another takes 1 second.

Santiago

12,014 görüntüleme • 6 ay önce

This is the fastest I've seen Llama 3.3 running anywhere! Llama 3.3 70B running at 652 t/s is lightning fast. And if you want Llama 3.1, here are the speeds I was able to get: • Llama 3.1 8B: 1006 t/s • Llama 3.1 70B: 709 t/s • Llama 3.1 405B: 206 t/s (You can access all of these models for free! See the link below.) This speed is incredible, but the interesting part is what's happening behind the scenes: These models aren't running on a GPU! In this video, I'm using the SambaNova cloud to access these models. They built a custom chip (SN40L) optimized for AI workflows. A single SN40L chip can hold hundreds of models (trillions of parameters) in memory! The speed alone is a huge deal, but the big advantage is for agentic workflows running multiple specialized models. A GPU can only host a single model and switch (unload and load) to a different model if necessary. An SN40L, on the other hand, can host every model at once, making it much faster. Here is the video where you can see how fast these chips are:

This is the fastest I've seen Llama 3.3 running anywhere! Llama 3.3 70B running at 652 t/s is lightning fast. And if you want Llama 3.1, here are the speeds I was able to get: • Llama 3.1 8B: 1006 t/s • Llama 3.1 70B: 709 t/s • Llama 3.1 405B: 206 t/s (You can access all of these models for free! See the link below.) This speed is incredible, but the interesting part is what's happening behind the scenes: These models aren't running on a GPU! In this video, I'm using the SambaNova cloud to access these models. They built a custom chip (SN40L) optimized for AI workflows. A single SN40L chip can hold hundreds of models (trillions of parameters) in memory! The speed alone is a huge deal, but the big advantage is for agentic workflows running multiple specialized models. A GPU can only host a single model and switch (unload and load) to a different model if necessary. An SN40L, on the other hand, can host every model at once, making it much faster. Here is the video where you can see how fast these chips are:

Santiago

97,543 görüntüleme • 1 yıl önce

Project Launch 🚀: mukh v0.1.14 - The Face Analysis Library Hello Everyone, I am happy to launch my first python package "mukh". Mukh (मुख, meaning "face" in Sanskrit) is a comprehensive face analysis library that provides unified APIs for various face-related tasks. It simplifies the process of working with multiple face analysis models through a consistent interface. --- 📌 Features: 🥸 DeepFake Detector: First Python package featuring an Ensemble of multiple models 🎯 Unified API: Single, consistent API for multiple face analysis tasks like face detection and reenactment 🔄 Model Flexibility: Support for multiple models per task 🛠️ Custom Pipelines: Optimized preprocessing and model combinations --- 📌 Currently Supported Tasks: 1️⃣ Face Detection 2️⃣ Face Reenactment with Source Image and Driving Video 3️⃣ Deepfake Detection for Image and Video 4️⃣ Deepfake Detection Pipeline - Ensemble of multiple models --- 📌 Open Source Contributions: I am opening up multiple tasks in the issues section of mukh including a bunch of `good-first-issues`. My goal is to help a number of beginners get started with their contributions, I will be personally guiding across completing these tasks so keep a check on the issues section. The link to the GitHub repository and detailed documentation is available below 👇 in the reply section, do give it a ⭐️ to support the project! --- Special Mentions in the video: Ayush Chaurasia adi unni hsr hacker house Nimisha Chanda @ElonMastikhor Ctrl+Vibe

Project Launch 🚀: mukh v0.1.14 - The Face Analysis Library Hello Everyone, I am happy to launch my first python package "mukh". Mukh (मुख, meaning "face" in Sanskrit) is a comprehensive face analysis library that provides unified APIs for various face-related tasks. It simplifies the process of working with multiple face analysis models through a consistent interface. --- 📌 Features: 🥸 DeepFake Detector: First Python package featuring an Ensemble of multiple models 🎯 Unified API: Single, consistent API for multiple face analysis tasks like face detection and reenactment 🔄 Model Flexibility: Support for multiple models per task 🛠️ Custom Pipelines: Optimized preprocessing and model combinations --- 📌 Currently Supported Tasks: 1️⃣ Face Detection 2️⃣ Face Reenactment with Source Image and Driving Video 3️⃣ Deepfake Detection for Image and Video 4️⃣ Deepfake Detection Pipeline - Ensemble of multiple models --- 📌 Open Source Contributions: I am opening up multiple tasks in the issues section of mukh including a bunch of `good-first-issues`. My goal is to help a number of beginners get started with their contributions, I will be personally guiding across completing these tasks so keep a check on the issues section. The link to the GitHub repository and detailed documentation is available below 👇 in the reply section, do give it a ⭐️ to support the project! --- Special Mentions in the video: Ayush Chaurasia adi unni hsr hacker house Nimisha Chanda @ElonMastikhor Ctrl+Vibe

Ishan Dutta

13,954 görüntüleme • 1 yıl önce