Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

👨🏻‍💻 LLM Engineer Toolkit - Collection of 120+ LLM Libraries Category Wise LLM Engineer Toolkit repository contains a curated list of 120+ LLM libraries category wise. 🚀 LLM Training 🧱 LLM Application Development 🩸LLM RAG 🟩 LLM Inference 🚧 LLM Serving 📤 LLM Data Extraction 🌠 LLM Data Generation... show more

Kalyan KS

3,674 subscribers

16,746 просмотров • 1 год назад •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

Комментарии: 5

Фото профиля Shivansh Fulper

Shivansh Fulper1 год назад

Super helpful...

Фото профиля Kalyan KS

Kalyan KS1 год назад

Thanks.

Фото профиля Alexander Myasoedov

Alexander Myasoedov1 год назад

INTRODUCING: Agentic Security - LLM Security Scanner! 🔍 🔑 Features: Scans for prompt injections, jailbreaking & more. Provides detailed reports & options to customize attack rules. 🔗access the GitHub Link ↓

Фото профиля The Tech Arch

The Tech Arch1 год назад

Nice consolidation, thanks for sharing

Фото профиля PointlessAI

PointlessAI1 год назад

Very handy. Thanks!

Похожие видео

Met a guy making $1.6 million/year as an LLM engineer. I asked him how he learned LLMs from scratch. He sent me the exact video that got him in. A 1 hour course on how LLMs actually work. He shows how transformers inside LLMs like ChatGPT & Claude are actually built. I watched it last night. Halfway through, I realized LLM architecture is way simpler than they make it look. Bookmark this and read the article below. • 00:00 - LLM foundations • 04:21 - LLM tokenization • 05:43 - LLMs vector embeddings • 22:16 - attention mechanism of LLM • 43:42 - LLM multi head attention

Met a guy making $1.6 million/year as an LLM engineer. I asked him how he learned LLMs from scratch. He sent me the exact video that got him in. A 1 hour course on how LLMs actually work. He shows how transformers inside LLMs like ChatGPT & Claude are actually built. I watched it last night. Halfway through, I realized LLM architecture is way simpler than they make it look. Bookmark this and read the article below. • 00:00 - LLM foundations • 04:21 - LLM tokenization • 05:43 - LLMs vector embeddings • 22:16 - attention mechanism of LLM • 43:42 - LLM multi head attention

Roan

80,650 просмотров • 22 дней назад

Robotics in the age of FMs, cloud and Starlink. We've been rethinking robot AI — cloud-first, LLM-first approach. Fast to deploy. Modular. Data-centric. Built for long-horizon reasoning. Paper: Blog: 🧵 #Robotics #AI #LLM #VLM

Robotics in the age of FMs, cloud and Starlink. We've been rethinking robot AI — cloud-first, LLM-first approach. Fast to deploy. Modular. Data-centric. Built for long-horizon reasoning. Paper: Blog: 🧵 #Robotics #AI #LLM #VLM

Ashish Kapoor

10,183 просмотров • 10 месяцев назад

New short course on LLMOps! LLMOps (large language model operations) is a rapidly developing field that takes ideas from MLOps (machine learning operations) and specializes them to building and deploying LLM-based applications. In this course, taught by Google Cloud's Erwin Huizenga, you'll learn to use automation to make building, tuning and deploying an LLM-based application less manual and more efficient. You'll learn how to: - Apply supervised fine-tuning to tune an LLM to a specific task - Automate and orchestrate LLM-tuning and deployment by customizing a pre-built tuning pipeline - Apply best practices for preparing training data for supervised fine-tuning of an LLM - Create an LLMOps workflow you can adapt to other LLM-tuning jobs This course doesn't assume any prior MLOps or LLMOps experience. Sign up here to learn about this emerging field!

New short course on LLMOps! LLMOps (large language model operations) is a rapidly developing field that takes ideas from MLOps (machine learning operations) and specializes them to building and deploying LLM-based applications. In this course, taught by Google Cloud's Erwin Huizenga, you'll learn to use automation to make building, tuning and deploying an LLM-based application less manual and more efficient. You'll learn how to: - Apply supervised fine-tuning to tune an LLM to a specific task - Automate and orchestrate LLM-tuning and deployment by customizing a pre-built tuning pipeline - Apply best practices for preparing training data for supervised fine-tuning of an LLM - Create an LLMOps workflow you can adapt to other LLM-tuning jobs This course doesn't assume any prior MLOps or LLMOps experience. Sign up here to learn about this emerging field!

Andrew Ng

221,803 просмотров • 2 лет назад

📢Excited to release GoEx⚡️a runtime for LLM-generated actions like code, API calls, and more. Featuring "post-facto validation" for assessing LLM actions after execution 🔍 Key to our approach is "undo" 🔄 and "damage confinement" abstractions to manage unintended actions & risks. This paves the way for fully autonomous LLM agents, enhancing interaction between apps & services with human-out-of-loop🚀 Blog: Code: Paper:

📢Excited to release GoEx⚡️a runtime for LLM-generated actions like code, API calls, and more. Featuring "post-facto validation" for assessing LLM actions after execution 🔍 Key to our approach is "undo" 🔄 and "damage confinement" abstractions to manage unintended actions & risks. This paves the way for fully autonomous LLM agents, enhancing interaction between apps & services with human-out-of-loop🚀 Blog: Code: Paper:

Shishir Patil

58,071 просмотров • 2 лет назад

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to *million-scale* with *dense grounding*. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to million-scale with dense grounding. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI

Jianing “Jed” Yang

27,626 просмотров • 2 лет назад

i'm a little sick of chatgpt giving me obviously broken code i've found a "micro agent" approach to LLM code generation can work much better the LLM first generates a *test*, and then enters a loop where it generates and iterates on the code until the tests pass source below

i'm a little sick of chatgpt giving me obviously broken code i've found a "micro agent" approach to LLM code generation can work much better the LLM first generates a test, and then enters a loop where it generates and iterates on the code until the tests pass source below

Steve (Builder.io)

544,212 просмотров • 2 лет назад

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic 🚀 Complete video: Code: I explain how to get structured JSON output with LlamaIndex and dynamic Pydantic class. This helps to implement the use case of data extraction from invoice documents. The solution runs on the local machine, thanks to Ollama. I'm using a MacBook Air M1 with 8GB RAM. LlamaIndex 🦙 Pydantic ollama #Python #LLM #RAG

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic 🚀 Complete video: Code: I explain how to get structured JSON output with LlamaIndex and dynamic Pydantic class. This helps to implement the use case of data extraction from invoice documents. The solution runs on the local machine, thanks to Ollama. I'm using a MacBook Air M1 with 8GB RAM. LlamaIndex 🦙 Pydantic ollama #Python #LLM #RAG

Andrej Baranovskij

147,949 просмотров • 2 лет назад

Another example of the multiple TTS parallel pipelines pattern. Here's a voice AI agent that speaks both English and Arabic, using a specific model/voice for each language. These are PlayAI voices. The STT, TTS, and LLM inference is all running on Groq Inc. (The LLM is LLama 4 Maverick.)

Another example of the multiple TTS parallel pipelines pattern. Here's a voice AI agent that speaks both English and Arabic, using a specific model/voice for each language. These are PlayAI voices. The STT, TTS, and LLM inference is all running on Groq Inc. (The LLM is LLama 4 Maverick.)

kwindla

13,401 просмотров • 1 год назад

Hedera = AI’s trust layer. Why? 🧠 LLM data provenance 🔐 Verifiable models 📦 Auditable outputs ⚖️ Enforceable ethics Mance Harmon said it. Hedera does it. Fast. Final. Trustless.

Hedera = AI’s trust layer. Why? 🧠 LLM data provenance 🔐 Verifiable models 📦 Auditable outputs ⚖️ Enforceable ethics Mance Harmon said it. Hedera does it. Fast. Final. Trustless.

Hedera

31,956 просмотров • 1 год назад

Structured Output from Multipage PDF with Sparrow (Qwen2 Vision LLM and MLX) I explain how multipage PDFs are handled in Sparrow to extract structured data in a single call.

Structured Output from Multipage PDF with Sparrow (Qwen2 Vision LLM and MLX) I explain how multipage PDFs are handled in Sparrow to extract structured data in a single call.

Andrej Baranovskij

30,659 просмотров • 1 год назад

#M5StackNew 🎉LLM-8850 Kit (4G) Released LLM-8850 Kit is a high-performance AI accelerator kit designed for edge AI and embedded computing scenarios. It consists of the LLM-8850 Card AI accelerator card, which is based on #Axera AX8850 SoC, and the LLM-8850 PiHat adapter board, enabling the Raspberry Pi platform to easily integrate high-compute AI acceleration and rapidly build compact, efficient edge intelligence systems. This is 4GB memory version of the LLM-8850 Kit. ✨Features ✅Ultra-compact form factor: M.2 M-Key 2242 size & High-performance NPU: 24 TOPS @ INT8, octa-core Cortex‑A55 1.7 GHz CPU ✅Memory: 4GB 64‑bit LPDDR4x, 4266 Mbps (2+2) ✅Hardware video engine: 8 K @ 30 fps H.264/H.265 encoding, 8 K @ 30 fps decoding, supports 16-channel 1080P parallel decoding ✅Secure boot & encryption: AES / DES / 3DES / SHA‑256 hardware security module ✅Native AXCL: one-click execution of full-stack models including CNN, Transformer, CLIP, Whisper, Llama3.2, Qwen3, InternVL3, etc., supports simultaneous H.264/H.265 encode/decode transcoding 🛒 Get Yours: Shopify: AliExpress: #M5Stack #IoT #M5StackNew #RaspberryPi #Axera #EdgeAI #AIAcceleration #LLM #MachineLearning #Hardware #Makers #EmbeddedSystems

#M5StackNew 🎉LLM-8850 Kit (4G) Released LLM-8850 Kit is a high-performance AI accelerator kit designed for edge AI and embedded computing scenarios. It consists of the LLM-8850 Card AI accelerator card, which is based on #Axera AX8850 SoC, and the LLM-8850 PiHat adapter board, enabling the Raspberry Pi platform to easily integrate high-compute AI acceleration and rapidly build compact, efficient edge intelligence systems. This is 4GB memory version of the LLM-8850 Kit. ✨Features ✅Ultra-compact form factor: M.2 M-Key 2242 size & High-performance NPU: 24 TOPS @ INT8, octa-core Cortex‑A55 1.7 GHz CPU ✅Memory: 4GB 64‑bit LPDDR4x, 4266 Mbps (2+2) ✅Hardware video engine: 8 K @ 30 fps H.264/H.265 encoding, 8 K @ 30 fps decoding, supports 16-channel 1080P parallel decoding ✅Secure boot & encryption: AES / DES / 3DES / SHA‑256 hardware security module ✅Native AXCL: one-click execution of full-stack models including CNN, Transformer, CLIP, Whisper, Llama3.2, Qwen3, InternVL3, etc., supports simultaneous H.264/H.265 encode/decode transcoding 🛒 Get Yours: Shopify: AliExpress: #M5Stack #IoT #M5StackNew #RaspberryPi #Axera #EdgeAI #AIAcceleration #LLM #MachineLearning #Hardware #Makers #EmbeddedSystems

M5Stack

11,024 просмотров • 2 месяцев назад

This is a trillion-dollar industry, and you can't solve it with an LLM: • Forecasting • Fraud detection • Churn prediction Large Language Models are fundamentally bad at solving these problems. When you feed structured data into an LLM, it doesn't see relationships, and it treats every number, date, and foreign key as a token. That's why you always get garbage back. An LLM thinks your database is a Wikipedia article. It doesn't understand its structure or its relationships. GPT-4 scores 63% on relational prediction tasks. That's the best it can do, and that's pretty much useless. You can't expect real-world business value to come from summarizing Wikipedia articles.

This is a trillion-dollar industry, and you can't solve it with an LLM: • Forecasting • Fraud detection • Churn prediction Large Language Models are fundamentally bad at solving these problems. When you feed structured data into an LLM, it doesn't see relationships, and it treats every number, date, and foreign key as a token. That's why you always get garbage back. An LLM thinks your database is a Wikipedia article. It doesn't understand its structure or its relationships. GPT-4 scores 63% on relational prediction tasks. That's the best it can do, and that's pretty much useless. You can't expect real-world business value to come from summarizing Wikipedia articles.

Santiago

94,701 просмотров • 4 месяцев назад

Learn how to build an optimized LLM inference system from the ground up in our new short course, Efficiently Serving LLMs, built in collaboration with Predibase by Rubrik and taught by Travis Addair. Whether you're serving your own LLM or using a model hosting service, this course will give you a deep understanding of the optimizations required to efficiently serve many users at once. - Learn how LLMs generate text one token at a time, and how techniques like KV caching, continuous batching, and quantization speed things up and optimize memory usage for serving multiple users. - Benchmark the performance of these LLM optimizations to explore the trade-offs between quickly responding to an individual user’s request vs. serving many users at once. - Use techniques like low-rank adaptation (LoRA) to efficiently serve hundreds of unique, custom fine-tuned models on a single device, without sacrificing throughput. - Use Predibase's LoRAX framework to see optimization techniques in action on a real LLM server. Sign up here:

Learn how to build an optimized LLM inference system from the ground up in our new short course, Efficiently Serving LLMs, built in collaboration with Predibase by Rubrik and taught by Travis Addair. Whether you're serving your own LLM or using a model hosting service, this course will give you a deep understanding of the optimizations required to efficiently serve many users at once. - Learn how LLMs generate text one token at a time, and how techniques like KV caching, continuous batching, and quantization speed things up and optimize memory usage for serving multiple users. - Benchmark the performance of these LLM optimizations to explore the trade-offs between quickly responding to an individual user’s request vs. serving many users at once. - Use techniques like low-rank adaptation (LoRA) to efficiently serve hundreds of unique, custom fine-tuned models on a single device, without sacrificing throughput. - Use Predibase's LoRAX framework to see optimization techniques in action on a real LLM server. Sign up here:

Andrew Ng

104,727 просмотров • 2 лет назад

Announcing Talkie: a new, open-weight historical LLM! We trained and finetuned a 13B model on a newly-curated dataset of only pre-1930 data. Try it below! with Alec Radford and Nick Levine 🧵

Announcing Talkie: a new, open-weight historical LLM! We trained and finetuned a 13B model on a newly-curated dataset of only pre-1930 data. Try it below! with Alec Radford and Nick Levine 🧵

David Duvenaud

1,462,772 просмотров • 3 месяцев назад

AIP Evolve — our new product for making agents more efficient and cost effective. See how Chad and Colton used it to autonomously swap models, tune prompts, validate outputs, and find structured ontology data that eliminated 2 LLM calls; cutting compute costs while improving accuracy and reliability in production.

AIP Evolve — our new product for making agents more efficient and cost effective. See how Chad and Colton used it to autonomously swap models, tune prompts, validate outputs, and find structured ontology data that eliminated 2 LLM calls; cutting compute costs while improving accuracy and reliability in production.

Palantir

159,367 просмотров • 2 месяцев назад

Right now, when you send a query to an LLM, it gets decrypted on the server. The LLM sees your data in plain text. Prof. Ajay Joshi (BU, CipherSonic AI ) on fully homomorphic encryption, which may be key for the future of AI privacy: how we can compute on data without ever decrypting it. The catch: it's a brutally memory-bound workload. Exactly the bottleneck wafer-scale was built to solve.

Right now, when you send a query to an LLM, it gets decrypted on the server. The LLM sees your data in plain text. Prof. Ajay Joshi (BU, CipherSonic AI ) on fully homomorphic encryption, which may be key for the future of AI privacy: how we can compute on data without ever decrypting it. The catch: it's a brutally memory-bound workload. Exactly the bottleneck wafer-scale was built to solve.

Cerebras

293,561 просмотров • 1 месяц назад