Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Course on Matrix Methods in Data Analysis & Signal Processing Machine Learning in Finance represents one of AI's fastest growing applications, leveraging data driven models and algorithms to make financial predictions, manage risks, and automate trading decisions. At the forefront is algorithmic trading (quant trading), where ML models predict... show more

D4rsh🦅

6,796 subscribers

82,499 Aufrufe • vor 10 Monaten •via X (Twitter)

Wissenschaft & Technologie Finanzen

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Spectre AI: Revolutionizing Blockchain Predictions with All-in-One Tools Available on Telegram & Dapp! Unleash the power of machine learning predictions with Spectre Bot! Our cutting-edge AI engine leverages advanced machine learning techniques, including deep learning models like Long Short-Term Memory (LSTM) networks, to provide insightful short-term token forecasts (6h, 12h, 24h, & 48h). Gain a deeper understanding of market sentiment with features like X Bubblemaps, Sentiment Analysis charts, and AI-powered TA Chatbots. Take control of your crypto future with Spectre Bot! Website: Community Telegram: Chart: Roadmap and other links: Spectre AI is part of the Google and NVIDIA Startup Programs. API powered by Bitquery.io ( Bloxy ). #spectre #ai #machinelearning #predictions #google #nvidia #biquery $SPECT

Spectre AI: Revolutionizing Blockchain Predictions with All-in-One Tools Available on Telegram & Dapp! Unleash the power of machine learning predictions with Spectre Bot! Our cutting-edge AI engine leverages advanced machine learning techniques, including deep learning models like Long Short-Term Memory (LSTM) networks, to provide insightful short-term token forecasts (6h, 12h, 24h, & 48h). Gain a deeper understanding of market sentiment with features like X Bubblemaps, Sentiment Analysis charts, and AI-powered TA Chatbots. Take control of your crypto future with Spectre Bot! Website: Community Telegram: Chart: Roadmap and other links: Spectre AI is part of the Google and NVIDIA Startup Programs. API powered by Bitquery.io ( Bloxy ). #spectre #ai #machinelearning #predictions #google #nvidia #biquery $SPECT

SPECTRE AI

107,565 Aufrufe • vor 2 Jahren

💡 Whats the upgrade that our game-changing Trading 🐦 is going to get: Our upgraded trading tools will be built on a foundation of advanced AI technologies and blockchain integrations to deliver a seamless, smarter trading experience. Here’s a glimpse of the tech behind this upgraded trading agent: 1️⃣ Multi-Layer Attention (MLA) - This is the backbone of our AI system, enabling multiple AI agents to work in sync. - It allows the agents to collaborate on tasks like analyzing market trends, identifying token opportunities, and optimizing strategies in real time. - MLA ensures parallel processing of data for better decision-making and faster 2️⃣ Learning and Evolution System - Our AI agents are powered by a self-learning framework that constantly evolves based on market conditions and user behavior. - With every interaction, the system adapts and gets smarter, improving the accuracy of its predictions and strategies. 3️⃣ On-Chain Data Analysis - The AI bots pull data directly from Ethereum and other blockchain networks, giving them real-time access to liquidity pools, token prices, and market activity. - This deep integration ensures precise and timely execution of tasks like token purchases, profit analysis, and cross-chain swaps. 4️⃣ Natural Language Processing (NLP) - NLP models power the bot’s ability to understand your tweets and translate them into complex trading actions. - This ensures an easy-to-use, human-friendly interface that connects your social interactions to advanced trading strategies. 5️⃣ Cloud-Hosted Infrastructure - The AI operates on scalable cloud infrastructure, ensuring 24/7 uptime, fast processing, and the ability to handle large volumes of trades simultaneously.

💡 Whats the upgrade that our game-changing Trading 🐦 is going to get: Our upgraded trading tools will be built on a foundation of advanced AI technologies and blockchain integrations to deliver a seamless, smarter trading experience. Here’s a glimpse of the tech behind this upgraded trading agent: 1️⃣ Multi-Layer Attention (MLA) - This is the backbone of our AI system, enabling multiple AI agents to work in sync. - It allows the agents to collaborate on tasks like analyzing market trends, identifying token opportunities, and optimizing strategies in real time. - MLA ensures parallel processing of data for better decision-making and faster 2️⃣ Learning and Evolution System - Our AI agents are powered by a self-learning framework that constantly evolves based on market conditions and user behavior. - With every interaction, the system adapts and gets smarter, improving the accuracy of its predictions and strategies. 3️⃣ On-Chain Data Analysis - The AI bots pull data directly from Ethereum and other blockchain networks, giving them real-time access to liquidity pools, token prices, and market activity. - This deep integration ensures precise and timely execution of tasks like token purchases, profit analysis, and cross-chain swaps. 4️⃣ Natural Language Processing (NLP) - NLP models power the bot’s ability to understand your tweets and translate them into complex trading actions. - This ensures an easy-to-use, human-friendly interface that connects your social interactions to advanced trading strategies. 5️⃣ Cloud-Hosted Infrastructure - The AI operates on scalable cloud infrastructure, ensuring 24/7 uptime, fast processing, and the ability to handle large volumes of trades simultaneously.

𝕋𝕎𝔼𝔼𝕋

20,354 Aufrufe • vor 1 Jahr

The Bloomberg Terminal of Prediction Markets. Private beta is live with Polymarket and Kalshi, delivering actionable insights for serious traders. - Real-time price tracking - Trading volume & liquidity data - Cross-market arbitrage - Recent trades & top holders - Edge discovery across markets - Graded Buy & Sell Signals Built by seasoned data and analytics veterans, to turn data into a trading advantage, now it’s your turn to test it. Private Beta is live. Like and reply for access.

The Bloomberg Terminal of Prediction Markets. Private beta is live with Polymarket and Kalshi, delivering actionable insights for serious traders. - Real-time price tracking - Trading volume & liquidity data - Cross-market arbitrage - Recent trades & top holders - Edge discovery across markets - Graded Buy & Sell Signals Built by seasoned data and analytics veterans, to turn data into a trading advantage, now it’s your turn to test it. Private Beta is live. Like and reply for access.

Predictefy

63,128 Aufrufe • vor 5 Monaten

Learn to train an LLM with distributed data while ensuring privacy using federated learning in a new two-part short course, Intro to Federated Learning and Federated Fine-tuning of LLMs with Private Data, created with Flower and taught by Daniel J. Beutel and nic lane. Federated learning allows a single model to be trained across multiple devices, such as phones, or multiple organizations, such as hospitals, without the need to share data to a central server. This two-part course gives you an introduction to federated learning, and then teaches you how to fine-tune your large language model with distributed data using Flower Lab’s open source federated learning framework. You’ll learn: - How to use federated learning to train a variety of models, ranging from speech and vision models to LLMs, across distributed data while offering data privacy options to users and organizations. - Privacy Enhancing Technologies like differential privacy (DP), which obscures individual data by adding calibrated noise to query results. - Two variants of differential privacy - Central and Local - and how to choose depending on your use case. - How to measure and decrease bandwidth usage to make federated learning more practical and efficient with techniques like using pre-trained models and Parameter-Efficient Fine-Tuning - How federated LLM fine-tuning reduces the risk of leaking training data. Sign up here!

Learn to train an LLM with distributed data while ensuring privacy using federated learning in a new two-part short course, Intro to Federated Learning and Federated Fine-tuning of LLMs with Private Data, created with Flower and taught by Daniel J. Beutel and nic lane. Federated learning allows a single model to be trained across multiple devices, such as phones, or multiple organizations, such as hospitals, without the need to share data to a central server. This two-part course gives you an introduction to federated learning, and then teaches you how to fine-tune your large language model with distributed data using Flower Lab’s open source federated learning framework. You’ll learn: - How to use federated learning to train a variety of models, ranging from speech and vision models to LLMs, across distributed data while offering data privacy options to users and organizations. - Privacy Enhancing Technologies like differential privacy (DP), which obscures individual data by adding calibrated noise to query results. - Two variants of differential privacy - Central and Local - and how to choose depending on your use case. - How to measure and decrease bandwidth usage to make federated learning more practical and efficient with techniques like using pre-trained models and Parameter-Efficient Fine-Tuning - How federated LLM fine-tuning reduces the risk of leaking training data. Sign up here!

Andrew Ng

64,517 Aufrufe • vor 1 Jahr

The discipline of rational decision-making in uncertain markets. In the chaotic nature of financial markets, emotional decisions are unsustainable. TraderLex provides a hybrid methodology that seamlessly integrates human expertise with data science. Our process leaves nothing to chance: Expert Insight: Our certified Prime Trader team constructs the technical frameworks. Data Validation: Our Data Analyst team validates these scenarios using statistical models. The outcome is high-probability market forecasts mathematically verified and free from subjective interpretation. TraderLex: The Science of Analysis.

The discipline of rational decision-making in uncertain markets. In the chaotic nature of financial markets, emotional decisions are unsustainable. TraderLex provides a hybrid methodology that seamlessly integrates human expertise with data science. Our process leaves nothing to chance: Expert Insight: Our certified Prime Trader team constructs the technical frameworks. Data Validation: Our Data Analyst team validates these scenarios using statistical models. The outcome is high-probability market forecasts mathematically verified and free from subjective interpretation. TraderLex: The Science of Analysis.

TraderLex

18,937 Aufrufe • vor 5 Monaten

Introducing Minara AI - your ultimate AI assistant for digital finance, like having a 24/7 personal CFO. Just ask your questions, get powerful market insights, and turn them into actionable strategies—backed by real-time data. Instantly. Overall, Minara can provides: ✅ Profressional analysis & insights as you need on crypto, stocks, RWA, DeFi,NFTs and more. (Far better than ChatGPT-5 and Grok-4) ✅ 50+ real-time data sources, including on-chain, financial, social and prediction data. ✅ Vibe trading crypto and tokenized stocks in one place. ✅ Create any agentic financial workflow with prompts. ✅ Manage your portfolio and track profit&loss ✅ Financial planning & forecasting (integrating Polymarket) No learning curve. For everyone. Join the waitlist and experience the revolution NOW👇

Introducing Minara AI - your ultimate AI assistant for digital finance, like having a 24/7 personal CFO. Just ask your questions, get powerful market insights, and turn them into actionable strategies—backed by real-time data. Instantly. Overall, Minara can provides: ✅ Profressional analysis & insights as you need on crypto, stocks, RWA, DeFi,NFTs and more. (Far better than ChatGPT-5 and Grok-4) ✅ 50+ real-time data sources, including on-chain, financial, social and prediction data. ✅ Vibe trading crypto and tokenized stocks in one place. ✅ Create any agentic financial workflow with prompts. ✅ Manage your portfolio and track profit&loss ✅ Financial planning & forecasting (integrating Polymarket) No learning curve. For everyone. Join the waitlist and experience the revolution NOW👇

Minara AI

200,507 Aufrufe • vor 9 Monaten

Trading on Velo is now live. Data, news, and trading at

Trading on Velo is now live. Data, news, and trading at

Velo

211,697 Aufrufe • vor 2 Monaten

🚨 CHINA TO MAKE EVERY CHINESE KID AN AI WHIZZ China just made AI training mandatory in schools, starting in first grade. By high school, kids will know how to train models, build neural networks, and do data analysis, while American kids are working on their multiplication tables. They’re adding courses in robotics, machine learning, and even digital ethics for high schoolers. The goal? turn the tables on the West and take control of humanity's future. Source: hyujkrrf on TikTok

🚨 CHINA TO MAKE EVERY CHINESE KID AN AI WHIZZ China just made AI training mandatory in schools, starting in first grade. By high school, kids will know how to train models, build neural networks, and do data analysis, while American kids are working on their multiplication tables. They’re adding courses in robotics, machine learning, and even digital ethics for high schoolers. The goal? turn the tables on the West and take control of humanity's future. Source: hyujkrrf on TikTok

Mario Nawfal

343,638 Aufrufe • vor 9 Monaten

a playlist of 30 youtube videos to learn machine learning fundamentals from scratch if you're struggling on where to start learning ML, this list goes this "Machine Learning: Teach by Doing" is a solid choice to learn both theory and code. (1) Introduction to Machine Learning Teach by Doing: (2) What is Machine Learning? History of Machine Learning: (3) Types of ML Models: (4) 6 steps of any ML project: (5) Install Python and VSCode and run your first code: (6) Linear Classifiers Part 1: (7) Linear Classifiers Part 2: (8) Jupyter Notebook, Numpy and Scikit-Learn: (9) Running the Random Linear Classifier Algorithm in Python: (10) The oldest ML model - Perceptron: (11) Coding the Perceptron: (12) Perceptron Convergence Theorem: (13) Magic of features in Machine Learning: (14) One hot encoding: (15) Logistic Regression Part 1: (16) Cross Entropy Loss: (17) How gradient descent works: (18) Logistic Regression from scratch in Python: (19) Introduction to Regularization: (20) Implementing Regularization in Python: (21) Linear Regression Introduction: (22) Ordinary Least Squares step by step implementation: (23) Ridge regression fundamentals and intuition: (24) Regression recap for interviews: (25) Neural network architecture in 30 minutes: (26) Backpropagation intuition: (27) Neural network activation functions: (28) Momentum in gradient descent: (29) Hands on neural network training in Python: (30) Introduction to Convolutional Neural Networks (CNNs):

a playlist of 30 youtube videos to learn machine learning fundamentals from scratch if you're struggling on where to start learning ML, this list goes this "Machine Learning: Teach by Doing" is a solid choice to learn both theory and code. (1) Introduction to Machine Learning Teach by Doing: (2) What is Machine Learning? History of Machine Learning: (3) Types of ML Models: (4) 6 steps of any ML project: (5) Install Python and VSCode and run your first code: (6) Linear Classifiers Part 1: (7) Linear Classifiers Part 2: (8) Jupyter Notebook, Numpy and Scikit-Learn: (9) Running the Random Linear Classifier Algorithm in Python: (10) The oldest ML model - Perceptron: (11) Coding the Perceptron: (12) Perceptron Convergence Theorem: (13) Magic of features in Machine Learning: (14) One hot encoding: (15) Logistic Regression Part 1: (16) Cross Entropy Loss: (17) How gradient descent works: (18) Logistic Regression from scratch in Python: (19) Introduction to Regularization: (20) Implementing Regularization in Python: (21) Linear Regression Introduction: (22) Ordinary Least Squares step by step implementation: (23) Ridge regression fundamentals and intuition: (24) Regression recap for interviews: (25) Neural network architecture in 30 minutes: (26) Backpropagation intuition: (27) Neural network activation functions: (28) Momentum in gradient descent: (29) Hands on neural network training in Python: (30) Introduction to Convolutional Neural Networks (CNNs):

ℏεsam

117,570 Aufrufe • vor 1 Jahr

if you're struggling on where to start learning ML, here’s a playlist of 30 youtube videos to learn machine learning fundamentals from scratch "Machine Learning: Teach by Doing" is a solid choice to learn both theory and code. (1) Introduction to Machine Learning Teach by Doing: (2) What is Machine Learning? History of Machine Learning: (3) Types of ML Models: (4) 6 steps of any ML project: (5) Install Python and VSCode and run your first code: (6) Linear Classifiers Part 1: (7) Linear Classifiers Part 2: (8) Jupyter Notebook, Numpy and Scikit-Learn: (9) Running the Random Linear Classifier Algorithm in Python: (10) The oldest ML model - Perceptron: (11) Coding the Perceptron: (12) Perceptron Convergence Theorem: (13) Magic of features in Machine Learning: (14) One hot encoding: (15) Logistic Regression Part 1: (16) Cross Entropy Loss: (17) How gradient descent works: (18) Logistic Regression from scratch in Python: (19) Introduction to Regularization: (20) Implementing Regularization in Python: (21) Linear Regression Introduction: (22) Ordinary Least Squares step by step implementation: (23) Ridge regression fundamentals and intuition: (24) Regression recap for interviews: (25) Neural network architecture in 30 minutes: (26) Backpropagation intuition: (27) Neural network activation functions: (28) Momentum in gradient descent: (29) Hands on neural network training in Python: (30) Introduction to Convolutional Neural Networks (CNNs):

if you're struggling on where to start learning ML, here’s a playlist of 30 youtube videos to learn machine learning fundamentals from scratch "Machine Learning: Teach by Doing" is a solid choice to learn both theory and code. (1) Introduction to Machine Learning Teach by Doing: (2) What is Machine Learning? History of Machine Learning: (3) Types of ML Models: (4) 6 steps of any ML project: (5) Install Python and VSCode and run your first code: (6) Linear Classifiers Part 1: (7) Linear Classifiers Part 2: (8) Jupyter Notebook, Numpy and Scikit-Learn: (9) Running the Random Linear Classifier Algorithm in Python: (10) The oldest ML model - Perceptron: (11) Coding the Perceptron: (12) Perceptron Convergence Theorem: (13) Magic of features in Machine Learning: (14) One hot encoding: (15) Logistic Regression Part 1: (16) Cross Entropy Loss: (17) How gradient descent works: (18) Logistic Regression from scratch in Python: (19) Introduction to Regularization: (20) Implementing Regularization in Python: (21) Linear Regression Introduction: (22) Ordinary Least Squares step by step implementation: (23) Ridge regression fundamentals and intuition: (24) Regression recap for interviews: (25) Neural network architecture in 30 minutes: (26) Backpropagation intuition: (27) Neural network activation functions: (28) Momentum in gradient descent: (29) Hands on neural network training in Python: (30) Introduction to Convolutional Neural Networks (CNNs):

ℏεsam

108,861 Aufrufe • vor 1 Jahr

$TAO is tackling the core challenges in machine learning, from optimizing data collection to faster inference, aiming to outperform giants like OpenAI and Microsoft. With a focus on computational efficiency and robust models, the race is on.

$TAO is tackling the core challenges in machine learning, from optimizing data collection to faster inference, aiming to outperform giants like OpenAI and Microsoft. With a focus on computational efficiency and robust models, the race is on.

Grayscale

88,595 Aufrufe • vor 1 Jahr

Quant Finance Trading Assistant Live! Join the Menthor Q team today, at 10am EST as they introduce their new Personal AI Trading Assistant! Trained on real option market data, proprietary quantitative models, and the entire catalog of MenthorQ systems. YouTube Link below!

Quant Finance Trading Assistant Live! Join the Menthor Q team today, at 10am EST as they introduce their new Personal AI Trading Assistant! Trained on real option market data, proprietary quantitative models, and the entire catalog of MenthorQ systems. YouTube Link below!

ₕₐₘₚₜₒₙ

61,483 Aufrufe • vor 7 Monaten

Data preparation! It's crucial for machine learning, and we all hate it. Tools and techniques to reduce this burden? A quick summary of 10 years of R&D on this, from cheap tricks to LLMs and graph neural networks 1/9

Data preparation! It's crucial for machine learning, and we all hate it. Tools and techniques to reduce this burden? A quick summary of 10 years of R&D on this, from cheap tricks to LLMs and graph neural networks 1/9

Gael Varoquaux 🦋

13,748 Aufrufe • vor 1 Jahr

MCT AI Agent Update: We've developed an AI model to forecast memecoin performance using historical data, X sentiment (likes, followers, posts), Rugcheck scores, real-time whale activity, and other in-depth metrics, including trading volume, liquidity patterns, and holders distribution.

MCT AI Agent Update: We've developed an AI model to forecast memecoin performance using historical data, X sentiment (likes, followers, posts), Rugcheck scores, real-time whale activity, and other in-depth metrics, including trading volume, liquidity patterns, and holders distribution.

Chain Alpha

38,948 Aufrufe • vor 1 Jahr

The LLM Data Company creates tooling to write, version, and execute evals for models and agents. They help you measure performance and define rewards for reinforcement learning. Congrats on the launch, Daanish Khazi, Gavin Bains, and Joey Besgen!

The LLM Data Company creates tooling to write, version, and execute evals for models and agents. They help you measure performance and define rewards for reinforcement learning. Congrats on the launch, Daanish Khazi, Gavin Bains, and Joey Besgen!

Y Combinator

17,131 Aufrufe • vor 1 Jahr

Building a machine learning model isn’t just about finding the right algorithm—it’s about the right process. In Machine Learning in Production, Andrew Ng breaks down the iterative loop of model development: training, error analysis, refining hyperparameters, and improving data. Getting to a high test set accuracy is one thing, but aligning your model with real-world business metrics? That’s where the real challenge begins. Learn how to bridge the gap between models and impact:

Building a machine learning model isn’t just about finding the right algorithm—it’s about the right process. In Machine Learning in Production, Andrew Ng breaks down the iterative loop of model development: training, error analysis, refining hyperparameters, and improving data. Getting to a high test set accuracy is one thing, but aligning your model with real-world business metrics? That’s where the real challenge begins. Learn how to bridge the gap between models and impact:

DeepLearning.AI

45,248 Aufrufe • vor 1 Jahr

#Binance AI Token Reports delivers full, data-driven briefs on any token, in just 30 seconds. 🔶 Real-time sentiment analysis 🔶 Powerful data from diverse sources 🔶 Actionable insights tailored to your trading style 👉

#Binance AI Token Reports delivers full, data-driven briefs on any token, in just 30 seconds. 🔶 Real-time sentiment analysis 🔶 Powerful data from diverse sources 🔶 Actionable insights tailored to your trading style 👉

Binance

59,104 Aufrufe • vor 5 Monaten

I made a real-world AI hedge fund team. It has 4 agents: 1 • market data agent 2 • quant agent 3 • risk manager agent 4 • portfolio manager agent You can run all of my code below. No prior coding experience is required. The agents work sequentially, passing messages to the next agent. 1 • Market Data Agent gathers market data and calculates technical signals. 2 • Quant Agent takes market data and generates a buy, sell, or hold signal. 3 • Risk Management Agent takes trading signal and generates a risk signal. 4 • Portfolio Management Agent considers all signals and makes a final trading decision.

I made a real-world AI hedge fund team. It has 4 agents: 1 • market data agent 2 • quant agent 3 • risk manager agent 4 • portfolio manager agent You can run all of my code below. No prior coding experience is required. The agents work sequentially, passing messages to the next agent. 1 • Market Data Agent gathers market data and calculates technical signals. 2 • Quant Agent takes market data and generates a buy, sell, or hold signal. 3 • Risk Management Agent takes trading signal and generates a risk signal. 4 • Portfolio Management Agent considers all signals and makes a final trading decision.

Virat Singh

368,451 Aufrufe • vor 1 Jahr

Foundation models, machine learning, and #AI use cases. In this episode of Smart Talks with IBM hosted by Malcolm Gladwell, IBM Research VP of AI Models explores the future of AI and data platforms like #watsonx with Jacob Goldstein:

Foundation models, machine learning, and #AI use cases. In this episode of Smart Talks with IBM hosted by Malcolm Gladwell, IBM Research VP of AI Models explores the future of AI and data platforms like #watsonx with Jacob Goldstein:

IBM

27,078 Aufrufe • vor 2 Jahren

Today, we're joined by Yejin Choi, professor and senior fellow at Stanford University University in the Computer Science Department and Stanford UniversityHAI. In this conversation, we explore Yejin’s recent work on making small language models reason more effectively. We discuss how high-quality, diverse data plays a central role in closing the intelligence gap between small and large models, and how combining synthetic data generation, imitation learning, and reinforcement learning can unlock stronger reasoning capabilities in smaller models. Yejin explains the risks of homogeneity in model outputs and mode collapse highlighted in her “Artificial Hivemind” paper, and its impacts on human creativity and knowledge. We also discuss her team's novel approaches, including reinforcement learning as a pre-training objective, where models are incentivized to “think” before predicting the next token, and "Prismatic Synthesis," a gradient-based method for generating diverse synthetic math data while filtering overrepresented examples. Additionally, we cover the societal implications of AI and the concept of pluralistic alignment—ensuring AI reflects the diverse norms and values of humanity. Finally, Yejin shares her mission to democratize AI beyond large organizations and offers her predictions for the coming year. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:44 - "Snowball effect" in AI investments 06:58 - Approaches to smaller models 08:58 - Importance of “better data” 14:07 - Imitation learning 18:24 - Artificial Hivemind paper 25:25 - AI risks 27:50 - Spectrum tuning 28:53 - Future of AI on humanity 33:08 - Reasoning in small models 34:58 - Prismatic Synthesis 48:20 - Reinforcement as a Pretraining Objective 55:04 - Pluralistic alignment 1:03:30 - Predictions

Today, we're joined by Yejin Choi, professor and senior fellow at Stanford University University in the Computer Science Department and Stanford UniversityHAI. In this conversation, we explore Yejin’s recent work on making small language models reason more effectively. We discuss how high-quality, diverse data plays a central role in closing the intelligence gap between small and large models, and how combining synthetic data generation, imitation learning, and reinforcement learning can unlock stronger reasoning capabilities in smaller models. Yejin explains the risks of homogeneity in model outputs and mode collapse highlighted in her “Artificial Hivemind” paper, and its impacts on human creativity and knowledge. We also discuss her team's novel approaches, including reinforcement learning as a pre-training objective, where models are incentivized to “think” before predicting the next token, and "Prismatic Synthesis," a gradient-based method for generating diverse synthetic math data while filtering overrepresented examples. Additionally, we cover the societal implications of AI and the concept of pluralistic alignment—ensuring AI reflects the diverse norms and values of humanity. Finally, Yejin shares her mission to democratize AI beyond large organizations and offers her predictions for the coming year. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:44 - "Snowball effect" in AI investments 06:58 - Approaches to smaller models 08:58 - Importance of “better data” 14:07 - Imitation learning 18:24 - Artificial Hivemind paper 25:25 - AI risks 27:50 - Spectrum tuning 28:53 - Future of AI on humanity 33:08 - Reasoning in small models 34:58 - Prismatic Synthesis 48:20 - Reinforcement as a Pretraining Objective 55:04 - Pluralistic alignment 1:03:30 - Predictions

The TWIML AI Podcast

12,141 Aufrufe • vor 4 Monaten