正在加载视频...
视频加载失败
When doing machine learning and AI research (or writing books), making the code reproducible is usually desirable. Often, that's easier said than done! So, I recorded a video illustrating and dealing with 6 sources of randomness that occur when training deep neural networks and LLMs: 1. Model weight initialization... show more
6 条评论

If you prefer, here is a YouTube version that includes chapter marks:

Maybe a real solution is to consider a probability of a model state (weights) instead of actual numerical values of the state. The optimization process is random by def, e.g. with Langevin dynamics based methods. But when lr decays the final state is the same with very high prob.

I like this idea, and it kind of is what Baysian neural networks do? But for those who prefer certain huge models due to the good predictive performance, e.g. vision and language transformers, this would probably not be feasible, I'd say.

Great Video. Nice explanations. Thanks for that!

Thank you for sharing this video! I'm equally excited for reading your new book too.

Fun fact: it's basically based on chapter 10 :)

![I have been working in AI and ML for over 8 years and have read more than 20 books in this field. These are the 7 books I would recommend if you want to build strong foundations and eventually work on real production AI systems. Not because they are popular. Because they teach concepts that remain useful even when frameworks and tools change. And the 7th book is the most important one. Today, understanding models is not enough. You also need to know how to turn an AI idea into a real application that people can actually use. Watch until the end, save this list, and start with the book that matches your biggest skill gap. . . . [AI Engineering, Machine Learning Engineering, AI Books, Machine Learning Books, AI Engineer Roadmap, ML Engineer Roadmap, Artificial Intelligence, Machine Learning, Deep Learning, Generative AI, Large Language Models, LLM, MLOps, LLMOps, Production AI, AI Systems, AI Infrastructure, System Design, Python, FastAPI, Backend Engineering, AI Applications, AI Agents, RAG, Model Evaluation, AI Learning, Learn AI, Learn Machine Learning, Tech Books, Engineering Books, Career in AI, AI Education] #llm #machinelearning #datascience #study](https://ttanon.com/i/c/7657982535732972832-720.webp)