Loading video...

Video Failed to Load

Go Home

25 algorithms every programmer should know: Let's start with my top favorite 10. If nothing else, you should read about these algorithms and have a good idea of how they work: 1. Linear search to find an element in a list 2. Binary search to find an element on...

273,905 views • 2 years ago •via X (Twitter)

9 Comments

John Crickett's profile picture
John Crickett2 years ago

99% of programmers will never write one of this professionally. Ironically the ones I have done aren't on this list.

Santiago's profile picture
Santiago2 years ago

They won't. But the usefulness of learning these algorithms is not to write them later. That's the argument I make in the video.

Raul Junco's profile picture
Raul Junco2 years ago

The main benefit of understanding algorithms is the skills you learn to solve problems efficiently and effectively.

Byron Goodman's profile picture
Byron Goodman2 years ago

I've never implemented DFS except in college, and graduate school. I have implemented A* and variations (BFS) many, many times. The problem with DFS is incomplete graphs and the bias introduced. A* requires more memory in comparison, but memory is cheap. Dijkstra's algorithm is basically A* so you can take that one off as well.

Calc Consulting's profile picture
Calc Consulting2 years ago

21 Every algorithm related to neural networks 😂

Santiago's profile picture
Santiago2 years ago

Yup :)

Edward Manda's profile picture
Edward Manda2 years ago

What’s the name of the book 📖?

Anirudh Sharma's profile picture
Anirudh Sharma2 years ago

Learning algorithms is not only useful for interviews but also beneficial for becoming a better problem solver.

inner voice priv/acc's profile picture
inner voice priv/acc2 years ago

Seriously! 📺 vids!

Related Videos

Experiments in progress. The one on the right has been learning for ~3 hours, the one in the middle for ~1 hour, and the one on the left just started a few minutes ago. The initial motivation for making the physical Atari was just to commit ourselves to a subset of algorithms that can make progress in this setup. This commitment rules out algorithms that require billions of samples to learn (or worse, require multiple environments running in parallel). Atari games are simple enough that we should be able to show learning on them in a short amount of time with no prior knowledge. Since then, I've realized that this setup is also a good way to compare different paradigms in robotics in a principled way. These paradigms are sim2real, learning from tele-operated data, and learning directly on the robots. So far, I have observed that getting sim2real to work reliably is hard. It requires tweaks that don't scale. Policies that can play perfectly in simulation fall apart because of latencies and the messiness of the real world. These aspects could be modeled to improve the simulation, but not without sinking significant human engineering hours. I have higher hopes for learning from tele-operated data, but that requires a human to learn the task first. These experiments are on my to-do list. I have to learn to play some of the games well through the robot. I’m half-decent at playing Pong and Ms Pacman now. Learning directly on robots is looking like the most promising approach. This approach takes away pesky distribution shifts and makes it possible to have algorithms that continually improve with more data and time without any human intervention. It feels great to let experiments run overnight and wake up to find improved policies. With learning on robots, I should, in principle, be able to go on a long vacation and come back to find better policies for complex tasks beyond Atari games. Whether that is possible with current learning algorithms is a different question.

Khurram Javed

52,110 views • 8 months ago

a playlist of 30 youtube videos to learn machine learning fundamentals from scratch if you're struggling on where to start learning ML, this list goes this "Machine Learning: Teach by Doing" is a solid choice to learn both theory and code. (1) Introduction to Machine Learning Teach by Doing: (2) What is Machine Learning? History of Machine Learning: (3) Types of ML Models: (4) 6 steps of any ML project: (5) Install Python and VSCode and run your first code: (6) Linear Classifiers Part 1: (7) Linear Classifiers Part 2: (8) Jupyter Notebook, Numpy and Scikit-Learn: (9) Running the Random Linear Classifier Algorithm in Python: (10) The oldest ML model - Perceptron: (11) Coding the Perceptron: (12) Perceptron Convergence Theorem: (13) Magic of features in Machine Learning: (14) One hot encoding: (15) Logistic Regression Part 1: (16) Cross Entropy Loss: (17) How gradient descent works: (18) Logistic Regression from scratch in Python: (19) Introduction to Regularization: (20) Implementing Regularization in Python: (21) Linear Regression Introduction: (22) Ordinary Least Squares step by step implementation: (23) Ridge regression fundamentals and intuition: (24) Regression recap for interviews: (25) Neural network architecture in 30 minutes: (26) Backpropagation intuition: (27) Neural network activation functions: (28) Momentum in gradient descent: (29) Hands on neural network training in Python: (30) Introduction to Convolutional Neural Networks (CNNs):

ℏεsam

117,570 views • 1 year ago

I had a fantastic time discussing with the learning legend Justin Skycak from Math Academy about learning math in the modern age. we've talked about his quite impressive self-learning journey (3000h of math in high school) all the way to how he hand curated the initial knowledge graph for math academy to make that process more efficient. great lively 3h discussion here are the chapters: 0:00:00 - intro: 0:02:10 - justin background 0:05:45 - 3000h math self study in high school 0:11:45 - what a day looked like for that 3000h stretch 0:16:10 - meta-learning vs pure math learning 0:21:50 - when did you get into cognitive neuro? 0:29:55 - how did the fundamental math helped in your research projects 0:43:10 - what does the math academy learning system looks like 0:47:34 - how did you guys build the 2000 topic knowledge graph 1:01:15 - would LLM be useful as an interface to that knowledge graph for the students? 1:10:46 - how does the FIRe spaced repetition algorithm works? 1:17:34 - does the same knowledge graph structure would work for physics? or other topic?: 1:34:05 - how do you understand the subject vs the curiculum 1:35:50 - is there a connection between studying math and learning a sport? 1:42:00 - do you think in math doing and teaching requires different skills? 1:56:25 - could you get understanding without automaticy? 2:05:35 - do you see any upside of confusion in learning? 2:14:11 - learning math as an adult? 2:19:20 - how to fill the motivation gap after learning the fundamental? 2:24:10 - how should teaching math for kids and adults balance fundamentals and creativity? 2:33:55 - is it ever too late to learn math seriously? 2:46:00 - mastery learning vs ultra learning 2:51:30 - top-down vs bottom-up 2:53:40 - mastery learning for domain without a structured hierarchical structure? 2:56:30 - neurodivergence / adhd for structured math learning? 3:06:20 - amateur mathematician augmented with technology will be able to contribute to research? 3:14:37 - what are you most excited about right now in term of learning enjoy!

Yacine Mahdid

57,320 views • 3 months ago

BOOM: CNN panel EXPLODES when Scott Jennings argues Americans *should* be proud to live in the greatest country on Earth and that it’s the left who hates this country, hate its history, and fear for the future.... “I like it when our leaders talk about a hopeful future. I think that's good for the country. I — I guess I sort of reject the premise of the conversation a little in that, you know, these are somehow dark times and we're living through this uncertain rough patch. I mean, I'm pretty happy, you know, and I think a lot of people are.” “If you looked at the splits [in an NBC News poll] on how people feel about America, the promise of America, if you look at whether they’re proud of their country or not — ,,Gallup has measured this — Republicans and conservatives are proud to be Americans, and it’s Democrats and liberals who are not. And I think if you looked at the splits in that, you’d find — you — you’d find — you’d find — you’d find the two lines on the graph going this way. And honestly, I mean, I think there’s a political movement in this country right now built on telling people that America is rotten at its core. It’s not the Republican ideology.” “The problem is telling you the truth about the numbers?” “I’m not going to give you a break about the math!” “Yeah. I agree. We have we have Democrats cheering for Iran. I totally agree with you. It’s crazy.” “What you’re raising, though, is the issue of — we’re not living in a shared reality. This is the biggest difference today for the rest of the country’s history. And it's hard to have a shared national purpose when you don’t have a shared reality. And so, I think one of the things we're going to have to grapple with as Americans is, you know, how do we have more of a shared reality when it comes to our political [differences]”

Curtis Houck

110,976 views • 3 months ago

STANFORD JUST PUT ITS ENTIRE ARTIFICIAL INTELLIGENCE CURRICULUM ON YOUTUBE FOR FREE. CS221. The same course that produced engineers now running AI labs, building frontier models, and getting paid $500,000 a year at the companies everyone is trying to work for. Most people have never heard of it. The ones who have are not telling you about it. Here is what the course actually covers: Search algorithms. The mathematical foundation behind every AI that finds optimal solutions in complex environments. Constraint satisfaction. How AI reasons through problems with thousands of interdependent variables simultaneously. Markov decision processes. The probabilistic framework behind every AI agent that makes sequential decisions under uncertainty. Machine learning from first principles. Not how to use sklearn. How the math actually works underneath it. Neural networks. Built from the ground up before jumping to applications. Logic and knowledge representation. How AI systems reason about the world formally. Natural language processing. The foundation of everything happening in LLMs right now. Robotics and computer vision. How AI perceives and acts in physical environments. Every concept that powers every AI product you use daily is in this curriculum. Not a surface level overview. The actual mathematics. The actual algorithms. The actual reasoning. This is what separates engineers who build AI from operators who use it. Stanford charged $60,000 a year for students to sit in this classroom. They put the whole thing on YouTube. Bookmark this before you open any other AI resource today. Follow CyrilXBT for more elite resources that build real depth the moment they drop.

CyrilXBT

54,956 views • 3 months ago

At the BNB Chain hackathon, CZ 🔶 BNB made several very important points about AI trading (Everything in parentheses is my own view and judgment.) He first said that AI will be involved in trading everywhere. Trading itself is already a huge market: there are 300 million users on Binance alone, and if you add the decentralized ecosystems, that number is not small either. In such a mass-market environment, many different trading strategies can work, with countless different coins, different projects, and different ways to play. But there is a big problem here: building commercial AI trading platforms for retail users is actually very hard. If a trading strategy works very well for one person, once a billion people start using the same strategy, that strategy “might still work, or might stop working.” Take copy trading / follow trading as an example: if you buy first and everyone follows you, the first buyer will perform very well, but the last person to follow may not end up with good results. So, with the exact same strategy and the exact same copy logic, the outcomes can be completely different for different people. (On top of that, every strategy also has its own capital capacity limits.) Teams that can really build strong AI are, with high probability, going to trade with their own money. In today’s world, money itself is already somewhat like a “commodity”; many people have a lot of capital, and it’s actually not that hard to raise funds. If you truly have an algorithm that can make a lot of money, it’s not hard to get money and run your own book. There is really only one situation where you would sell this algorithm to mass-market users: for example, if you charge a $10 monthly subscription and can sell it to one million users, then your $10 million monthly subscription revenue is higher than the profit you could make by trading the strategy yourself. (Here this touches one of our earlier theses: as training AI models becomes relatively easier and the supply of models increases, model companies have more incentive to open-source. By analogy, as the production process of trading strategies is increasingly simplified by AI and the supply of strategies explodes, traders will have stronger incentives to monetize by expanding their influence in other words, by “open-sourcing” their strategies.) Of course, CZ did not say that this model can never work. Another path is to build an AI trading platform that lets users tune different AI algorithms, or very easily assemble their own structures and strategies, so that what each person ends up running is different and better tailored to themselves. Some people will make money, some people will lose money, but the platform still has value because it’s very hard for most people to build an AI trading algorithm from scratch. So there are a lot of trade-offs here; it’s not as simple as saying “once AI shows up, everything automatically gets better.” (This is exactly what we presented at the hackathon: you describe your own strategy in natural language, and the AI automatically generates a workflow. The parameters in that workflow, the models used, the logical structure, the APIs it calls, and even the algorithms it invokes are all customizable. The reasons we think workflows are a good way to do this include: controllable execution paths, Lego-like modular nodes, and better visualization that makes it easier for users to build and adjust their workflows.) Finally, his conclusion was very clear: it’s not that AI will definitely make trading better, and it’s not that AI will definitely make things worse. Rather, no matter what, in the future a huge number of people will use AI to trade. This will be a very large field, and whoever can build the best algorithms will make a lot of money.

Tykoo

25,535 views • 7 months ago