Alex Ker 🔭
@thealexker • 11,832 subscribers
@baseten eng+gtm, early-stage investing | sharing how to apply AI thoughtfully and intentionally | prev: @stanfordhai @bloombergbeta @neurable
Videos
Does GPT understand the world? Here is what Ilya Sutskever, co-founder of OpenAI, says during a discussion with Jensen Huang, CEO of Nvidia: (1) When we train a large neural network to accurately predict the next word in lots of different texts from the internet, the AI is learning a world model. (2) On the surface, it may look like learning correlations in text, but it turns out that to 'just learn' statistical correlations in text, to compress information really well, what the neural network learns is some representation of the process that produced the text. (3) This text is a projection of the world...what the neural network is learning is aspects of the world, of people, of the human conditions, their hopes, dreams, motivations, their interactions...the situations we are in. The neural network learns a compressed, abstract, usable representation." Do you think learning representations = understanding? Are large language models simply stochastic parrots, or are they much more?
Alex Ker 🔭1,367,021 views • 2 years ago
Peter Thiel on AI and jobs: "In a world without growth, everything becomes a zero-sum game." Takeaways: (1) Automation freed people to do other, more productive things. If we had enormous productivity gains and GDP growth, just about everybody would be better off. (2) The challenge is in most sectors, we don't have enough productivity gain. The economy is dominated by service sector jobs, which have stayed stagnant. (3) All trends (including AI) are overrated. Be careful about buzzwords--they are a tell that companies are bluffing and undifferentiated. Underrated companies have no buzzwords and don't fit into any pre-existing categories. Figuring out the correct way to think about things in categories for which we don't even have proper language is critical.
Alex Ker 🔭882,091 views • 2 years ago
![👀 I used OpenAI's Code Interpreter to make Flappy Bird 🐦in 7 minutes: Code Interpreter/GPT-4 for code generation. Pre-existing or AI-generated assets for graphics. --- Here's how to make the game in only 6 steps: (1): Enter the following prompt: "write p5.js code for Flappy Bird where you control a yellow bird continuously flying between a series of green pipes. The bird flaps every time you left click the mouse. If the bird falls to the ground or hits a pipe, you lose. This game goes on infinitely until you lose and you get points the further you go". (2): Use generative AI or existing game assets and spirits. I searched "flappy bird assets" on Google and used the first link, a GitHub repo with pngs from the original Flappy Bird. (3): Use this prompt to link assets to the code: "Please generate the entire file again based on the fact I'm using a unique background, spirits for the bird, and pipes. Here is the list of assets I'm using: [list of file names]." Code Interpreter should modify the code accordingly to include the list of file names. (4) Make an account OpenProcessing -> create a sketch -> paste in the code generated by Code Interpreter -> upload in-game assets from step (2). (5) (Optional) Ask ChatGPT to make changes to improve the in-game experience e.g., adding a high score, restarting the game when the bird dies, etc. Copy the new code into your OpenProcessing sketch and reload the game. (6) If something doesn't work, ask GPT4 to fix it. Copy and paste the error message and ask it to regenerate the code. --- Bonus Tips: - Iteratively test code. Each time you make a change using Code Interpreter, test the updated code by playing the game so you catch new bugs early. - Learn programming by asking questions: "Act as a senior programmer very good at explaining concepts to a beginner. Tell me how gravity works in this game and how you used code to make this happen."Code Interpreter/GPT4 for code generation. Download Pre-existing assets or generate new images for graphics. Excited to see what you make!](https://image.24vids.com/tw-1678801892858556417/ext_tw_video_thumb/1678801683596423169/pu/img/eUKZlT6rmDJJlHGD.jpg)
👀 I used OpenAI's Code Interpreter to make Flappy Bird 🐦in 7 minutes: Code Interpreter/GPT-4 for code generation. Pre-existing or AI-generated assets for graphics. --- Here's how to make the game in only 6 steps: (1): Enter the following prompt: "write p5.js code for Flappy Bird where you control a yellow bird continuously flying between a series of green pipes. The bird flaps every time you left click the mouse. If the bird falls to the ground or hits a pipe, you lose. This game goes on infinitely until you lose and you get points the further you go". (2): Use generative AI or existing game assets and spirits. I searched "flappy bird assets" on Google and used the first link, a GitHub repo with pngs from the original Flappy Bird. (3): Use this prompt to link assets to the code: "Please generate the entire file again based on the fact I'm using a unique background, spirits for the bird, and pipes. Here is the list of assets I'm using: [list of file names]." Code Interpreter should modify the code accordingly to include the list of file names. (4) Make an account OpenProcessing -> create a sketch -> paste in the code generated by Code Interpreter -> upload in-game assets from step (2). (5) (Optional) Ask ChatGPT to make changes to improve the in-game experience e.g., adding a high score, restarting the game when the bird dies, etc. Copy the new code into your OpenProcessing sketch and reload the game. (6) If something doesn't work, ask GPT4 to fix it. Copy and paste the error message and ask it to regenerate the code. --- Bonus Tips: - Iteratively test code. Each time you make a change using Code Interpreter, test the updated code by playing the game so you catch new bugs early. - Learn programming by asking questions: "Act as a senior programmer very good at explaining concepts to a beginner. Tell me how gravity works in this game and how you used code to make this happen."Code Interpreter/GPT4 for code generation. Download Pre-existing assets or generate new images for graphics. Excited to see what you make!
Alex Ker 🔭739,811 views • 2 years ago
Andrej Karpathy is a legendary researcher who helped start OpenAI and created Stanford's first deep learning class. Andrej Karpathy's advice on how to learn AI: (1) 10,000 hours of deliberate practice will make you an expert. You can iterate as you work. Only compare yourself to the past, not to others. (2) Don't worry about making mistakes. You build intuitions on what is useful vs. not useful- they are not dead work. (3) Teach to strengthen your understanding and find gaps in knowledge. Similar to "If you can't explain it to a six-year-old, then you don't understand it yourself" - Albert Einstein.
Alex Ker 🔭506,959 views • 2 years ago
The most interesting thing I've heard in a long time: Can AI ever be conscious? Ilya Sutskever Ilya Sutskever, co-founder at OpenAI, explained a simple experiment for AI consciousness. We carefully curate the data such that we never mention anything about consciousness...we would only give the AI controlled data about surface-level experiences and mundane objects. At some point, we would tell AI about the concept of consciousness. If the AI agrees and says it's been experiencing the same thing or recognizes the experience, then it would be convincing. Do you think AI can be conscious? If, so what is a good test for it? Is something like John Searle's Chinese Room argument sufficient?
Alex Ker 🔭472,663 views • 2 years ago
No more content to load