Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

We just launched a major new Data Engineering Professional Certificate on Coursera! Data underlies all modern AI systems, and engineers who know how to build systems to store and serve it are in high demand. If you're interested in learning this skill, please check out this 4-course sequence, which... is designed to make you job-ready to be a Data Engineer. This is a new specialization taught by Joe Reis, the co-author of the best-selling book “Fundamentals of Data Engineering," in collaboration with AWS. (Disclosure, I serve on Amazon's board.) For many AI systems, data engineering is 80% of the work, and modeling is 20%. But people’s attention on these two topics is often flipped. This makes the job of the data engineer particularly important. In this professional certificate, you'll learn foundational data engineering skills while implementing modern data architectures using open-source tools: - Learn the key steps of the data lifecycle, to generate, ingest, store, transform, and serve data. - Learn to align with organizational goals to design the data pipeline right for your business' needs. - Understand how to make necessary trade-offs between speed, scalability, security, and cost. Joe has distilled into this specialization decades of experience helping startups and large companies with data infrastructure. He is also joined by 17 other industry leaders in the data field, who will help you learn in-demand skills for the growing field of data engineering. Please sign up here:show more

Andrew Ng

1,920,325 subscribers

120,581 views • 2 years ago •via X (Twitter)

Education Health & Wellness Science & Technology

Anya Rossi• Live Now

Private livecam show

10 Comments

Rufus2 years ago

Cool, I will definitely enroll for this course.

Jay2 years ago

This is awesome. I am definitely getting on this asap. Enjoyed your ML/DL courses on Coursera.

DE2 years ago

enrolled sir

Richard Buckley Watterson2 years ago

Does has any plan to create yearly subscription or combine with Coursera plus?

iHope2 years ago

i have the book “Fundamentals of Data Engineering", though not the knowledge

Rajeev Kumar2 years ago

Good to hear!

Tais2 years ago

Finally, a VPS service that puts customization in your hands! #GameChanger $TSAI #AI #ERC20 #ETH #NLP

naila huq2 years ago

👏

Hillary Kiptoo2 years ago

My current course, almost done with week 1.

Alexander De Ridder2 years ago

Incredible. Data engineering empowers AI growth. Course looks promising.

Related Videos

Major program launch: Data Analytics Professional Certificate! This large, five-course sequence takes you all the way to being job-ready as a data analyst, and shows how to use Generative AI as a thought partner to enhance your work in this role. Offered by on Coursera, this is taught by Sean Barnes, Ph.D., a Data Science & Engineering Leader at Netflix. Analyzing data remains one of the most important skills in where the world is going with AI. This comprehensive certificate takes you all the way to being job-ready. Each course comes with practical projects demonstrated in real-world contexts, such as analyzing sales data for a Korean bakery, video game sales trends across different regions, or identifying factors impacting customer retention for a communications company. You'll also work on estimating fire distribution for forest fire prevention, analyzing how a diamond's properties affect its market value, and developing predictive models for retail sales analysis, carbon emissions, and coral reef conservation. Here's some of what you'll learn: - How to define data and categorize it into its many types such as discrete & continuous numerical, structured & unstructured, time series, categorical, and know what insights can be derived from the different types of data categories. - How to differentiate between data-related job roles and their responsibilities, and how data flows through an organization from the moment of capture to decision-making. - How to perform data processing functions and apply conditional formatting in spreadsheets to extract business value from your data using statistical calculations and best practices for visualizing and interpreting data. - How to use LLMs for stakeholder analysis, data exploration, and data visualization. - Best practices for using LLMs for as a thought partner to data analysis work By the end of this professional certificate program, you will have learned core statistical concepts, analysis techniques, and visualization methodologies that will serve as the foundation for working as a data analyst. The world needs more data analysts, especially ones who know how to use modern generative AI. With data science roles projected to grow 36% by 2033, the skills taught in this program create new professional opportunities in data. Sign up here!

Major program launch: Data Analytics Professional Certificate! This large, five-course sequence takes you all the way to being job-ready as a data analyst, and shows how to use Generative AI as a thought partner to enhance your work in this role. Offered by on Coursera, this is taught by Sean Barnes, Ph.D., a Data Science & Engineering Leader at Netflix. Analyzing data remains one of the most important skills in where the world is going with AI. This comprehensive certificate takes you all the way to being job-ready. Each course comes with practical projects demonstrated in real-world contexts, such as analyzing sales data for a Korean bakery, video game sales trends across different regions, or identifying factors impacting customer retention for a communications company. You'll also work on estimating fire distribution for forest fire prevention, analyzing how a diamond's properties affect its market value, and developing predictive models for retail sales analysis, carbon emissions, and coral reef conservation. Here's some of what you'll learn: - How to define data and categorize it into its many types such as discrete & continuous numerical, structured & unstructured, time series, categorical, and know what insights can be derived from the different types of data categories. - How to differentiate between data-related job roles and their responsibilities, and how data flows through an organization from the moment of capture to decision-making. - How to perform data processing functions and apply conditional formatting in spreadsheets to extract business value from your data using statistical calculations and best practices for visualizing and interpreting data. - How to use LLMs for stakeholder analysis, data exploration, and data visualization. - Best practices for using LLMs for as a thought partner to data analysis work By the end of this professional certificate program, you will have learned core statistical concepts, analysis techniques, and visualization methodologies that will serve as the foundation for working as a data analyst. The world needs more data analysts, especially ones who know how to use modern generative AI. With data science roles projected to grow 36% by 2033, the skills taught in this program create new professional opportunities in data. Sign up here!

Andrew Ng

85,182 views • 1 year ago

Here's how I would learn data engineering basics in 2025: - Find a data source you care about (examples: gaming APIs, stock market, web scraping, etc) - Use Python to interact and ingest your source. Initially just write the data to a CSV. - Setup an account with Snowflake or Google BigQuery. - update your Python script to load a table in Snowflake/BigQuery - schedule your script with CRON in the cloud with a service like Heroku. - build aggregations and visualizations on top of your ingested data Only thing this misses is data quality and complex job orchestration which you can learn later! How would you learn data engineering nowadays?

Here's how I would learn data engineering basics in 2025: - Find a data source you care about (examples: gaming APIs, stock market, web scraping, etc) - Use Python to interact and ingest your source. Initially just write the data to a CSV. - Setup an account with Snowflake or Google BigQuery. - update your Python script to load a table in Snowflake/BigQuery - schedule your script with CRON in the cloud with a service like Heroku. - build aggregations and visualizations on top of your ingested data Only thing this misses is data quality and complex job orchestration which you can learn later! How would you learn data engineering nowadays?

Zach Wilson

20,412 views • 1 year ago

1/ The data parsing market for robotics is just emerging, and it’s already valued in the tens of billions. Data parsing to build data models and software for Robotics is a $20B market in 2024 and is expected to reach $150B+ by 2034 Cherry AI Robotics has built a data parsing tool for robotics, which goes live next week, and will effectively make this project one of the pioneers in data parsing for robotics.

1/ The data parsing market for robotics is just emerging, and it’s already valued in the tens of billions. Data parsing to build data models and software for Robotics is a $20B market in 2024 and is expected to reach $150B+ by 2034 Cherry AI Robotics has built a data parsing tool for robotics, which goes live next week, and will effectively make this project one of the pioneers in data parsing for robotics.

CherryAI Robotics

90,786 views • 1 year ago

Introducing: Advanced Data Assets™ By LayerAI 🧬 Data is used to power Big Data and AI. The increasing demand for high quality data to improve AI models will lead to new companies creating value in the global data market. The problem: current data collection methods make data fall short of its true potential. Data is limited. Building a decentralized solution where users choose to productize and earn from their data opens untapped sources of income. 🌐 Creating Advanced Data Assets™ There exists a market opportunity to create a digital blockchain-based global data marketplace. Data collected using our nodes, our native network apps, settled on LayerAI. The Advanced Data. Meet the Ecosystem that empowers users to participate in the Data Economy.

Introducing: Advanced Data Assets™ By LayerAI 🧬 Data is used to power Big Data and AI. The increasing demand for high quality data to improve AI models will lead to new companies creating value in the global data market. The problem: current data collection methods make data fall short of its true potential. Data is limited. Building a decentralized solution where users choose to productize and earn from their data opens untapped sources of income. 🌐 Creating Advanced Data Assets™ There exists a market opportunity to create a digital blockchain-based global data marketplace. Data collected using our nodes, our native network apps, settled on LayerAI. The Advanced Data. Meet the Ecosystem that empowers users to participate in the Data Economy.

LayerAI | AI2Earn

27,136 views • 2 years ago

I made an AI data science team with Python. I'm excited to share my new project, the AI Data Science Team, a Python package for creating AI co-pilots and agents to assist in common data science tasks. I walk you through the GitHub page, showcasing the progress and potential of this project. I'll explain how these agents can streamline tasks like code generation and modeling pipeline creation, making data science projects more efficient. Introduction to AI Data Science Team Project Integrating Human-in-the-Loop Example: Accessing Agents for Feature Engineering Setting up Feature Engineering Agent Code On GitHub: Python AI-Tips Newsletter (stay updated as I build this project in the open):

I made an AI data science team with Python. I'm excited to share my new project, the AI Data Science Team, a Python package for creating AI co-pilots and agents to assist in common data science tasks. I walk you through the GitHub page, showcasing the progress and potential of this project. I'll explain how these agents can streamline tasks like code generation and modeling pipeline creation, making data science projects more efficient. Introduction to AI Data Science Team Project Integrating Human-in-the-Loop Example: Accessing Agents for Feature Engineering Setting up Feature Engineering Agent Code On GitHub: Python AI-Tips Newsletter (stay updated as I build this project in the open):

Matt Dancho (Business Science)

11,799 views • 1 year ago

AI is changing what data teams are expected to build. Increasingly, the focus is on AI applications, agents, and automations that turn data into action. That’s why founder Zach Wilson is launching a free six-hour Databricks boot camp starting August 3, covering: • Building data systems with Lakebase and Postgres • Working with unstructured data, vector search, and retrieval • Building AI agents with Agent Bricks The course runs entirely in Databricks Free Edition and is designed for beginners and practitioners building practical AI data engineering skills. Join here:

AI is changing what data teams are expected to build. Increasingly, the focus is on AI applications, agents, and automations that turn data into action. That’s why founder Zach Wilson is launching a free six-hour Databricks boot camp starting August 3, covering: • Building data systems with Lakebase and Postgres • Working with unstructured data, vector search, and retrieval • Building AI agents with Agent Bricks The course runs entirely in Databricks Free Edition and is designed for beginners and practitioners building practical AI data engineering skills. Join here:

Databricks

21,458 views • 2 months ago

#WATCH | Delhi | UIDAI Chairperson and World Bank Executive Director Neelkanth Mishra says, "...What is most critical is that 99% of the data in corporations is untouched by AI. None of the companies wants to share this data with AI models because once you've shared it, it's gone. And if you don't have that, then how do you get solutions?.. There is a complete market failure in the data market... India's Digital Personal Data Protection (DPDP) law, the data architecture which is based on DEPA (Data Empowerment and Protection Architecture), is a remarkable model for enabling data sharing where the owner of the data still retains control even as it makes it available for certain usage..."

#WATCH | Delhi | UIDAI Chairperson and World Bank Executive Director Neelkanth Mishra says, "...What is most critical is that 99% of the data in corporations is untouched by AI. None of the companies wants to share this data with AI models because once you've shared it, it's gone. And if you don't have that, then how do you get solutions?.. There is a complete market failure in the data market... India's Digital Personal Data Protection (DPDP) law, the data architecture which is based on DEPA (Data Empowerment and Protection Architecture), is a remarkable model for enabling data sharing where the owner of the data still retains control even as it makes it available for certain usage..."

ANI

35,016 views • 2 days ago

one thing i find interesting about Grass is the growing importance of data infrastructure as AI scales AI labs need massive amounts of data, but accessing public web data is becoming increasingly difficult Grass uses a distributed network of internet connections to help collect that data and make it available to AI companies i believe access to high-quality data will become an increasingly important competitive advantage in AI, which makes this an interesting area to follow

one thing i find interesting about Grass is the growing importance of data infrastructure as AI scales AI labs need massive amounts of data, but accessing public web data is becoming increasingly difficult Grass uses a distributed network of internet connections to help collect that data and make it available to AI companies i believe access to high-quality data will become an increasingly important competitive advantage in AI, which makes this an interesting area to follow

Ansem 🐂🀄️

91,963 views • 21 hours ago

Imitation learning is great, but needs us to have (near) optimal data. We throw away most other data (failures, evaluation data, suboptimal data, undirected play data), even though this data can be really useful and way cheaper! In our new work - RISE, we show a simple way to *use all of this non-optimal data to robustify imitation learning* with minimal requirements beyond BC. Key idea: use non-expert data to learn how to *recover* back to expert data with a minimal frills offline RL that works under sparse data coverage. Allows usage of *all* available data, not just expert data - never throw your data away! Paper: Website: A 🧵(1/10)

Imitation learning is great, but needs us to have (near) optimal data. We throw away most other data (failures, evaluation data, suboptimal data, undirected play data), even though this data can be really useful and way cheaper! In our new work - RISE, we show a simple way to use all of this non-optimal data to robustify imitation learning with minimal requirements beyond BC. Key idea: use non-expert data to learn how to recover back to expert data with a minimal frills offline RL that works under sparse data coverage. Allows usage of all available data, not just expert data - never throw your data away! Paper: Website: A 🧵(1/10)

Abhishek Gupta

20,644 views • 11 months ago

Ever wondered how AI could understand your company’s private data the way Google understands the web? Elastic is doing just that by being the foundation for context engineering: ▶️ Linking an organisation’s proprietary data to AI, making its data searchable and actionable. ▶️ Enabling multimodal, multilingual AI experiences in India’s Tier II and III cities. ▶️ Driving global business impact for enterprises and governments alike. In this exclusive conversation with Ash Kulkarni, CEO of Elastic, learn how the company is helping enterprises turn data into clarity and real-world outcomes. See the full article and video here: Shradha Sharma

Ever wondered how AI could understand your company’s private data the way Google understands the web? Elastic is doing just that by being the foundation for context engineering: ▶️ Linking an organisation’s proprietary data to AI, making its data searchable and actionable. ▶️ Enabling multimodal, multilingual AI experiences in India’s Tier II and III cities. ▶️ Driving global business impact for enterprises and governments alike. In this exclusive conversation with Ash Kulkarni, CEO of Elastic, learn how the company is helping enterprises turn data into clarity and real-world outcomes. See the full article and video here: Shradha Sharma

YourStory

16,476 views • 10 months ago

This April AMA is here. In this session, the team breaks down how biodata (like sleep and brain data) can be standardized, valued, and turned into real-world assets (RWA). What you’ll learn: 1. The 4 key milestones for Biodata RWA in 2026 2. Why sleep data is the first step in building a data economy 3. How data becomes structured, scored, and monetizable 4. The role of MAN token in rewarding and settling data usage 5. How privacy is protected with distributed storage & computation 6. Ownership models: sell vs license your data 7. Why institutions (AI, pharma, insurance) need verified biodata In the future, your data won’t just exist, it will work for you.

This April AMA is here. In this session, the team breaks down how biodata (like sleep and brain data) can be standardized, valued, and turned into real-world assets (RWA). What you’ll learn: 1. The 4 key milestones for Biodata RWA in 2026 2. Why sleep data is the first step in building a data economy 3. How data becomes structured, scored, and monetizable 4. The role of MAN token in rewarding and settling data usage 5. How privacy is protected with distributed storage & computation 6. Ownership models: sell vs license your data 7. Why institutions (AI, pharma, insurance) need verified biodata In the future, your data won’t just exist, it will work for you.

Matrix AI Network

15,296 views • 5 months ago

AI is transforming the way businesses operate 🤖. It’s no longer just a tool, it powers decision-making, efficiency, and growth. From automating tasks to predicting trends and uncovering insights, AI is becoming the backbone of modern business. But AI isn’t magic. It needs massive amounts of high-quality data 📊. Companies like Scale AI and other Web2 giants thrive because they control the pipelines of this data, turning it into a huge competitive advantage. The problem is most of this data is locked in centralized systems 🔒, expensive, and often inaccessible for smaller companies or innovators. That’s where OORT | The Data Cloud for Decentralized AI comes in 🌐✨. By building decentralized storage and AI infrastructure, OORTECH makes data open, secure, and accessible to everyone. It’s a foundation for the next generation of AI-powered businesses, giving all innovators the chance to compete and create 🚀

AI is transforming the way businesses operate 🤖. It’s no longer just a tool, it powers decision-making, efficiency, and growth. From automating tasks to predicting trends and uncovering insights, AI is becoming the backbone of modern business. But AI isn’t magic. It needs massive amounts of high-quality data 📊. Companies like Scale AI and other Web2 giants thrive because they control the pipelines of this data, turning it into a huge competitive advantage. The problem is most of this data is locked in centralized systems 🔒, expensive, and often inaccessible for smaller companies or innovators. That’s where OORT | The Data Cloud for Decentralized AI comes in 🌐✨. By building decentralized storage and AI infrastructure, OORTECH makes data open, secure, and accessible to everyone. It’s a foundation for the next generation of AI-powered businesses, giving all innovators the chance to compete and create 🚀

Sky Wee

67,559 views • 1 year ago

AI is transforming the way businesses operate 🤖. It helps companies work faster, cut costs, and make smarter decisions. From automating repetitive tasks to predicting trends and uncovering insights, AI is becoming the backbone of modern business. But AI can’t function without data 📊. Massive amounts of high-quality data are required to train models and make them effective. Right now, most of this data is controlled by a few centralized giants 🔒, making it expensive, siloed, and out of reach for smaller businesses and innovators. This is where OORT | The Data Cloud for Decentralized AI comes in 🌐✨. By combining decentralized storage with AI infrastructure powered by blockchain, OORT makes data open, secure, and accessible to everyone. It’s building a foundation where businesses of all sizes can tap into AI’s full potential and compete in the AI-driven economy 🚀

AI is transforming the way businesses operate 🤖. It helps companies work faster, cut costs, and make smarter decisions. From automating repetitive tasks to predicting trends and uncovering insights, AI is becoming the backbone of modern business. But AI can’t function without data 📊. Massive amounts of high-quality data are required to train models and make them effective. Right now, most of this data is controlled by a few centralized giants 🔒, making it expensive, siloed, and out of reach for smaller businesses and innovators. This is where OORT | The Data Cloud for Decentralized AI comes in 🌐✨. By combining decentralized storage with AI infrastructure powered by blockchain, OORT makes data open, secure, and accessible to everyone. It’s building a foundation where businesses of all sizes can tap into AI’s full potential and compete in the AI-driven economy 🚀

Sky Wee

58,319 views • 11 months ago

Introducing the Future of AI-Powered Sports Data with $FXI.⚡️ We’re not just talking about innovation, we’re building it. 🚀 From #AI-driven data capture to on-chain validation and data monetization, the FX1 ecosystem is rewriting the rules of the sports and data economy. Our platform empowers leagues, teams, and creators to unlock the full potential of their data with cutting-edge AI solutions. 🧠 Why FX1? ➡️ AI-Powered Precision: Transform raw sports data into actionable insights. ➡️ Data Validation on Chain: Building trust in the data economy through blockchain. ➡️ AI-Powered Revenue Streams: Use sports data to drive predictive analytics, odds modeling, and other high-value solutions that unlock new ways to monetize. FX1 is leading the charge in AI innovation, creating a seamless bridge between sports, blockchain, and the data economy. This isn’t just evolution - it’s a revolution. 💡 The future of sports is here. And it’s powered by AI. 🤖 Watch the full video and see how we’re turning vision into reality. 👇

Introducing the Future of AI-Powered Sports Data with $FXI.⚡️ We’re not just talking about innovation, we’re building it. 🚀 From #AI-driven data capture to on-chain validation and data monetization, the FX1 ecosystem is rewriting the rules of the sports and data economy. Our platform empowers leagues, teams, and creators to unlock the full potential of their data with cutting-edge AI solutions. 🧠 Why FX1? ➡️ AI-Powered Precision: Transform raw sports data into actionable insights. ➡️ Data Validation on Chain: Building trust in the data economy through blockchain. ➡️ AI-Powered Revenue Streams: Use sports data to drive predictive analytics, odds modeling, and other high-value solutions that unlock new ways to monetize. FX1 is leading the charge in AI innovation, creating a seamless bridge between sports, blockchain, and the data economy. This isn’t just evolution - it’s a revolution. 💡 The future of sports is here. And it’s powered by AI. 🤖 Watch the full video and see how we’re turning vision into reality. 👇

FX1

23,960 views • 1 year ago

1/ Cherry AI Robotics is building the world’s first data layer for robotics. Every autonomous robot needs a neural network to operate, which requires massive domain-specific data. Cherry AI Robotics has an entire ecosystem of products with 200k+ communities and 800k+ users. These products generate large amounts of data, which is parsed to create valuable data sets for robotics. Learn more:

1/ Cherry AI Robotics is building the world’s first data layer for robotics. Every autonomous robot needs a neural network to operate, which requires massive domain-specific data. Cherry AI Robotics has an entire ecosystem of products with 200k+ communities and 800k+ users. These products generate large amounts of data, which is parsed to create valuable data sets for robotics. Learn more:

CherryAI Robotics

105,357 views • 1 year ago

Ever wondered how we come up with combos with new characters and new moves? It’s all in the frame data! Frame data opens up a new perspective to the game. This is one of the most basic levels of frame data 101. Check it out! #streetfighter #streetfighter6 #kimberly #sf6

Ever wondered how we come up with combos with new characters and new moves? It’s all in the frame data! Frame data opens up a new perspective to the game. This is one of the most basic levels of frame data 101. Check it out! #streetfighter #streetfighter6 #kimberly #sf6

Sherry Nhan

109,419 views • 3 years ago

World Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet." "And we know that in order for robotics to work, we have to somehow unlock the power of scaling law. But where does that come from?" "It's a profound problem that everybody's battling with in robotics." "We see a lot of unlock in being able to do this whole process through the modeling of the environments." "Being able to create these digital worlds... that's just going to unlock so much more potential for being able to replace all the costly and the unsafe data in the real environments with the data generated from the worlds for robots to be able to do scalable learning and evaluations." Fei-Fei Li Yunzhu Li martin_casado

World Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet." "And we know that in order for robotics to work, we have to somehow unlock the power of scaling law. But where does that come from?" "It's a profound problem that everybody's battling with in robotics." "We see a lot of unlock in being able to do this whole process through the modeling of the environments." "Being able to create these digital worlds... that's just going to unlock so much more potential for being able to replace all the costly and the unsafe data in the real environments with the data generated from the worlds for robots to be able to do scalable learning and evaluations." Fei-Fei Li Yunzhu Li martin_casado

a16z

78,216 views • 2 months ago

Did you know that Facebook made $134.9 billion in 2023 from selling your data? Our society has come to the point where we accepted an unfair model in which privacy is being exploited and data gifted to big tech that is selling it for billions. We intend to break the norm of how data is shared on the internet because it is outdated and unfair. You should be empowered with more control and monetization models for your data!

Did you know that Facebook made $134.9 billion in 2023 from selling your data? Our society has come to the point where we accepted an unfair model in which privacy is being exploited and data gifted to big tech that is selling it for billions. We intend to break the norm of how data is shared on the internet because it is outdated and unfair. You should be empowered with more control and monetization models for your data!

Solana ID 🪷

30,464 views • 2 years ago