Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Since so many companies are adopting Databricks, data engineers and AI engineers should be learning the platform In this 5-week course, we cover all the things you need to learn: - Spark, real-time streaming with Delta Live Table and Spark Streaming - Iceberg and Delta table and lake house...

Zachly's profile picture

Zach Wilson

51,504 subscribers

12,394 Aufrufe • vor 22 Tagen •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Databricks launches Free Edition! Explore and learn the latest data and AI technologies for free. Users can experiment with the full range of use cases – from building AI agents and applications to analyzing data with SQL – on the same platform used by millions of professionals. We’re proud to help today’s students and enthusiasts build real skills on real tools in today's competitive AI and ML job market.
0:43

Databricks launches Free Edition! Explore and learn the latest data and AI technologies for free. Users can experiment with the full range of use cases – from building AI agents and applications to analyzing data with SQL – on the same platform used by millions of professionals. We’re proud to help today’s students and enthusiasts build real skills on real tools in today's competitive AI and ML job market.

Databricks

25,085 Aufrufe • vor 1 Jahr

.OpenAI GPT-5.5 is now available on Databricks, with Codex coding workflows and model inference fully governed through Unity AI Gateway. With GPT-5.5 on Databricks, you can: - Power coding workflows with Codex or other coding agents - Build custom agents grounded in enterprise data - Ask business questions in natural language from enterprise data with Genie - Automate document intelligence pipelines with Lakeflow Spark Declarative Pipelines Hear more from our co-founder, Patrick Wendell, and OpenAI CRO Denise Holland Dresser about how Databricks and OpenAI are bringing frontier AI to the enterprise. Get started today:
14:58

.OpenAI GPT-5.5 is now available on Databricks, with Codex coding workflows and model inference fully governed through Unity AI Gateway. With GPT-5.5 on Databricks, you can: - Power coding workflows with Codex or other coding agents - Build custom agents grounded in enterprise data - Ask business questions in natural language from enterprise data with Genie - Automate document intelligence pipelines with Lakeflow Spark Declarative Pipelines Hear more from our co-founder, Patrick Wendell, and OpenAI CRO Denise Holland Dresser about how Databricks and OpenAI are bringing frontier AI to the enterprise. Get started today:

Databricks

63,207 Aufrufe • vor 4 Monaten

AI is changing what data teams are expected to build. Increasingly, the focus is on AI applications, agents, and automations that turn data into action. That’s why founder Zach Wilson is launching a free six-hour Databricks boot camp starting August 3, covering: • Building data systems with Lakebase and Postgres • Working with unstructured data, vector search, and retrieval • Building AI agents with Agent Bricks The course runs entirely in Databricks Free Edition and is designed for beginners and practitioners building practical AI data engineering skills. Join here:
1:42

AI is changing what data teams are expected to build. Increasingly, the focus is on AI applications, agents, and automations that turn data into action. That’s why founder Zach Wilson is launching a free six-hour Databricks boot camp starting August 3, covering: • Building data systems with Lakebase and Postgres • Working with unstructured data, vector search, and retrieval • Building AI agents with Agent Bricks The course runs entirely in Databricks Free Edition and is designed for beginners and practitioners building practical AI data engineering skills. Join here:

Databricks

21,458 Aufrufe • vor 1 Monat

We are teaming up with Databricks to supercharge AI workflows. ⚡ #CUDA will soon be at the heart of Databricks' Data Intelligence Platform, starting with AI-accelerated Photon, delivering improved speed and efficiency for customers’ data warehousing and analytics workflows.
0:38

We are teaming up with Databricks to supercharge AI workflows. ⚡ #CUDA will soon be at the heart of Databricks' Data Intelligence Platform, starting with AI-accelerated Photon, delivering improved speed and efficiency for customers’ data warehousing and analytics workflows.

NVIDIA AI Developer

22,931 Aufrufe • vor 2 Jahren

We're having a blast at Databricks Data + AI Summit! We're talking with builders about three easy ways to bring Nimble's live web search into Databricks: 1. Ask Genie to search the web and bring any data into any table 2. Call Nimble via SQL to enrich your tables 3. Build an end-to-end app on Databricks to monitor and visualize anything on the web
0:40

We're having a blast at Databricks Data + AI Summit! We're talking with builders about three easy ways to bring Nimble's live web search into Databricks: 1. Ask Genie to search the web and bring any data into any table 2. Call Nimble via SQL to enrich your tables 3. Build an end-to-end app on Databricks to monitor and visualize anything on the web

Nimble

62,226 Aufrufe • vor 2 Monaten

Databricks engineers can make $180k per year! Thats why I’m releasing a free Databricks boot camp on August 3rd! We’ll be covering all the essentials needed to be a great AI data engineer: - Day 1: Lakebase and production database systems - Day 2: Context engineering and vector databases - Day 3: AI agents on Agent Bricks Join the boot camp for free here:
1:34

Databricks engineers can make $180k per year! Thats why I’m releasing a free Databricks boot camp on August 3rd! We’ll be covering all the essentials needed to be a great AI data engineer: - Day 1: Lakebase and production database systems - Day 2: Context engineering and vector databases - Day 3: AI agents on Agent Bricks Join the boot camp for free here:

Zach Wilson

11,627 Aufrufe • vor 1 Monat

Without proper governance, an AI agent might autonomously access sensitive data, expose personal information, or modify sensitive records. In our new short course: “Governing AI Agents,” created with Databricks and taught by Amber Roberts, you’ll design AI agents that handle data safely, securely, and transparently across their entire lifecycle. You’ll learn to integrate governance into your agent’s workflow by controlling data access, ensuring privacy protection and implementing observability. Skills you'll gain: - Understand the four pillars of agent governance: Lifecycle management, risk management, security, and observability - Define appropriate data permissions for your agent - Create views or SQL queries that return only the data your agent should access - Anonymize and mask sensitive data like social security numbers and employee IDs - Log, evaluate, version, and deploy your agents on Databricks If you’re building or deploying AI agents, learning how to govern them is key to keeping systems safe and production-ready. Sign up here:
2:01

Without proper governance, an AI agent might autonomously access sensitive data, expose personal information, or modify sensitive records. In our new short course: “Governing AI Agents,” created with Databricks and taught by Amber Roberts, you’ll design AI agents that handle data safely, securely, and transparently across their entire lifecycle. You’ll learn to integrate governance into your agent’s workflow by controlling data access, ensuring privacy protection and implementing observability. Skills you'll gain: - Understand the four pillars of agent governance: Lifecycle management, risk management, security, and observability - Define appropriate data permissions for your agent - Create views or SQL queries that return only the data your agent should access - Anonymize and mask sensitive data like social security numbers and employee IDs - Log, evaluate, version, and deploy your agents on Databricks If you’re building or deploying AI agents, learning how to govern them is key to keeping systems safe and production-ready. Sign up here:

Andrew Ng

78,182 Aufrufe • vor 10 Monaten

Killer skill stack right now: vibe coding + Databricks. Fortune 1000 companies have the data. They don't have enough people building apps on it. If you can walk in, vibe code on their data, and deploy securely back to Databricks, you're in a different league. Amateur to pro vibe coder. 😎
1:20

Killer skill stack right now: vibe coding + Databricks. Fortune 1000 companies have the data. They don't have enough people building apps on it. If you can walk in, vibe code on their data, and deploy securely back to Databricks, you're in a different league. Amateur to pro vibe coder. 😎

Manny Bernabe

13,908 Aufrufe • vor 6 Monaten

Tony Blair and Oracle co-founder Larry Ellison plan to use digital ID to "unify" all data on each country's citizens "so it can be consumed and used by" their AI models. "We have to take all of this data... and move it into a single... unified data platform." "When we want to ask a question, we've provided that AI model with all the data they need to understand our country." "We need to unify all of the national data, put it into a database where it's easily consumable by the AI model, and then ask whatever question you like."
1:06

Tony Blair and Oracle co-founder Larry Ellison plan to use digital ID to "unify" all data on each country's citizens "so it can be consumed and used by" their AI models. "We have to take all of this data... and move it into a single... unified data platform." "When we want to ask a question, we've provided that AI model with all the data they need to understand our country." "We need to unify all of the national data, put it into a database where it's easily consumable by the AI model, and then ask whatever question you like."

Wide Awake Media

54,156 Aufrufe • vor 10 Monaten

Larry Ellison—owner of Oracle, CBS, and now TikTok—tells Tony Blair about his plan to use digital ID to "unify" all data on each country's citizens "so it can be consumed and used by" his AI models. "We have to take all of this data... and move it into a single, if you will, unified data platform." "When we want to ask a question, we've provided that AI model with all the data they need to understand our country." "We need to unify all of the national data, put it into a database where it's easily consumable by the AI model, and then ask whatever question you like."
1:14

Larry Ellison—owner of Oracle, CBS, and now TikTok—tells Tony Blair about his plan to use digital ID to "unify" all data on each country's citizens "so it can be consumed and used by" his AI models. "We have to take all of this data... and move it into a single, if you will, unified data platform." "When we want to ask a question, we've provided that AI model with all the data they need to understand our country." "We need to unify all of the national data, put it into a database where it's easily consumable by the AI model, and then ask whatever question you like."

Wide Awake Media

144,618 Aufrufe • vor 7 Monaten

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.
0:39

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.

Databricks

10,132 Aufrufe • vor 1 Jahr

⚡️We are excited to announce that our new no-code Enterprise Platform is NOW available in private beta! As RAG apps advance from prototype to production we’ve been overwhelmed by requests for an enterprise grade solution to provide these applications with the data they need. Designed to make it easy to get your data #RAGready, our Platform can preprocess more than 25 file types and soon will be fully #multimodal, also able to ingest audio, video and image files. We ship with a baseline suite of source connectors, including Amazon Web Services S3, Microsoft Azure Blob Storage, OneDrive, SFTP, Databricks Delta Table, Google Drive, Salesforce, Elastic, OpenSearch, and Google Cloud storage with many more fast following. Platform transforms your documents into a standardized JSON schema, broken down into semantically coherent elements allowing you to reconstruct your document in the manner most useful to you. Want only the narrative text but not the headers and footers? This is entirely configurable through the UI. Additionally, we generate more than 30 types of metadata for each element to make it easy to curate the data being written downstream and to support metadata filtering during retrieval. Smart chunking and the ability to choose from a range of embedding models are in from launch, delivering a turnkey solution for chunk and embedding experimentation. As for destination connectors, we've got that covered too, with Amazon Web Services S3, Pinecone, Chroma , Weaviate AI Database, Google Cloud storage, MongoDB, Microsoft Azure cognitive search, PostgreSQL, Elastic, OpenSearch, and Databricks Delta Table. And of course, all of this can be scheduled to keep your data continuously hydrated. The private-beta is live today! Sign-up to get access and come build the future of LLM data foundations with us: 🚀 #ETLforLLMs #AI #DataPreprocessing #DataScience #DataTransformation #LLMs #ETL #ML #PreppingData #MachineLearning #RAG #Engineer #Unstructured #Unstructuredio #RetrievalAugmentedGeneration #multimodal #AIJobs
1:00

⚡️We are excited to announce that our new no-code Enterprise Platform is NOW available in private beta! As RAG apps advance from prototype to production we’ve been overwhelmed by requests for an enterprise grade solution to provide these applications with the data they need. Designed to make it easy to get your data #RAGready, our Platform can preprocess more than 25 file types and soon will be fully #multimodal, also able to ingest audio, video and image files. We ship with a baseline suite of source connectors, including Amazon Web Services S3, Microsoft Azure Blob Storage, OneDrive, SFTP, Databricks Delta Table, Google Drive, Salesforce, Elastic, OpenSearch, and Google Cloud storage with many more fast following. Platform transforms your documents into a standardized JSON schema, broken down into semantically coherent elements allowing you to reconstruct your document in the manner most useful to you. Want only the narrative text but not the headers and footers? This is entirely configurable through the UI. Additionally, we generate more than 30 types of metadata for each element to make it easy to curate the data being written downstream and to support metadata filtering during retrieval. Smart chunking and the ability to choose from a range of embedding models are in from launch, delivering a turnkey solution for chunk and embedding experimentation. As for destination connectors, we've got that covered too, with Amazon Web Services S3, Pinecone, Chroma , Weaviate AI Database, Google Cloud storage, MongoDB, Microsoft Azure cognitive search, PostgreSQL, Elastic, OpenSearch, and Databricks Delta Table. And of course, all of this can be scheduled to keep your data continuously hydrated. The private-beta is live today! Sign-up to get access and come build the future of LLM data foundations with us: 🚀 #ETLforLLMs #AI #DataPreprocessing #DataScience #DataTransformation #LLMs #ETL #ML #PreppingData #MachineLearning #RAG #Engineer #Unstructured #Unstructuredio #RetrievalAugmentedGeneration #multimodal #AIJobs

Unstructured

21,874 Aufrufe • vor 2 Jahren

Don’t DIY your AI: building a custom Agentforce agent is as simple as describing the job and integrating it directly into your workflow—no separate models, hyperscalers, databases, or AI engineers needed! With all apps, data, AI, and workflows seamlessly integrated on the Salesforce Platform, humans + agents = customer success. This is what AI was meant to be! #DF24
2:36

Don’t DIY your AI: building a custom Agentforce agent is as simple as describing the job and integrating it directly into your workflow—no separate models, hyperscalers, databases, or AI engineers needed! With all apps, data, AI, and workflows seamlessly integrated on the Salesforce Platform, humans + agents = customer success. This is what AI was meant to be! #DF24

Marc Benioff

44,730 Aufrufe • vor 1 Jahr

“With coding agents, you’re putting this jetpack on and going 10,000 miles an hour, doing things you were never able to do before.” In this conversation, OpenAI’s Peter Steinberger 🦞 and Tibo join Databricks Co-founder Patrick Wendell to unpack what comes next as agents move beyond code authoring into observability, operational work, and long-running responsibilities across software and data systems. Watch the full conversation:
1:52

“With coding agents, you’re putting this jetpack on and going 10,000 miles an hour, doing things you were never able to do before.” In this conversation, OpenAI’s Peter Steinberger 🦞 and Tibo join Databricks Co-founder Patrick Wendell to unpack what comes next as agents move beyond code authoring into observability, operational work, and long-running responsibilities across software and data systems. Watch the full conversation:

Databricks

20,061 Aufrufe • vor 15 Tagen

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.
5:38

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.

Santiago

101,473 Aufrufe • vor 1 Jahr

Here’s how I would learn data engineering in 2025: 1. The basics: - learn SQL — SELECT, FROM, WHERE, GROUP BY, JOIN, HAVING, etc - learn Python — data structures: objects, arrays, tuples, namedtuples — algorithms: recursion, loops 2. Intermediate - learn distributed compute — pick up PySpark or Snowflake or BigQuery - learn data make architecture — pick up iceberg or delta lake - learn job orchestration — pick up Airflow or Mage - learn data quality — pick up Great expectations 3. Advanced - learn the data modeling techniques — one big table vs kimball vs Inmon vs data vault techniques - learn machine learning features and vector databases — pick up pinecone and how to fine tune LLMs with high quality data My newsletter has a deeper roadmap here:
1:19

Here’s how I would learn data engineering in 2025: 1. The basics: - learn SQL — SELECT, FROM, WHERE, GROUP BY, JOIN, HAVING, etc - learn Python — data structures: objects, arrays, tuples, namedtuples — algorithms: recursion, loops 2. Intermediate - learn distributed compute — pick up PySpark or Snowflake or BigQuery - learn data make architecture — pick up iceberg or delta lake - learn job orchestration — pick up Airflow or Mage - learn data quality — pick up Great expectations 3. Advanced - learn the data modeling techniques — one big table vs kimball vs Inmon vs data vault techniques - learn machine learning features and vector databases — pick up pinecone and how to fine tune LLMs with high quality data My newsletter has a deeper roadmap here:

Zach Wilson

29,420 Aufrufe • vor 1 Jahr

In the past, it wasn't possible for companies to tap into their unstructured data. But that's now changing with AI. On Greylock Partners Change Agents, Aaron Levie shared "We see a future where you can actually begin to bring agents to all that data and answer any kind of question the customer has, and then eventually be able to automate any kind of workflow that the customer has."
1:03

In the past, it wasn't possible for companies to tap into their unstructured data. But that's now changing with AI. On Greylock Partners Change Agents, Aaron Levie shared "We see a future where you can actually begin to bring agents to all that data and answer any kind of question the customer has, and then eventually be able to automate any kind of workflow that the customer has."

Box

315,675 Aufrufe • vor 8 Monaten

Incredible to see how Box is leveraging Salesforce to grow faster, stay closer to customers, and unlock the power of data. Excited for what’s next: Agentforce + Tableau Next = AI + CRM + real-time insights at scale. Aaron Levie is building the future of enterprise software. Welcome Tableau Next — the world’s first agentic analytics platform! You, your agent, and your app—united with Agentforce across all your data: Salesforce, Snowflake, Databricks, Amazon, Google & more. Built on an open, composable architecture powered by Data Cloud. Agents + humans, driving real insight + action. The future of the #DataFam is here. Watch the #TC25 keynote:
3:32

Incredible to see how Box is leveraging Salesforce to grow faster, stay closer to customers, and unlock the power of data. Excited for what’s next: Agentforce + Tableau Next = AI + CRM + real-time insights at scale. Aaron Levie is building the future of enterprise software. Welcome Tableau Next — the world’s first agentic analytics platform! You, your agent, and your app—united with Agentforce across all your data: Salesforce, Snowflake, Databricks, Amazon, Google & more. Built on an open, composable architecture powered by Data Cloud. Agents + humans, driving real insight + action. The future of the #DataFam is here. Watch the #TC25 keynote:

Marc Benioff

70,016 Aufrufe • vor 1 Jahr

Say hello to the fusion of visual programming, code, and AI. Retool Workflows is the fastest way to automate critical business processes. Explore, join, and transform your data with real-time feedback and AI-powered actions. Deploy and manage automations with developer-first control. Used by companies like RE/MAX, OpenAI, and EquipmentShare—Workflows is now available for every team. Try it today for free:
0:38

Say hello to the fusion of visual programming, code, and AI. Retool Workflows is the fastest way to automate critical business processes. Explore, join, and transform your data with real-time feedback and AI-powered actions. Deploy and manage automations with developer-first control. Used by companies like RE/MAX, OpenAI, and EquipmentShare—Workflows is now available for every team. Try it today for free:

Retool

11,238 Aufrufe • vor 2 Jahren

Enrollment is now open for the Data Engineering Professional Certificate! Data engineers are the architects of modern organizations, ensuring data is reliable, accessible, and ready for analytics and machine learning. This professional certificate is tailored to equip you with the critical skills, through frameworks and hands-on practice, to excel in this role. Taught by industry expert Joe Reis, co-author of the best-selling book "Fundamentals of Data Engineering," along with 17 guest instructors from the data field, you will gain expertise to start and further your career in the high-demand field of data engineering. Key focus areas: 🗂️ Data Engineering Lifecycle: Learn the important stages of building an efficient data pipeline that creates business value. 📥 Data Ingestion: Learn how to efficiently gather data from various sources. 💾 Data Storage: Master the techniques for storing data securely and cost-effectively. 🔄 Data Transformation: Understand how to clean, organize, and prepare data for analysis and machine learning. 🏗️ Data Architecture Design: Build robust architectures that support scalable, efficient data workflows. 📊 Serving Data: Ensure that data is available to stakeholders when and where they need it to drive business decisions. Enroll now!
1:33

Enrollment is now open for the Data Engineering Professional Certificate! Data engineers are the architects of modern organizations, ensuring data is reliable, accessible, and ready for analytics and machine learning. This professional certificate is tailored to equip you with the critical skills, through frameworks and hands-on practice, to excel in this role. Taught by industry expert Joe Reis, co-author of the best-selling book "Fundamentals of Data Engineering," along with 17 guest instructors from the data field, you will gain expertise to start and further your career in the high-demand field of data engineering. Key focus areas: 🗂️ Data Engineering Lifecycle: Learn the important stages of building an efficient data pipeline that creates business value. 📥 Data Ingestion: Learn how to efficiently gather data from various sources. 💾 Data Storage: Master the techniques for storing data securely and cost-effectively. 🔄 Data Transformation: Understand how to clean, organize, and prepare data for analysis and machine learning. 🏗️ Data Architecture Design: Build robust architectures that support scalable, efficient data workflows. 📊 Serving Data: Ensure that data is available to stakeholders when and where they need it to drive business decisions. Enroll now!

DeepLearning.AI

20,833 Aufrufe • vor 1 Jahr