课程: DataOps with Apache Iceberg using Spark, Nessie, and Dremio

Introduction

Hey, everybody. This is Alex Merced, and welcome to this course: DataOps with Apache Iceberg. And in this course, we're going to be covering several different topics. So let's talk about those topics that we'll be talking about, well, in this course, including what is DataOps. So we're going to get into sort of like what is DataOps, what are the different sort of goals of DataOps and technologies that enable DataOps. Essentially, you know, really automating the operations that allow our data to work, and using tools like Docker, setting up a local environment to try things out with like Docker, such as Nessie, dbt, GitHub Actions, and kind of getting hands-on with these tools that allow us to really kind of operationalize for data quality, for deployment, and things like that when it comes to our data architecture, particularly with Apache Iceberg. And if you're not familiar with Apache Iceberg, please do check out some of the courses on Apache Iceberg that you can find on this platform. Now with that, I also want to point you to where you can find resources. For any resources that I'm going to refer to on this course, you'll be able to find here. So by scanning this QR code, this will take you to a GitHub repository where you'll find the resources that I have coalesced to supplement this course. Have a great day. I want to see you in the next section. We're going to have a great time in this course and learn a lot of really cool stuff about DataOps, Apache Iceberg, and about data and working with data in general. So I'll see you there.

内容