免费学习该课程!
今天就开通帐号,24,600 门业界名师课程任您挑!
Define and deploy the Databricks Asset Bundle - Databricks教程
课程: MLOps with Databricks
Define and deploy the Databricks Asset Bundle
- [Instructor] In the previous video, we defined the components of our Databricks workflow. Let's now work on the Databricks YAML file. The bundle name was already defined in the beginning when we started working with DB Connect. Let's move directly to the most important part, bundle resources. Our bundle has one resource. It's a job called hotel-cancellation. It has a schedule. The job is supposed to run at 6:00 AM, Amsterdam time every Monday. It has a pause status. It is defined by a variable scheduled pause status. For non-production workflows, we want to pause the schedule so that the job doesn't run on a chron trigger, and the value pause is defined for a variable in the dev target. The job has a tag, project_name. It can be used to track the cost associated with the project. Let's now define the job cluster. We choose 15.4 standard runtime, single user mode. We also choose the VM types for the worker nodes and the driver nodes and autoscaling policy. In our case, all the tasks…