Azure Data Factory
While working with Azure data factory you know first five component
1) Pipeline 2) Dataset
3)Dataflow 4) Power Query 5) Linked services
1) Pipeline: ?Pipeline is a?data-driven workflow where?data is orchestrated to transform as per Target system requirements.
2) Dataset: Datasets?identify?data?within the linked?data?stores, such as SQL tables, files, folders, and documents.
3)Dataflow:A?data flow in ADF?is a visual and code-free transformation layer, which uses Azure Databricks clusters behind the covers.
4) Power Query: The?Power Query?activity allows you to build and execute?Power Query?mash-ups to execute?data?wrangling at scale in a?Data Factory.
5) Linker Services:Azure Data Factory Linked Services?allow you to establish a connection with your data stores. There are more than 90 pre-built connectors that you can use to connect to your data stores
There are many ways to work on ADF.
1) Azure Portal UI 2)Azure Power Shell(Insall azure Power Shell)
3) .NET 4) PYTHON
5) REST 6) Resource Manager Template (Azure Power shell Az Module)
Triggers: Triggers in ADF?are used to run pipelines automatically either on a wall-clock schedule or at a periodic time interval.
There are three types of trigger available in ADF
1) Schedule Trigger: A trigger that invokes a pipeline on a wall - Clock schedule
2) Tumbling Window Trigger: A trigger that operates on a periodic interval, while also retaining state.
3) Event -Based Trigger: A trigger that responds to an event.