Curious about what's coming in Airflow 3? In this episode of the Data Flowcast, PMC Member Vikram Koka chats all things Airflow 3— including the ability to run tasks from anywhere, at any time, in any language. Listen on Apple, Spotify, Youtube, or where you like to ?? https://lnkd.in/gqnqVu7N
Apache Airflow
非盈利组织
Apache Airflow is a Open Source platform to programmatically author, schedule & monitor workflows.
关于我们
Apache Airflow is an open-source platform for developing, scheduling, and monitoring batch-oriented workflows. Airflow's extensible Python framework enables you to build workflows connecting with virtually any technology. A web interface helps manage the state of your workflows. Airflow is deployable in many ways, varying from a single process on your laptop to a distributed setup to support even the biggest workflows. It is a de-facto standard for Data Engineering & ETL pipelines
- 网站
-
https://airflow.apache.org/
Apache Airflow的外部链接
- 所属行业
- 非盈利组织
- 规模
- 1,001-5,000 人
- 类型
- 非营利机构
- 创立
- 2015
- 领域
- data engineering、etl、data science、workflow、python、dag、airflow和Apache Airflow
Apache Airflow员工
-
Mathew Wicks
AI/ML on Kubernetes | Kubeflow Lead | deployKF | Airflow Helm Chart
-
Albert Okiri
Driving Sustainable Environment Management @NuruData | Empowering Decision Makers @Acies Crest | Contributor @Apache Airflow
-
Harshit Mohan
Manager - Digital and Data Services at PwC
-
Anwesha Chowdhury
Generative AI Engineer | Open Source Contributor | ML Engineer
动态
-
Join Jarek Potiuk at OSA Con 2024 to discuss all things Airflow 3! https://osacon.io/
-
-
?? Exciting news— we're offering a FREE Airflow Fundamentals or DAG Authoring Certification to anyone who completes the Airflow Survey! Plus, you'll be entered into a raffle for a free DAG Writing Best Practices Workshop with Marc Lamberti ?? Please take the survey here and receive your perks! https://lnkd.in/gZHVFj4y
-
-
We've just released Apache Airflow 2.10.3 ?? ?? PyPI: https://lnkd.in/d8XfEC27 ?? Docs: https://lnkd.in/dkCZYKim ?? Release Notes: https://lnkd.in/dJaM36_s ?? Docker Image: "docker pull apache/airflow:2.10.3" Thanks to all the contributors who made this possible.
-
-
?? Have you taken the Annual Airflow Survey yet? ?? Don't worry- there's still time to join the 600+ Airflow users who have already taken the time to share their thoughts on the future of the project! ?? It takes less than 7 minutes, and you will receive a comped Airflow Fundamentals or DAG Authoring Certification ($150 value each), AND be entered into a raffle for a DAG Writing Workshop with Marc Lamberti! Take the survey here and impact the future of Airflow: https://lnkd.in/gZHVFj4y
-
-
Great article from Next Insurance about standardization of DAGs
?? Exciting News! I just published my first article on Medium! ?? As a data engineer and a big fan of Apache Airflow, I’m passionate about improving the quality and consistency of Airflow DAGs. In this article, I dive into how you can use Python’s Abstract Syntax Tree (AST) to lint your DAGs and standardize workflows across your team. Plus, I introduce DAGLint, a tool we built internally at Next Insurance to enforce best practices and ensure smooth operations. Check it out and let me know your thoughts!?? #DataEngineering #Airflow #Python
-
It's our favorite time of year! ?? Fall = Airflow Survey time, and we are thrilled to present this year's updated experience, making the survey easier, quicker, and just more fun to complete. On top of an improved experience, we're offering even more perks as our thanks for completing the survey, including: 1?? A complimentary Airflow Fundamentals Certification ($150 value) 2?? A complimentary DAG Authoring Certification ($150 value) 3?? The chance to enter a raffle to participate in a DAG Authoring Best Practices Workshop with Marc Lamberti Take the survey here— it's quick, easy, and makes a massive impact on the future of Apache Airflow: https://lnkd.in/gZHVFj4y
-
-
We are thrilled to announce that Vikram Koka has joined the Apache Airflow Project Management Committee (PMC)! ?? Vikram has been a key contributor to Airflow for over 5 years, playing a crucial role in shaping both the Airflow 2 release and the upcoming Airflow 3. He’s co-authored several impactful AIPs, including Scheduler HA (AIP-15) and Task Execution Interface (AIP-72), and delivered a fantastic keynote on Airflow 3 at this year’s Airflow Summit. This recognition is well-deserved, and we’re excited to see Vikram’s continued contributions to steering Airflow's future. Congratulations, Vikram! ??
-
Chief Strategy Officer at Astronomer, Apache Airflow Committer & PMC member, Board member
Airflow 3.0 will be the biggest Apache Airflow release in the last five years. I am excited to be part of the community working on it. #Airflow #Astronomer #dataorchestration #DataOps
What’s coming in Airflow 3 and beyond?
Vikram Koka，发布于领英
-
Glad to have shared ASAPP's work using Apache Airflow for MLOps/LLMOps on the official Apache Airflow blog: https://lnkd.in/eUNKYVtG
?? Exciting Read for the Apache Airflow Community! ??? We're thrilled to share a fantastic article from Medium by Udit Saxena from ASAPP, highlighting how they're leveraging Apache Airflow to enhance AI-powered contact centers. This deep dive offers a glimpse into their innovative approach to managing complex workflows and driving efficiency in their AI systems. Whether you're working on similar challenges or just curious about real-world applications of Airflow, this is definitely worth a read! #ApacheAirflow #DataEngineering #AI #MachineLearning #WorkflowAutomation
Airflow at ASAPP: Enhancing AI-Powered Contact Centers
medium.com