Data with Marc

@MarcLamberti - 82 本の動画

チャンネル登録者数 3.46万人

This channel is to help data engineers start or improve their skills around the most exciting data engineering tools. I'm obsessed with providing high-value ...

最近の動画

Write your first DAG in Airflow 3 for beginners 20:13

Write your first DAG in Airflow 3 for beginners

Real-Time Event-Driven Data Pipelines in Apache Airflow 14:30

Real-Time Event-Driven Data Pipelines in Apache Airflow

What's new in Apache Airflow 3? 22:52

What's new in Apache Airflow 3?

Introduction to Claude Code: Python Case Study with Apache Airflow 12:19

Introduction to Claude Code: Python Case Study with Apache Airflow

10x your Airflow DAGs development with Cursor AI 27:27

10x your Airflow DAGs development with Cursor AI

Build an AI Agent and talk to your Airflow DAGs 16:54

Build an AI Agent and talk to your Airflow DAGs

Loading data into S3 Iceberg Tables with AWS EMR and Apache Airflow 22:45

Loading data into S3 Iceberg Tables with AWS EMR and Apache Airflow

How to run PySpark with Apache Airflow: The new way! 15:17

How to run PySpark with Apache Airflow: The new way!

Mini Data Engineering Project: Monitor Apache Airflow with Airbyte, Snowflake, and Superset 39:13

Mini Data Engineering Project: Monitor Apache Airflow with Airbyte, Snowflake, and Superset

What's new in Apache Airflow 2.10? 15:50

What's new in Apache Airflow 2.10?

Airflow DAG Factory: Create DAGs dynamically with YAML 16:00

Airflow DAG Factory: Create DAGs dynamically with YAML

Backfill your DAGs in Apache Airflow: Everything you need to know 23:14

Backfill your DAGs in Apache Airflow: Everything you need to know

The NEW way to ingest data with Airflow in a single task! 20:59

The NEW way to ingest data with Airflow in a single task!

What's new in Apache Airflow 2.9? 13:24

What's new in Apache Airflow 2.9?

Airflow Notifications with Microsoft Teams and Notifiers 14:09

Airflow Notifications with Microsoft Teams and Notifiers

Airflow Tutorial: Create Data Pipelines with No Airflow Knowledge! 7:48

Airflow Tutorial: Create Data Pipelines with No Airflow Knowledge!

What's new in Apache Airflow 2.8? 9:58

What's new in Apache Airflow 2.8?

The New Airflow UI Explained 15:18

The New Airflow UI Explained

Configure VS Code to Develop Airflow DAGs with Docker at ease! 11:02

Configure VS Code to Develop Airflow DAGs with Docker at ease!

Getting Started with Airflow for Beginners 16:00

Getting Started with Airflow for Beginners

What is Apache Airflow? For beginners 11:50

What is Apache Airflow? For beginners

The ExternalPythonOperator: No more dependency conflicts in Apache Airflow 11:42

The ExternalPythonOperator: No more dependency conflicts in Apache Airflow

Why Airflow? The Top 5 Reasons To Use It! 10:01

Why Airflow? The Top 5 Reasons To Use It!

Airflow Tutorial: Running Data Quality Checks with Snowflake and Soda 28:06

Airflow Tutorial: Running Data Quality Checks with Snowflake and Soda

What's new in Apache Airflow 2.7? 12:55

What's new in Apache Airflow 2.7?

Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more! 1:01:31

Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more!

Managed Apache Airflow With Astro! Goodbye MWAA and GCC 16:04

Managed Apache Airflow With Astro! Goodbye MWAA and GCC

What's new in Apache Airflow 2.6? 9:53

What's new in Apache Airflow 2.6?

Airflow TriggerDagRunOperator in 60 seconds #shorts 0:56

Airflow TriggerDagRunOperator in 60 seconds #shorts

Airflow Quickstart Project with DuckDB, MinIO and Streamlit 13:38

Airflow Quickstart Project with DuckDB, MinIO and Streamlit

Airflow ExternalTaskSensor in 60 seconds #shorts 1:00

Airflow ExternalTaskSensor in 60 seconds #shorts

Airflow Datasets in 60 seconds #shorts 0:59

Airflow Datasets in 60 seconds #shorts

Why Airflow DAG dependencies in 60 seconds? #shorts 0:56

Why Airflow DAG dependencies in 60 seconds? #shorts

Airflow DAG dependencies: The Datasets, TriggerDAGRunOperator, and ExternalTaskSensor 17:15

Airflow DAG dependencies: The Datasets, TriggerDAGRunOperator, and ExternalTaskSensor

Airflow with DBT tutorial - The best way! 17:54

Airflow with DBT tutorial - The best way!

What They Don't Tell You About Apache Airflow 11:10

What They Don't Tell You About Apache Airflow

Installing and Running Airflow on a small AWS EC2 Instance 14:11

Installing and Running Airflow on a small AWS EC2 Instance

DuckDB Tutorial - DuckDB course for beginners 25:53

DuckDB Tutorial - DuckDB course for beginners

What's new in Apache Airflow 2.5? 7:52

What's new in Apache Airflow 2.5?

Airflow DAG: Make your data pipelines better! 13:06

Airflow DAG: Make your data pipelines better!

The New Way of Scheduling DAGs in Airflow with Datasets 11:52

The New Way of Scheduling DAGs in Airflow with Datasets

Airflow Data Pipeline with AWS and Snowflake for Beginners | Project 24:09

Airflow Data Pipeline with AWS and Snowflake for Beginners | Project

What's new in Apache Airflow 2.4? 6:34

What's new in Apache Airflow 2.4?

Dynamic DAGs in Apache Airflow for Advanced 13:49

Dynamic DAGs in Apache Airflow for Advanced

Airflow DAG Scheduling in 5 mins 4:56

Airflow DAG Scheduling in 5 mins

Airflow Dynamic DAGs: The powerful way with Jinja and YAML 13:43

Airflow Dynamic DAGs: The powerful way with Jinja and YAML

Airflow DockerOperator: The Basics (and more 🤫) 19:36

Airflow DockerOperator: The Basics (and more 🤫)

Airflow Data Pipelines with Github Copilot?! 12:06

Airflow Data Pipelines with Github Copilot?!

Airflow Sensors : Get started in 10 mins 11:55

Airflow Sensors : Get started in 10 mins

Airflow Helm Chart : Quick Start For Beginners in 10mins 13:06

Airflow Helm Chart : Quick Start For Beginners in 10mins

Configure Airflow 2.0 with LDAP in 15 mins 17:17

Configure Airflow 2.0 with LDAP in 15 mins

Big data in Airflow? Discover the XCom Backends with AWS S3! 20:44

Big data in Airflow? Discover the XCom Backends with AWS S3!

Airflow DAG: Coding your first DAG for Beginners 20:31

Airflow DAG: Coding your first DAG for Beginners

Running Airflow 2.0 with Docker in 5 mins 11:55

Running Airflow 2.0 with Docker in 5 mins

The TriggerDagRunOperator in Airflow! Create DAG dependencies at ease 12:23

The TriggerDagRunOperator in Airflow! Create DAG dependencies at ease

Apache Airflow: Adios SubDAGs! Welcome TaskGroups! 6:53

Apache Airflow: Adios SubDAGs! Welcome TaskGroups!

The Airflow BranchPythonOperator for Beginners in 10 mins 12:27

The Airflow BranchPythonOperator for Beginners in 10 mins

Airflow XCom for Beginners - All you have to know in 10 mins 11:36

Airflow XCom for Beginners - All you have to know in 10 mins

Apache Airflow with AWS RDS 11:39

Apache Airflow with AWS RDS

Running Apache Airflow with the KubernetesExecutor on a multi-node Kubernetes cluster locally 19:48

Running Apache Airflow with the KubernetesExecutor on a multi-node Kubernetes cluster locally

Airflow 2.0: What to expect? 10:42

Airflow 2.0: What to expect?

Apache Airflow: Storing logs in AWS S3 14:41

Apache Airflow: Storing logs in AWS S3

Apache Airflow: The Celery Executor with MySQL and RabbitMQ 5:57

Apache Airflow: The Celery Executor with MySQL and RabbitMQ

Apache Airflow: The ExternalTaskSensor demystified 14:03

Apache Airflow: The ExternalTaskSensor demystified

Apache Airflow: How to define variables through environment variables 15:11

Apache Airflow: How to define variables through environment variables

Apache Airflow: How to fix dependencies errors 3:50

Apache Airflow: How to fix dependencies errors

Scaling Apache Airflow with the Kubernetes Executors 5:17

Scaling Apache Airflow with the Kubernetes Executors

Password authentication and filtering by owner in Apache Airflow 9:39

Password authentication and filtering by owner in Apache Airflow

Variables, Macros and Templating in Apache Airflow 4:41

Variables, Macros and Templating in Apache Airflow

Introduction to metrics for monitoring Apache Airflow 4:34

Introduction to metrics for monitoring Apache Airflow

How to use timezones in Apache Airflow 3:57

How to use timezones in Apache Airflow

Apache Airflow | How to Use the DockerOperator with Airflow 4:23

Apache Airflow | How to Use the DockerOperator with Airflow

Apache Airflow | Building And Running Your First Airflow Docker Image 4:03

Apache Airflow | Building And Running Your First Airflow Docker Image

Apache Airflow | Running Airflow Using Sequential Executor With Docker 4:59

Apache Airflow | Running Airflow Using Sequential Executor With Docker

Apache Airflow | Getting Results From PostgreSQL Using Hooks 4:51

Apache Airflow | Getting Results From PostgreSQL Using Hooks

Apache Airflow | How to Create an Operator 6:58

Apache Airflow | How to Create an Operator

Apache Airflow | Coding Your First Dag 4:07

Apache Airflow | Coding Your First Dag

Apache Airflow | What Is a DAG? 3:32

Apache Airflow | What Is a DAG?

Apache Airflow | Minimising DAGs With SubDAGs 1:40

Apache Airflow | Minimising DAGs With SubDAGs

Apache Airflow | How to Use Operators 6:20

Apache Airflow | How to Use Operators

Apache Airflow | What Is An Operator 3:14

Apache Airflow | What Is An Operator

Master Big Data Tools with our Online Courses 0:39

Master Big Data Tools with our Online Courses

人気の動画

Airflow DAG: Coding your first DAG for Beginners 20:31

Airflow DAG: Coding your first DAG for Beginners

26万 回視聴 - 4 年前

Running Airflow 2.0 with Docker in 5 mins 11:55

Running Airflow 2.0 with Docker in 5 mins

18万 回視聴 - 4 年前

Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more! 1:01:31

Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more!

8.3万 回視聴 - 1 年前

Airflow with DBT tutorial - The best way! 17:54

Airflow with DBT tutorial - The best way!

6.3万 回視聴 - 2 年前

Apache Airflow: The ExternalTaskSensor demystified 14:03

Apache Airflow: The ExternalTaskSensor demystified

5.8万 回視聴 - 5 年前

What is Apache Airflow? For beginners 11:50

What is Apache Airflow? For beginners

5万 回視聴 - 1 年前

Airflow XCom for Beginners - All you have to know in 10 mins 11:36

Airflow XCom for Beginners - All you have to know in 10 mins

4.9万 回視聴 - 4 年前

DuckDB Tutorial - DuckDB course for beginners 25:53

DuckDB Tutorial - DuckDB course for beginners

4.2万 回視聴 - 2 年前

The TriggerDagRunOperator in Airflow! Create DAG dependencies at ease 12:23

The TriggerDagRunOperator in Airflow! Create DAG dependencies at ease

3.8万 回視聴 - 4 年前

Why Airflow? The Top 5 Reasons To Use It! 10:01

Why Airflow? The Top 5 Reasons To Use It!

3.5万 回視聴 - 1 年前

Apache Airflow | Getting Results From PostgreSQL Using Hooks 4:51

Apache Airflow | Getting Results From PostgreSQL Using Hooks

3.3万 回視聴 - 6 年前

Installing and Running Airflow on a small AWS EC2 Instance 14:11

Installing and Running Airflow on a small AWS EC2 Instance

3.2万 回視聴 - 2 年前