Glossary
Quick definitions of terms I use often — click a card to flip it, or open a term for the full write-up.
Airflow
Airflow
Airflow
Tap to flip
An orchestration platform for scheduling and monitoring workflows.
Full definition →Airflow
Config Param
Tap to flip
airflow.cfg — the central file controlling executor, database, parallelism, and other settings.
Full definition →Airflow
DAG
Tap to flip
Directed Acyclic Graph — a set of tasks with defined dependencies and no cycles.
Full definition →Airflow
Plugins
Tap to flip
The plugins/ folder Airflow auto-loads to register custom Operators, Hooks, Sensors, and UI views.
Full definition →Airflow
Requirements Folder
Tap to flip
requirements.txt — the Python dependencies DAGs need, installed into the Airflow environment at build time.
Full definition →Airflow
Scheduler
Tap to flip
The Airflow process that triggers task instances when their dependencies and schedule are met.
Full definition →Airflow
UI
Tap to flip
The Airflow web interface for viewing, triggering, and debugging DAG runs.
Full definition →Airflow
Web Server
Tap to flip
The Flask process that serves the Airflow UI.
Full definition →Python
Python
List (Python)
Tap to flip
An ordered, mutable collection of items.
Full definition →Python
Python
Tap to flip
A high-level, dynamically-typed language widely used for data engineering and scripting.
Full definition →AWS
AWS
Lambda
Tap to flip
AWS's serverless compute service — run code without provisioning servers.
Full definition →Data Management
Data Management
Data Governance
Tap to flip
The policies and processes that define who can access, change, and own data.
Full definition →Data Management
Data Quality
Tap to flip
How accurate, complete, and reliable data is for its intended use.
Full definition →RDBMS
RDBMS
RDS Postgres
Tap to flip
Managed PostgreSQL on AWS RDS — Postgres without the operational overhead.
Full definition →