🚀 Expert — Metadata, Logging & Monitoring
1. What is the primary purpose of the Airflow Metadata Database?
2. Which database is commonly recommended for production Airflow metadata?
3. Why is remote logging commonly enabled in production?
4. Which cloud storage service can be used for remote logging?
5. Which practice is recommended for managing sensitive credentials in Airflow?
6. Which Airflow feature helps notify users when a DAG or task exceeds an expected execution time?
7. What is the purpose of configuring task retries?
8. Which command is commonly used to test a DAG without triggering the scheduler?
9. Which Python testing framework is widely used for unit testing Airflow DAGs?
10. Why should DAG validation and linting be included in CI/CD pipelines?