July 19, 2023 What is ELT (Extract, Load, Transform)? A Beginner’s Guide 4 min read - ELT is a data processing method that involves extracting data from its source, loading it into a database or data warehouse, and then later transforming it to a format that suits business needs.
June 16, 2022 How Databand Achieves Automated Data Lineage 3 min read - See how Databand achieves automated data lineage so you can diagnose pipeline failures and downstream impacts.
September 7, 2021 Airflow’s best kept secrets: How to track metadata with Airflow Cluster Policies & Task Callbacks 6 min read - The time that it takes to detect problems within your Airflow tasks is a major problem. There’s one big reason for that. You didn’t write every DAG. It’s hard to find a scalable way to make your platform maintainable when there…
July 13, 2021 Using Databand’s Anomaly Detection to meet data delivery deadlines 8 min read - Anomaly detection can be a great tool for when your data pipelines have strict deadlines for delivery. The problem is actually implementing a good system for detecting the leading indicators of failure. Today, data engineers are dealing with a tangled…