Databases Intermediate

What is ETL (Extract, Transform, Load)?

A data pipeline process that extracts data from sources, transforms it into a suitable format, and loads it into a destination system.

ETL processes move data between systems. Extract pulls data from databases, APIs, files, or streams. Transform cleans, validates, enriches, and restructures the data. Load writes the processed data to a data warehouse or target system.

Modern variations include ELT (load raw data first, transform in the warehouse) and real-time streaming. Tools include Apache Airflow, dbt (transform layer), Apache Spark, and cloud services like AWS Glue. ETL is fundamental to data warehousing and analytics.

Learn More About This Topic

SQL for Absolute Beginners

Related reading

Redis Fundamentals

Related reading

MongoDB Fundamentals: Building Scalable NoSQL Applications with Document Databases

Related reading

Related Terms

CTE (Common Table Expression)

A temporary named result set defined within a SQL statement using the WITH clause, improving query readability and enabling recursion.

Database Constraint

Rules enforced by the database to maintain data integrity, including NOT NULL, UNIQUE, CHECK, PRIMARY KEY, and FOREIGN KEY.

Materialized View

A database object that stores the precomputed result of a query, offering faster reads at the cost of periodic refresh.

A PostgreSQL maintenance operation that reclaims storage from dead tuples and updates statistics for the query planner.

A category of databases that store data in non-tabular formats, optimized for specific data models and access patterns.

Full-Text Search

A technique for searching natural language text in databases using word stemming, ranking, and relevance scoring.

View All Databases Terms →