Databases Intermediate

What is ETL (Extract, Transform, Load)?

A data pipeline process that extracts data from sources, transforms it into a suitable format, and loads it into a destination system.

ETL processes move data between systems. Extract pulls data from databases, APIs, files, or streams. Transform cleans, validates, enriches, and restructures the data. Load writes the processed data to a data warehouse or target system.

Modern variations include ELT (load raw data first, transform in the warehouse) and real-time streaming. Tools include Apache Airflow, dbt (transform layer), Apache Spark, and cloud services like AWS Glue. ETL is fundamental to data warehousing and analytics.

Learn More About This Topic

SQL for Absolute Beginners

Related reading

Redis Fundamentals

Related reading

MongoDB Fundamentals: Building Scalable NoSQL Applications with Document Databases

Related reading

Related Terms

A situation where two or more transactions permanently block each other by each holding locks that the other needs.

Database Backup

The process of creating copies of database data to protect against data loss from failures, corruption, or human error.

Prepared Statement

A pre-compiled SQL template that uses parameters instead of literal values, preventing SQL injection and improving performance.

The process of copying and maintaining database data across multiple servers for redundancy, failover, and read scaling.

A middleware server that sits between applications and databases, providing connection pooling, load balancing, and query routing.

A category of databases that store data in non-tabular formats, optimized for specific data models and access patterns.

View All Databases Terms →