data transformation
Changing data formats
Data transformation is the process of converting data from one format, structure, or value system to another.
In computing and data science, this typically means cleaning, restructuring, or encoding data to make it suitable for analysis or compatible with different systems: The pipeline handles data transformation before loading into the warehouse.
More broadly, any systematic change to how information is organized or represented.
- data integrationMerging sources into one
- encodingConverting data to format
- normalizationAdjusting to a standard
- aggregationCombined collection of items
- filteringSelective passage of elements
mapping · ETL · pivoting · data wrangling · scaling · parsing · flat file · lookup table · business rules · reshaping · enrichment · deduplication · transpose · cleansing · pipeline · conversion · extract · migration
- integrationintegration, synthesis, fusion, merging, unifying
- data engineeringdata pipeline, ETL, data warehouse, data lake, batch processing
- data extractionweb scraping, data mining, export, parsing, crawling
data transformationdata storage
Retaining digital information
data retention · data preservation · data capture · data collection · no-op