data lake
Raw information pool
A data lake is a storage system that holds vast amounts of raw data in its native format until needed for analysis.
Unlike traditional databases that require data to be structured before storage, data lakes accept everything—structured, semi-structured, unstructured—and impose organization later.
The company dumped all its customer data into a data lake for the analytics team to mine.
The metaphor suggests a natural reservoir: data flows in from many streams and pools until someone draws from it.
Huge data measurement unit
- exabytesQuintillion-byte units
- scalabilityCapacity for growth
- horizontal scalingAdding machines to distribute load
- throughputProcessing rate over time
batch processing · elasticity · parallel processing · terabytes
Lacking imposed order
- semi-structuredBetween rigid and freeform
- structuredArranged in organized form
- metadataDescriptive information about content
- ETLSource-to-destination data process
ELT · partitioning · federated
Place for storing things
- cloud storageOnline data preservation service
- GCPGoogle's cloud computing platform
- HadoopOpen-source cluster framework
- archiveStored historical records
retention · ingestion · blobs · bucket · cold storage · lakehouse · Snowflake
Database manipulation language
- AthenaGreek wisdom deity
- business intelligenceData analysis for decisions
- dashboardsVehicle information panels
- aggregationCombined collection of items
Restricting resource availability selectively
- complianceAdhering to requirements
- audit trailChronological record of transactions
- GDPREU data protection law
- catalogingSystematic organization into records
petabytes
Huge data measurement unit
- exabytesQuintillion-byte units
- scalabilityCapacity for growth
- horizontal scalingAdding machines to distribute load
throughput · batch processing · elasticity · parallel processing · terabytes
unstructured
Lacking imposed order
- semi-structuredBetween rigid and freeform
- structuredArranged in organized form
- metadataDescriptive information about content
ETL · ELT · partitioning · federated
repository
Place for storing things
- cloud storageOnline data preservation service
- GCPGoogle's cloud computing platform
- HadoopOpen-source cluster framework
archive · retention · ingestion · blobs · bucket · cold storage · lakehouse · Snowflake
SQL
Database manipulation language
- AthenaGreek wisdom deity
- business intelligenceData analysis for decisions
- dashboardsVehicle information panels
access control
Restricting resource availability selectively
- complianceAdhering to requirements
- audit trailChronological record of transactions
- GDPREU data protection law