Hadoop
Distributed computing platform
Hadoop is an open-source software framework for storing and processing massive datasets across clusters of computers.
It enables distributed computing—breaking enormous tasks into smaller pieces handled by many machines working in parallel.
Hadoop became foundational to big data processing in the 2010s: We migrated our analytics pipeline to Hadoop.
The name comes from a toy elephant belonging to the creator's child.
Gathered group nearby
- distributedDivided and given out
- scalableAble to increase capacity
- petabyteQuadrillion bytes measured
- batchQuantity produced together
processing · analytics · warehouse · ETL · ingestion · pipeline · parallel · nodes
Gathered group nearby
- rackFrame for holding items
- commodityFungible traded good
- serverOne who attends tables
- masterAuthority or controller
slave · fault-tolerant · failover · heartbeat · block · replication · storage · network
Nineties web services pioneer
- GoogleDominant web search provider
- CuttingDividing by blade
- elephantTusked gray giant
- ApacheSouthwestern indigenous nation
open-source · 2006 · Java · pioneer · revolution · paradigm · legacy · predecessor
cluster
Gathered group nearby
- distributedDivided and given out
- scalableAble to increase capacity
- petabyteQuadrillion bytes measured
batch · processing · analytics · warehouse · ETL · ingestion · pipeline · parallel · nodes · commodity
cluster
Gathered group nearby
master · slave · fault-tolerant · failover · heartbeat · block · replication · storage · network · bandwidth
Yahoo
Nineties web services pioneer
Apache · open-source · 2006 · Java · pioneer · revolution · paradigm · legacy · predecessor · evolution
Zookeeper
Wildlife facility attendant
IBM
Multinational technology corporation
- MicrosoftRedmond technology corporation
- AmazonGreek warrior women
- AzureMicrosoft cloud computing service
EMR · vendor · license · support · migration · legacy · on-premises · hybrid · deployment · consultant
- parallel computingmultiprocessors, shared memory, supercomputers, UPC, Linda
- techsoftware, hardware, code, coding, programming
- software toolsapp, program, software, compiler, debugger
- databasesSQL, table, databases, database, tables
- distributed systemsload balancing, sharding, replication, partitioning, clustering
- Big DataKafka, Zookeeper, data lake, ETL, data pipeline