parallelizing
Splitting across processors
Parallelizing is dividing a task so that its parts can be executed simultaneously rather than sequentially.
The term comes from computing, where parallelizing code distributes work across multiple processors: Parallelizing the algorithm cut processing time by 80%.
The concept extends to any effort at running operations in parallel: We're parallelizing our hiring process to fill positions faster.
Twisted fiber strands
- coresCentral essential parts
- multiprocessingConcurrent execution across CPUs
- distributedDivided and given out
- concurrencyOverlapping execution of tasks
Hadoop · vectorization · multicore · cluster · grid · supercomputer · pipelining · dataflow
Increase in pace
- scalabilityCapacity for growth
- throughputProcessing rate over time
- latencyDelay in system response
- bottleneckConstriction limiting throughput
overhead · bandwidth · acceleration · efficiency · partitioning · granularity · benchmarking
Units of work
- batchingProcessing in sets
- schedulingAssigning times to events
- queuingStanding in ordered sequence
- pipelineLong-distance fluid transport tube
chunking · splitting · merging · fan-out · orchestration
Mutual blocking, no progress
- semaphoreFlag-based signaling system
- barrierObstruction preventing passage
- lockMechanism requiring a key
- atomicityAtoms in a molecule
starvation · blocking · non-blocking · coordination · futures · promises
threads
Twisted fiber strands
- coresCentral essential parts
- multiprocessingConcurrent execution across CPUs
- distributedDivided and given out
concurrency · Hadoop · vectorization · multicore · cluster · grid · supercomputer · pipelining · dataflow · sharding
speedup
Increase in pace
- scalabilityCapacity for growth
- throughputProcessing rate over time
- latencyDelay in system response
bottleneck · overhead · bandwidth · acceleration · efficiency · partitioning · granularity · benchmarking
tasks
Units of work
- batchingProcessing in sets
- schedulingAssigning times to events
- queuingStanding in ordered sequence
pipeline · chunking · splitting · merging · fan-out · orchestration
deadlock
Mutual blocking, no progress
- semaphoreFlag-based signaling system
- barrierObstruction preventing passage
- lockMechanism requiring a key
atomicity · starvation · blocking · non-blocking · coordination · futures · promises
parallelizingconsolidating
Combining dispersed elements
unifying · merging · centralizing · serializing · chaining
parallel, parallels, unparalleled, parallelism, paralleling, parallelogram, parallax, nonparallel, antiparallel