parallel computing
Multi-core task division
Parallel computing is processing multiple calculations or tasks simultaneously rather than sequentially.
Traditional computing executes one instruction at a time; parallel computing divides work across multiple processors, cores, or machines working in concert.
The approach dramatically speeds up problems that can be broken into independent parts: The simulation used parallel computing to model weather patterns across thousands of grid points.
Common in scientific research, graphics rendering, and large-scale data analysis.
Ultra-powerful computing system
- clusterGathered group nearby
- BeowulfOld English epic's protagonist
- batch processingRunning queued jobs automatically
- PBSNon-profit educational broadcaster
Passing strand through opening
- multithreadingParallel execution paths
- concurrencyOverlapping execution of tasks
- race conditionOutcome depends on timing
- deadlockMutual blocking, no progress
semaphore · critical section · non-blocking · starvation · monitor · futures
Increase in pace
- scalabilityCapacity for growth
- efficiencyProductive without waste
- throughputProcessing rate over time
- overheadLocated directly above
granularity · load balancing · bottleneck · profiling · benchmarking · hotspot · instrumentation
Open-source cluster framework
- fault toleranceSystem continues despite failures
- load balancingDistributing work across resources
- nodesPoints of connection
- replicationAct of duplicating precisely
Having several processors
- GPUVisual processing hardware
- coprocessorSupplementary computational unit
- shared memoryJointly accessible mental or digital storage
- interconnectJoin in a network
supercomputer
Ultra-powerful computing system
- clusterGathered group nearby
- BeowulfOld English epic's protagonist
- batch processingRunning queued jobs automatically
PBS · workstation · rack · datacenter
threading
Passing strand through opening
- multithreadingParallel execution paths
- concurrencyOverlapping execution of tasks
- race conditionOutcome depends on timing
deadlock · semaphore · critical section · non-blocking · starvation · monitor · futures
speedup
Increase in pace
- scalabilityCapacity for growth
- efficiencyProductive without waste
- throughputProcessing rate over time
overhead · granularity · load balancing · bottleneck · profiling · benchmarking · hotspot · instrumentation
Hadoop
Open-source cluster framework
- fault toleranceSystem continues despite failures
- load balancingDistributing work across resources
- nodesPoints of connection
multicore
Having several processors
- GPUVisual processing hardware
- coprocessorSupplementary computational unit
- shared memoryJointly accessible mental or digital storage
- computingcomputer, computers, software, hardware, code
- distributed systemsload balancing, sharding, replication, partitioning, clustering
- Computing Modelsbiocomputing, supercomputing
- computing operationscompiling, debugging, executing, parsing, indexing
- cyberinfrastructurenetwork infrastructure, data centers, supercomputers, supercomputing, university networks
- CFDfluid flow, turbulent flow, laminar flow, boundary conditions, incompressible flow
parallel, compute, computing, parallels, computation, parallelism, paralleling, paralegal, parallax