dataflow

Operation-driven processing

Dataflow describes how data moves through a system—from input to processing to output.

In computing, dataflow programming treats programs as directed graphs where data flows between operations, rather than following sequential instructions.

The term also describes documentation of how information passes between components: The dataflow diagram shows how customer orders move through the system.

computing

pipeline

Long-distance fluid transport tube

scheduling · graph · reactive · programming · asynchronous · synchronization · multithreading · dependency · throughput · scalability

network

routing

Path selection process

protocols · buffering · congestion · throughput · switching · multiplexing · queueing · transmission · TCP · UDP

systems

architecture

Building design discipline

  • ETLSource-to-destination data process
  • warehousingStoring goods commercially
  • analyticsSystematic examination of datasets

schema · indexing · storage · query · repository · metadata · normalization · ingestion · orchestration · spark

visual

diagram

Simplified explanatory sketch

visualization · modeling · notation · symbols · documentation · blueprint · schematic · whiteboard · miro

Categories
Opposites
information movement direction

dataflowdata storage

Retaining digital information

data retention

control mechanism

dataflowpolling

Systematic opinion gathering

information movement

dataflowbatch processing

Running queued jobs automatically

Family

flow, data, flowing, overflow, database, datum, dataset, databank, datalink

Familiarity
Top 1,000,000
Profile
Used worldwide · Timeless · Abstract · Rated G