data mining
Large-scale pattern discovery
Data mining is the process of analyzing large datasets to discover patterns, correlations, and useful information.
The term borrows from extractive mining—sifting through raw material to find something valuable.
In business, data mining helps identify customer behavior and market trends.
In research, it reveals relationships that might otherwise go unnoticed: Data mining of medical records suggested a link between the drug and heart attacks.
The practice raises privacy concerns when applied to personal information without consent.
Systematic grouping by traits
- clusteringForming concentrated groups
- regressionReturn to former state
- predictionForecast of coming events
- pattern recognitionIdentifying regularities in inputs
extraction · decision trees · k-means · neural networks · cross-validation
Initial data preparation steps
- feature engineeringCreating predictive input variables
- validationConfirming truth or accuracy
- evaluationDetermining worth or quality
- interpretationAssigned meaning
visualization · reporting · iteration · deployment · training set
Open-source cluster framework
- cloud computingInternet-delivered digital infrastructure
- NoSQLSchema-free database systems
- scalabilityCapacity for growth
- ETLSource-to-destination data process
classification
Systematic grouping by traits
- clusteringForming concentrated groups
- regressionReturn to former state
- predictionForecast of coming events
pattern recognition · extraction · decision trees · k-means · neural networks · cross-validation
preprocessing
Initial data preparation steps
- feature engineeringCreating predictive input variables
- validationConfirming truth or accuracy
- evaluationDetermining worth or quality
interpretation · visualization · reporting · iteration · deployment · training set
Hadoop
Open-source cluster framework
- cloud computingInternet-delivered digital infrastructure
- NoSQLSchema-free database systems
- scalabilityCapacity for growth
ETL · parallel processing · batch processing · SQL · storage
- Big DataHadoop, Kafka, Zookeeper, ETL, batch processing
- OSINTgeolocation, reverse image search, public records, digital footprint, IP tracking
- analysisanalyze, analysis, evaluate, examine, statistical analysis
- computingcomputer, computers, software, hardware, code
- digital societysocial networks, internet, digital age, internet culture, digital natives
- digital technologyinternet, software, streaming, computers, CGI
data miningprimary research
Data gathered directly by researcher
field research · data collection · experimentation · data entry · data destruction
data, mineral, mining, miner, minerals, mined, miners, database, minefield