A CDE Definition
The massive amounts of data collected over time that are difficult to analyze and handle using common database management tools. The data are analyzed for marketing trends in business as well as in the fields of manufacturing, medicine and science. The types of data include business transactions, email messages, photos, surveillance videos, activity logs and unstructured text from blogs and social media, as well as the huge amounts of data that can be collected from sensors of all varieties (see machine-generated data).
Big Data Storage and Big Data Analytics
The storage industry is continuously challenged as Big Data increases exponentially. While the physical storage can be enhanced with more terabyte drive arrays, the software infrastructure must be flexible enough to quickly and economically accommodate ever greater volumes of transactions and queries. See Hadoop, Spark and cloud computing).
The analytical challenge is deriving meaningful information from data in petabyte and exabyte volumes. Big Data analytics breaks down the data sets into smaller chunks for efficient processing and employs parallel computing to derive intelligence for effective decision-making (see MPP).
Big Data Vs. Market Research
Analyzing Big Data may be able to forecast trends and people's habits without the kind of explanation one would derive from traditional market research. The Big Data patterns show the next probable behavior of a person or market without a logical explanation as to why. Right, wrong or indifferent, Big Data has been one of the hottest buzzwords of the 2010s. See Petabyte Age and Google Zeitgeist.
Before/After Your Search Term
Terms By Topic
Click any of the following categories for a list of fundamental terms.