A CDE Definition
A component of "Big Data," the huge volume of data created by software alone rather than from business transactions such as orders, comments and support questions that are initiated by humans. Examples of machine data are the numerous system logs generated by the operating system and other infrastructure software in the normal course of the day, as well as Web page request and clickstream logs produced by Web servers. Network management logs and telecom call detail records are also machine-generated data. See Big Data.
The massive amounts of data collected over time that are difficult to analyze and handle using common database management tools. The data are analyzed for marketing trends in business as well as in the fields of manufacturing, medicine and science. The types of data include business transactions, email messages, photos, surveillance videos, activity logs and unstructured text from blogs and social media, as well as the huge amounts of data that can be collected from sensors of all varieties (see machine-generated data).
Big Data Storage and Big Data Analytics
The storage industry is continuously challenged as Big Data increases exponentially. While the physical storage can be enhanced with more terabyte drive arrays, the software infrastructure must be flexible enough to quickly and economically accommodate ever greater volumes of transactions and queries. See Hadoop, Spark and cloud computing).
The analytical challenge is deriving meaningful information from data in petabyte and exabyte volumes. Big Data analytics breaks down the data sets into smaller chunks for efficient processing and employs parallel computing to derive intelligence for effective decision-making (see MPP).
Big Data Vs. Market Research
Analyzing Big Data may be able to forecast trends and people's habits without the kind of explanation one would derive from traditional market research. The Big Data patterns show the next probable behavior of a person or market without a logical explanation as to why. Right, wrong or indifferent, Big Data has been one of the hottest buzzwords of the 2010s. See Petabyte Age and Google Zeitgeist.
Before/After Your Search Term
Terms By Topic
Click any of the following categories for a list of fundamental terms.