What is the big data era?

Question 1: What is the era of big data? The world contains an unimaginable amount of digital information, becoming more and faster... From business to science, from politics to art, this impact is everywhere Not here. Scientists and computer engineers have coined a new term for this phenomenon: "big data." What does the era of big data mean? What does the concept of big data mean? What does big data analysis mean? So-called big data, what exactly is big data, where does it come from, and what is its definition?

1: Definition of big data.

1. Big data, also known as huge amounts of data, refers to the amount of data involved that is so huge that it cannot be captured, managed, and processed by the human brain or even mainstream software tools within a reasonable time. , and organize it into information that helps companies make more positive business decisions.

2. Big data technology refers to the ability to quickly obtain valuable information from various types of big data, including data collection, storage, management, analysis and mining, visualization and other technologies and its integration. Technologies applicable to big data include massively parallel processing (MPP) databases, data mining grids, distributed file systems, distributed databases, cloud computing platforms, the Internet, and scalable storage systems.

The Internet is a magical network, and big data development is also a model. If you really want to understand big data, you can come here. The starting number of this mobile phone is 187, the middle number is 3er0 and the last number It's 14250, you can find it by combining them in order. What I want to say is, unless you want to do it or understand the content, if you are just joining in the fun, don't come.

3. Big data application refers to the act of integrating and applying big data technology to specific big data *** to obtain valuable information. For different businesses in different fields, different enterprises, or even the same business of different enterprises in the same field, due to differences in business needs, data mining and analysis and mining goals, the big data technology and big data information system used may also be different. There is quite a big difference. Only by adhering to the synchronous development of the trinity of "objects, technology, and applications" can the value of big data be fully realized.

When your technology reaches its limit, that is the limit of data. "Big data is not about how to define it, the most important thing is how to use it. The biggest challenge is which technologies can better use data and how big data can be used." How is the application of data? Compared with traditional databases and the rise of open source big data analysis tools such as Hadoop, what is the value of these unstructured data services?

2: Big data. Types and value mining methods

1. The types of big data can be roughly divided into three categories:

1) Traditional enterprise data (Traditional enterprise data): including consumer data from CRM systems, traditional ERP data, inventory data and accounting data, etc.

2) Machine-generated/sensor data: including call records (CallDetail Records), smart meters, industrial equipment sensors, equipment logs. (Usually Digital exhaust), transaction data, etc.

3) Social data: including user behavior records, feedback data, etc.

2. There are four main methods for mining business value from big data:

1) Segment customer groups and then customize special services for each group.

2. )Simulate the real environment, explore new needs and improve the return on investment

3) Strengthen departmental connections and improve the efficiency of the entire management chain and industrial chain

4) Reduce. Service costs, discover hidden clues to innovate products and services.

Three: Characteristics of big data

The industry usually uses four V (i.e. Volume, Variety, Value, Velocity) to summarize the characteristics of big data. Specifically, big data has four basic characteristics:

1. It is a huge data volume

Large data volumes (volumes) refer to large data sets, generally 10TB About the scale, but in practical applications, many enterprise users put multiple data sets together, forming a PB-level data volume; Baidu data shows that its new...gt;gt;

Question 2: Big data era: What is big data? What is big data? Is it an operating model, a capability, a technology, or a collective name for data security? What is the difference between what we call “big data” today and “data” in the traditional sense in the past? What are the sources of big data? etc. Of course, I am not an expert or scholar, and I cannot give an authoritative definition that will convince everyone. The following is just a summary based on my own understanding. I only seek to express my personal understanding and do not seek comprehensive authority. Let’s start with the difference between “big data” and “data.” In the past, the “data” we talked about largely referred to “numbers,” such as the number of customers, business volume, operating income, and profits. Etc., they are all numbers or simple text that can be encoded. These data are relatively simple to analyze, and traditional data solutions (such as databases or business intelligence technology) in the past can easily handle it; but today we call " "Big data" does not simply refer to "numbers", but may also include "text, pictures, audio, video..." and other formats. It covers a very rich content, such as our blog, Weibo, light blog, our Audio and video sharing, our call recordings, our location information, our review information, our transaction information, interactive information, etc., everything is included. To summarize in formal sentences, "data" is structured, while "big data" includes "structured data", "semi-structured data" and "unstructured data". Regarding "structured", "semi-structured" and "unstructured", it may be difficult to understand literally. Here I try to use my language to see if I can express it vividly: Since data is structured, data analysis can Following certain existing rules, such as through simple linear correlation, data analysis can roughly predict next month's operating income; while big data is semi-structured and unstructured, and the rules it follows during the analysis process are: Unknown, it simulates by integrating all aspects of information, it evaluates evidence in an analytical form, assumes response results, and calculates the credibility of each possibility. Through big data analysis, we can accurately find the next market hot spot. Based on this, perhaps we can give a definition of "big data". "Big data" refers to the ability to collect and analyze a large amount of information, and this information involves all aspects of human life. The purpose is to find out the past unknowns from complex data. Laws that are easy to show. Compared with "data", "big data" has two obvious characteristics: first, as mentioned above, the attributes of data include structured, unstructured and semi-structured data; second, data frequently Generate interactions, conduct data analysis on a large scale, and conduct data mining in real-time in conjunction with the business. After solving what big data is, there is another question, what are the sources of big data? Or it would be clearer to express this question like this: "What are the data sources of big data?" For enterprises, there are two main data sources of big data. One part comes from the operational data generated in the enterprise's own information system. These Most of the data is standardized and structured. (If further refinement is continued, the internal information system of the enterprise can be divided into two categories. One is the "basic system", which is used to improve the efficiency of daily business such as personnel, accounting processing, and receiving orders; the other is the "information system" ", used to support business strategies, conduct market analysis, develop customers, etc.) The data used in traditional business intelligence systems is basically the data part.

The other part comes from the outside, including unstructured data that widely exists in social networks, the Internet of Things, e-commerce, etc. These unstructured data consist of social media data originating from Facebook, Twitter, LinkedIn and other sources, and their generation is often accompanied by the continuous emergence and application of new channels and technologies such as social networks, mobile computing and sensors. This includes, for example, call detail records, device and sensor information, GPS and geolocation mapping data, massive image files transferred via managed file transfer protocols, Web text and clickstream data, scientific information, email, and more. Due to different sources and types of data, different aspects of the same thing can be seen. Taking consumer customers as an example, consumption record information can reveal the customer's consumption ability, consumption frequency, consumption points of interest, etc., and channel information can reveal the customer's channels. Preferences and consumption payment information can reveal the customer's payment channel situation, and there are many more, such as whether the customer will share the consumption situation on social networking sites, whether the customer has searched for relevant keywords on the search engine before and after consumption, etc., this information ( Or data)...gt;gt;

Question 3: What does the era of big data mean? Detailed explanation: McKinsey, a world-renowned consulting firm, was the first to propose the arrival of the "big data" era. McKinsey said: "Data has penetrated into every industry and business function field today and has become an important production factor. People are mining and applying massive amounts of data. It heralds the arrival of a new wave of productivity growth and consumer surplus. "Big data" has existed for a long time in fields such as physics, biology, environmental ecology, and industries such as military, finance, and communications. The development of the Internet and information industry has attracted people's attention. Big data is another disruptive technological revolution in the IT industry after cloud computing and the Internet of Things. Cloud computing mainly provides places and channels for the storage and access of data assets, and data is the truly valuable asset. The amount of business transaction information within the enterprise, commodity logistics information in the Internet world, person-to-person interaction information, location information, etc. in the Internet world will far exceed the carrying capacity of the existing enterprise IT architecture and infrastructure, and the real-time requirements It will also greatly exceed existing computing power. How to revitalize these data assets and make them serve national governance, corporate decision-making and even personal life is the core issue of big data, and it is also the inner soul and inevitable upgrade direction of cloud computing.

Question 4: In the era of big data, what is the concept of big data and big data analysis? The world contains an unimaginable amount of digitized information, becoming more and more rapidly... From business to science, from politics to art, the impact is everywhere. Scientists and computer engineers have coined a new term for this phenomenon: "big data." What does the big data era mean? What does the concept of big data mean? What does big data analysis mean? The so-called big data, what exactly is big data, where does it come from, and what is its definition?

1: Definition of big data.

1. Big data, also known as huge amounts of data, refers to the amount of data involved that is so huge that it cannot be captured, managed, and processed by the human brain or even mainstream software tools within a reasonable time. , and organize it into information that helps companies make more positive business decisions. 2. Big data technology refers to the ability to quickly obtain valuable information from various types of big data, including data collection, storage, management, analysis and mining, visualization and other technologies and their integration. Technologies applicable to big data include massively parallel processing (MPP) databases, data mining grids, distributed file systems, distributed databases, cloud computing platforms, the Internet, and scalable storage systems.

The Internet is a magical network, and big data development is also a model. If you really want to understand big data, you can come here. The starting number of this mobile phone is 187, the middle number is 3er0 and the last number It's 14250, you can find it by combining them in order. What I want to say is, unless you want to do it or understand the content, if you are just joining in the fun, don't come.

3. Big data application refers to the act of integrating and applying big data technology to specific big data *** to obtain valuable information. For different businesses in different fields, different enterprises, or even the same business of different enterprises in the same field, due to differences in business needs, data mining and analysis and mining goals, the big data technology and big data information system used may also be different. There is quite a big difference. Only by adhering to the synchronous development of the trinity of "objects, technology, and applications" can the value of big data be fully realized. When your technology reaches its limit, that is the limit of data. "Big data is not about how to define it, the most important thing is how to use it. The biggest challenge is which technologies can better use the data and how big data is used. This Compared with traditional databases, the rise of open source big data analysis tools such as Hadoop, what is the value of these unstructured data services?

2: Types of big data and value mining methods 1. The types of big data can be roughly divided into three categories: 1) Traditional enterprise data: including consumer data from CRM systems, traditional ERP data, inventory data and accounting data, etc. 2) Machine and sensor data (Machine-generated). /sensor data): includes call records (CallDetail Records), smart meters, industrial equipment sensors, equipment logs (usually Digital exhaust), transaction data, etc. 3) Social data (Socialdata): includes user behavior records, feedback data, etc. Social media platforms such as Twitter and Facebook. 2. There are four main methods of mining business value from big data: 1) segmenting customer groups and then customizing special services for each group; 2) simulating real-life environments and exploring them. New demands also increase the return on investment. 3) Strengthen departmental connections and improve the efficiency of the entire management chain and industrial chain. 4) Reduce service costs and discover hidden clues to innovate products and services.

Three: Characteristics of big data The industry usually uses four V (i.e. Volume, Variety, Value, Velocity) to summarize the characteristics of big data. Specifically, big data has four basic characteristics: 1. It is a huge data volume. Large volumes (volumes) refer to large data sets, generally around 10TB in size. However, in practical applications, many enterprise users put multiple data sets together, forming a PB-level data volume; Baidu data shows that its The new homepage navigation needs to provide more than 1.5PB of data every day (1PB=1024TB). If this data is printed out, it will exceed 500 billion A4 sheets of paper. Data confirms that so far, the amount of data produced by all printed materials produced by humans is only 1.5PB. 200PB. 2. Is the data category large and... gt; gt;

Question 5: What is big data, how to understand big data (big data, mega data) in the era of big data, or Huge amounts of data refer to massive, high-growth and diverse information assets that require new processing models to have stronger decision-making, insight and process optimization capabilities.

Question 6: What. It is the era of big data. The era of big data

(huge amount of data (IT industry term))

Editor

The first person to propose the arrival of the era of "big data" was the global McKinsey, a well-known consulting firm, said: “Data has penetrated into every industry and business function area today and has become an important production factor. People's mining and application of massive data heralds the arrival of a new wave of productivity growth and consumer surplus. "Big data" has existed for a long time in fields such as physics, biology, environmental ecology, and industries such as military, finance, and communications. However, it has attracted people's attention due to the development of the Internet and information industry in recent years.

Background

Editor

In 2012, the term big data (big data) was mentioned more and more, and people used it to describe And define the massive data generated in the era of information explosion

The era of big data is coming

Data, and name the technological development and innovation related to it. It has appeared on the cover of columns of "News" and "The Wall Street Journal", entered the news on the official website of the White House in the United States, appeared in some domestic Internet-themed lecture salons, and was even used by sensitive companies such as Guojin Securities, Guotai Junan, Galaxy Securities, etc. Written into investment recommendation report. [1]

Data is rapidly expanding and getting bigger, which determines the future development of enterprises. Although many enterprises may not be aware of the hidden dangers caused by the explosive growth of data, as time goes by, People will increasingly realize the importance of data to enterprises.

As a column in "***" stated in February 2012, the era of "big data" has arrived. In business, economics and other fields, decisions will increasingly be based on data and analysis. Made rather than based on experience and intuition.

Gary King, professor of sociology at Harvard University, said: "This is a revolution. The huge data resources have enabled various fields to begin the quantification process. Regardless of academia, business or government, all fields will Start this process" [2]

Impact

Editor

Big Data

Today's society is a rapidly developing society. , science and technology are developed, information is flowing, communication between people is getting closer and closer, and life is becoming more and more convenient. Big data is the product of this high-tech era. [3]

With the advent of the cloud era, big data (Big data) has also attracted more and more attention. Big data is often used to describe the large amounts of unstructured and semi-structured data created by a company that would take too much time and money to download to a relational database for analysis. Big data analytics is often associated with cloud computing because real-time analysis of large data sets requires frameworks like MapReduce to distribute work to tens, hundreds, or even thousands of computers. [2]

In today's society, the application of big data is increasingly demonstrating its advantages, and it occupies an increasingly large area, such as e-commerce, O2O, logistics and distribution, etc. The field of data development is assisting enterprises to continuously develop new businesses and innovate operating models. With the concept of big data, the judgment of consumer behavior, product sales forecast, precise marketing scope and inventory replenishment have been comprehensively improved and optimized. [4]

"Big data" in the Internet industry refers to the phenomenon of user network behavior data generated and accumulated by Internet companies in daily operations. The scale of these data is so huge that it cannot be measured in G or T.

How big is big data? A set of data called "One Day on the Internet" tells us that in one day, all the content generated by the Internet can be burned into 168 million DVDs; as many as 294 billion emails are sent out (equivalent to two years of paper letters in the United States) quantity); issued 2 million community posts (equivalent to 770 years of text in Time magazine); sold 378,000 mobile phones, which is higher than the 371,000 babies born every day in the world...[1]

As of 2012, the amount of data has jumped from the TB (1024GB=1TB) level to the PB (1024TB=1PB), EB (1024PB=1EB) and even ZB (1024EB=1ZB) levels. Research results from the International Data Corporation (IDC) show that the amount of data generated globally in 2008 was 0.49ZB, the amount of data in 2009 was 0.8ZB, the growth in 2010 was 1.2ZB, and the amount in 2011 was as high as 1.82ZB, equivalent to Each person in the world generates more than 200GB of data.

As of 2012, the amount of data in all printed materials produced by mankind is 200PB. All the data in the history of mankind...gt;gt;

Question 7: What is big data? The era of big data

(Huge amount of data (IT industry term))

Editor

The first person to propose the arrival of the "big data" era was a world-renowned consulting company McKinsey, McKinsey said: "Data has penetrated into every industry and business function area today and has become an important production factor. People's mining and application of massive data heralds the arrival of a new wave of productivity growth and consumer surplus. "Big data" has existed for a long time in fields such as physics, biology, environmental ecology, and industries such as military, finance, and communications. However, it has attracted people's attention due to the development of the Internet and information industry in recent years.

Chinese name

Big data era

Foreign name

Big data

Proposed by

McKinsey

Generic

Scientific terms

Contents

1 Background

2 Impact

? Big data

? The essence of big data

? Data value

? Visualization

3 characteristics

4 Case Analysis

5 Rise of Industry

6 Provide Basis

7 Countermeasures

Background

Editor

In 2012, the term big data is being mentioned more and more, and people use it to describe and define the massive amounts of data generated in the era of information explosion

The era of big data is coming

Data, and named the technological development and innovation related to it. It has appeared on the cover of columns of "News" and "The Wall Street Journal", entered the news on the official website of the White House in the United States, appeared in some domestic Internet-themed lecture salons, and was even used by sensitive companies such as Guojin Securities, Guotai Junan, Galaxy Securities, etc. Written into investment recommendation report. [1]

Data is rapidly expanding and getting bigger, which determines the future development of enterprises. Although many enterprises may not be aware of the hidden dangers caused by the explosive growth of data, as time goes by, People will increasingly realize the importance of data to enterprises.

As a column in "***" stated in February 2012, the era of "big data" has arrived. In business, economics and other fields, decisions will increasingly be based on data and analysis. Made rather than based on experience and intuition.

Gary King, professor of sociology at Harvard University, said: "This is a revolution. The huge data resources have enabled various fields to begin the quantification process. Regardless of academia, business or government, all fields will Start this process" [2]

Impact

Editor

Big Data

Today's society is a rapidly developing society. , science and technology are developed, information is flowing, communication between people is getting closer and closer, and life is becoming more and more convenient. Big data is the product of this high-tech era. [3]

With the advent of the cloud era, big data (Big data) has also attracted more and more attention. Big data is often used to describe the large amounts of unstructured and semi-structured data created by a company that would take too much time and money to download to a relational database for analysis. Big data analytics is often associated with cloud computing because real-time analysis of large data sets requires frameworks like MapReduce to distribute work to tens, hundreds, or even thousands of computers.

[2]

In today's society, the application of big data is increasingly demonstrating its advantages, and it occupies an increasingly large area, such as e-commerce, O2O, logistics and distribution, etc. The field of data development is assisting enterprises to continuously develop new businesses and innovate operating models. With the concept of big data, the judgment of consumer behavior, product sales forecast, precise marketing scope and inventory replenishment have been comprehensively improved and optimized. [4]

"Big data" in the Internet industry refers to the phenomenon of user network behavior data generated and accumulated by Internet companies in daily operations. The scale of these data is so huge that it cannot be measured in G or T.

How big is big data? A set of data called "One Day on the Internet" tells us that in one day, all the content generated by the Internet can be burned into 168 million DVDs; as many as 294 billion emails are sent out (equivalent to two years of paper letters in the United States) quantity); issued 2 million community posts (equivalent to 770 years of text in Time magazine); sold 378,000 mobile phones, which is higher than the 371,000 babies born every day in the world...[1]

As of 2012, the amount of data has jumped from the TB (1024GB=1TB) level to the PB (1024TB=1PB), EB (1024PB=1EB) and even ZB (1024EB=1ZB) levels. Research results table of International Data Corporation (IDC)...gt;gt;

Question 8: Briefly describe what is the era of big data, a large-scale era of acquisition, storage, management, and analysis Data analysis that greatly exceeds the capabilities of traditional database software tools has four major characteristics: massive data scale, rapid data flow, diverse data types, and low value density.

Question 9: What is the era of big data. What is also called cloud business? ? With the maturity of distributed computing technology, large companies have the ability to analyze and process big data. This has also allowed data analysis technologies such as data mining to gradually mature. In the past, only sampling data analysis could be used, but now all data can be analyzed. As the amount of data increases, the analysis results become more and more accurate and the scope becomes wider and wider, and the data becomes more and more valuable. This has caused almost all companies to desperately collect all kinds of data to improve their services.

Cloud merchants are also called smart cloud merchants. Information application infrastructure is everywhere = platform applications are cross-regional, cross-terminal, cross-system, and cross-platform.

Question 10: Jack Ma said that the era of big data has begun to arrive, so what does big data mean? If you want to learn more about this knowledge, Hello, it depends on which industry you choose. Let me first talk about the connotation of the big data concept in several aspects. 1. Large amounts of data, such as TB, PB, and even EB, need to be analyzed. deal with. 2. Rapid response is required, the market changes rapidly, and it is required to respond to changes in a timely and rapid manner. The analysis of data must also be fast, and there are higher performance requirements, so the amount of data seems to be "large" in terms of speed. 3. Data diversity: There are more and more unstructured data from different data sources, which require cleaning, sorting, filtering and other operations to turn into structured data. 4. The value density is low. Due to untimely data collection, incomplete data samples, discontinuous data, etc., the data may be distorted. However, when the amount of data reaches a certain scale, more real and comprehensive feedback can be achieved through more data. . Many industries will have big data needs, such as the telecommunications industry, the Internet industry, and other industries that easily generate large amounts of data. Many traditional industries, such as medicine, education, mining, electricity, and other industries, will have big data needs. As the business continues to expand and historical data continues to increase, the amount of data continues to grow. If you need to analyze big data, you can use open source big data projects such as Hadoop, or commercial big data BI tools such as Yonghong Z-Suite. With the rapid development of the Internet and mobile phones, big data is increasingly used in various fields.

It is also increasingly oriented towards personal big data applications.