A Study On The Big Data

Cloud computing is the practice of using remote storage for applications and data. The idea itself is not a new one; it has been in use for many years albeit under different names. In the earliest days of the computer age machines had to be physically large to contain the hardware required to do their jobs. It was impractical and prohibitively expensive to provide one of these mainframes for individual users; not to mention for what they were used for, unnecessary. Instead, one central computer was wired to several terminals that users could interface with. Typically, only large organizations such as, major corporations or government agencies could afford one of these machines or had need of one. This was the birth of cloud computing. Until the early 1980s this system was typical for any organization requiring large amounts of processing power. It was considered unnecessary and difficult to put the nuts and bolts of applications onto users’ desktop machines. Rather, by keeping applications in a central location, they could be managed and updated more easily and large amounts of storage space and processing power were not needed on desktop machines. Indeed, before this time there were no desktop machines mass produced that could achieve this level of power. This was about to change.

Cloud computing is an internet based computing which provides various applications and services like storage, servers, infrastructure, networking with low cost, on-demand self service, pay as you go model, location independent resource pooling, reasonable price , rapid elasticity etc. Cloud computing is one way to increase the capacity add capabilities without investing in new infrastructures like computer hardware involves storage memory, licensing for new software, training for a person and in a dynamic way.

Data storage is the 3rd phase in big data analytic. This stage provides the platform that manages all the assembled information in a way that it can be further analyzed and information can be retrieved. There are two features provided at this platform:

Imagine having tonnes of personal belongings but hardly any place to store them. Land is something physical and limited which means we will eventually run out of it. Just like that, we run out of hard drive space and local storage space in your computer. Now, imagine having a special place where it has the capability to store everyone’s belongings in a limited space. And that place is called the internet. The cloud is just a metaphor for the Internet.

Big Data has taken the business world by storm. By 2020, it is expected that the amount of digital information in existence will have grown from 3.2 zettabytes in 2014 to 40 zettabytes. Companies are doing all they can to capture this digital information and turn it into actionable insights. Currently, the total amount of data being captured and stored by industry is doubling every 1.2 years. Therefore, companies must find increasingly efficient solutions to store and analyze this incredible amount of data.

The cloud aims to cut costs, and help the users focus on their core business instead of being impeded by IT obstacles Cloud computing is so named because the information being accessed is found in the "clouds", and does not require a user to be in a specific place to gain access to it. The services are offered from data centres all over the world, which collectively are referred to as the "cloud." The idea of the "cloud" is to simplify the huge network connections and computer systems involved in online services. Cloud computing is a computing model, not a technology. In this model of computing, all the servers, networks, applications and other elements related to data centres are made available to IT and end users. Cloud computing is a type of computing that is comparable to grid computing. It relies on sharing computing resources rather than having local servers or personal devices to handle applications.

Today ‘Big data’ is more popular than before, the performance of a database is becoming extremely important, including family life, school studying, office work and all business. Providing reliable and faster database services is the goal of organizations including any business, schools, and

Big data is an extensive collection of structured and unstructured data. It is a modern day technology which is applied to store, manage and analyze data that are not possible to manage, store and analyze by using the commonly used software or tools. Since all of our daily tasks are overtaken by the modern technologies and all the businesses and organizations are using internet system to operate, the production of data has increased significantly in past

Abstract— Big data is a significant subject in modern times with the rapid advancement of new technologies for example, smartphones, pc/laptops, game consoles, that all in some way store information. Big companies require a place to not only store all the data that is coming in but to also analyze it for specific purposes and at the fastest speed manageable. There are many different providers out there who provide this service, this paper will talk about one way the company Google handles data using their own special made platform.

To address the question of how and what techniques has been used to manages this big amount of data or in the field of Big Data, I review some research papers and review articles in the field of Big Data. This paper provides the synthesis of those papers which I found relevant to this field. This paper will focus on the following things:

Data has always been analyzed within companies and used to help benefit the future of businesses. However, the evolution of how the data stored, combined, analyzed and used to predict the pattern and tendencies of consumers has evolved as technology has seen numerous advancements throughout the past century. In the 1900s databases began as “computer hard disks” and in 1965, after many other discoveries including voice recognition, “the US Government plans the world’s first data center to store 742 million tax returns and 175 million sets of fingerprints on magnetic tape.” The evolution of data and how it evolved into forming large databases continues in 1991 when the internet began to pop up and “digital storage became more cost effective than paper. And with the constant increase of the data supplied digitally, Hadoop was created in 2005 and from that point forward there was “14.7 Exabytes of new information are produced this year" and this number is rapidly increasing with a lot of mobile devices the people in our society have today (Marr). The evolution of the internet and then the expansion of the number of mobile devices society has access to today led data to evolve and companies now need large central Database management systems in order to run an efficient and a successful business.

A cloud based service is basically just a system that shares information over the Internet, instead of on your hard drive (which would be your local drive and you would not need internet access to use it, but it is only accessible through your computer). The information that you store in “the cloud” is really sent over the internet, and stored on a server with a bunch of other people’s information that the cloud provider owns. Another way to think about it, is that you are basically just “renting” a piece of the cloud service provider’s server to use. Cloud services are so convenient because they allow you to work on your information from any of your devices, just by sending it over the internet, saving it on the provider’s server, and then when you want to access it again from a different device, you simply retrieve it through the internet. “Research shows that the global market for cloud computing will grow from $40.7 billion in 2011 to more than $241 billion in 2020.” (Symantec)

The explanation of “cloud computing” from the National Institute of Standards and Technology (NIST) [2] is that cloud computing enables omnipresent, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. According to the explanation, cloud computing

Data is very critical for any organization. In an organization every by year massive amounts of data will be created and how fast your business reacts to that important information determines whether you succeed or fail. The big problem is how we efficiently handle the 3 V’s of Big Data.

‘Big Data’ is the application of specialized techniques and technologies to process very large sets of data. These data sets are often so large and complex that it becomes difficult to process using on-hand database management tools. There are several techniques which are widely used in implementation of Big Data.