Staggering Revelations About Big Data

The United States of America entered WW2 in 1941, directing their campaign from Australia as it started to perceive threats from Japan (2). By 1942, Brisbane had been set up as the support and training base for the Pacific War (2). Military personal from America started arriving in Brisbane, with the small number of troops requiring accommodation being dealt with by leasing rooms in many of the CBDs hotels, guest houses, or by leasing rooms in private residences (5). This solution was quickly obsolete as troops poured into the city, with approximately 100,000 US troops stationed around the city between 1942 and 1945 (1 & 3). During this period, Australia’s divisions returned to Brisbane from the Middle

As defined by the magazine, CQ Researcher, big data is the collection and analysis of enormous amounts of information by supercomputers (CQ Researcher, 1). This collection and analysis has led to many great feats in the fields physics, medicine, social

The amount of data produced in the world is increasing exponentially, and we are a part of this phenomenon. We all use email, phones, social media, and credit cards. The new technologies that we are bringing home, such as smart cars and smart TVs, are collecting more and more data. Boyd and Crawford exposed the imperfections of the Big Data industry, and they have shown that we cannot assume that the industry will solve its own problems. By using all these technologies, we have given Big Data access to our finances, social interactions, homes, and minds. Big Data offers imperfect people tools that can be used for good and evil. If we are blind to how our data is being collected, the industry will continue misusing our data. But if we pay attention, and demand the technology companies respect our privacy, they will be forced to have higher standards. Currently, our society has ignored how our privacy is being jeopardized. As Boyd and Crawford noted, we don’t have the tools and access of researches, and our often unaware of the algorithms collecting our information (759,760). But we do have power. We can voice our concerns, or find alternatives to services that don’t respect us. We can use the tools we have access to for good, just like Big Data has been used

Our every day life has changed forever, thanks for the ubiquitous smart phones and technology dependent information age. We leave a trail of data while travelling, shopping, driveing, bloggin, and even voting. All of these activities leave a digital signature unique to us, which if analyzed can predict our next move. Similarly, a large set of data is being created each day by businesses, researchers and the World Wide Web. According to an estimate by the government, there are about 1.2 zettabytes (250 billion DVDs) of electronic data generated each year by everything from underground physics experiments and telescopes to retail transactions and Twitter posts (Mervis 22). This data growth has created a new challenge and opportunity. The

Additionally, social networking website Facebook, stores approximately 40 billion photos in total. (“Data, data everywhere”, 2010) Besides enormous data that generated from daily operational company transactions and social networks, the price drop of the data storage is also a strong factor triggering the fever of “Big Data”. For example, Google Drive - a cloud based data storage service – had a price drop of approximately 80% from March 2014. This price drop is considered a marketing approach to attract more computer users to adopt Google’s cloud service, which provides a more convenient and efficient way to access and store daily-used files. Although emerge of enormous data provides us opportunities to conduct further investigation and benchmarking, valuable information are not fully extracted and the potential power of using “Big Data” is undermined. In order to achieve thoroughly extraction of useful information from databases, many professionals in the academic field devoted into the study of data analysis and identified two of the most important drawbacks of traditional data analysis, which lacks of predictability and is less flexible in scalability.

Data has always been analyzed within companies and used to help benefit the future of businesses. However, the evolution of how the data stored, combined, analyzed and used to predict the pattern and tendencies of consumers has evolved as technology has seen numerous advancements throughout the past century. In the 1900s databases began as “computer hard disks” and in 1965, after many other discoveries including voice recognition, “the US Government plans the world’s first data center to store 742 million tax returns and 175 million sets of fingerprints on magnetic tape.” The evolution of data and how it evolved into forming large databases continues in 1991 when the internet began to pop up and “digital storage became more cost effective than paper. And with the constant increase of the data supplied digitally, Hadoop was created in 2005 and from that point forward there was “14.7 Exabytes of new information are produced this year" and this number is rapidly increasing with a lot of mobile devices the people in our society have today (Marr). The evolution of the internet and then the expansion of the number of mobile devices society has access to today led data to evolve and companies now need large central Database management systems in order to run an efficient and a successful business.

Before this digital form of a dark age takes over, what must be done to preserve our digital information and records and keep them from disappearing? Foremost, we need to boost

According to researcher and tech author Bernard Marr, every two days humanity creates as much data as it did from the beginning of time to 2003. Every minute of the day, Facebook users share nearly 2.5 million elements of content and WhatsApp users share around 350,000 photos. And the world is far from fully connected. When the next billion Internet users come online, these numbers will only skyrocket. Fold in the data generated by connected machines and the Internet of Things (IoT), and we 're talking lots and lots of

Big Data is all around us, from creating our anniversary videos on Facebook and giving Netflix recommendations to utilizing all cellphones as weather stations to improve predictions (source 4) and combining it with machine learning for interesting insights. (source 5) All this data needs to be processed, creating a multitude of jobs in the data science field. Companies with products relying heavily in internet are investing heavily in Big Data, companies such as Uber, Spotify, Google and IBM to name a

For example Facebook alone generates 10 Tb of data (each day), twitter generates 7 Tb which is very huge volume of data being generated and upgraded. Previously the data was maximum considered in gigabytes but nowadays data is generated in Terabytes to Petabytes and sometime in future it will reach to Zettabytes which huge volume of data if we consider social industry and if take other industry like finance where the data makes a big difference like the stock market which is globally hundreds of stock exchanges there are other data like company’s fundamental data, this is also generating GB/TB of data in volume which is collectively in TB/PB.

The term Big data refers to the procedure to store and oversee extensive arrangements of information. In todays world and age of specialized gadgets, for example, portable workstations, cell phones and PCs information is being created in high limits. To manage information on this expansive scale enormous information is utilized. In this paper, we have introduced the ideas of huge information and its investigation. Moreover, mainstream information examination at present utilized have been clarified.

"Such ‘Data Explosions ' has led to one of the most challenging research issues of the current Information and Communication Technology (ICT) era: how to effectively and optimally manage such large amount of data and identify new ways to analyze large amounts of data for unlocking information. The issue is also known as the ‘Big Data ' problem, which is defined as the practice of collecting complex data sets so large that it becomes difficult to analyze and interpret manually or using on-hand data management applications. From the perspective of real-world applications, the Big Data problem has also become a common phenomenon in domain of science, medicine, engineering, and commerce"

Even something as common as a database is being advanced in the fight to protect

The amount of data on the planet in 2014 was around 4.4 zettabytes. It’s expected to grow to 44ZB by the year 2020. It’s also predicted that by 2020, the amount of information produced by machines will account for about 10% of data on earth. One Zettabyte is 1000 Exabytes or 1 Billion Terrabytes. To put it in perspective, with one exabyte of data, a person can watch 36,000 years worth of HD videos. So, with one zettabyte of data, thousands of generations can watch 36 million years of HD videos. One doesn’t have to be Albert Einstein to know that the amount of data usage on this planet will reach

Today, as the internet is becoming ubiquitous in our lives so is information. Scientists have even calculated the estimate data that we as humans have stored since the year 1996. It is no surprise that we have stored over 295 Exabyte of data and this is just until the year 2010 and today we are 7 years since [1]. Imagine how much data we might have stored! The thing to ponder about is that what is this data? Is this just books and news publications or photos and videos of users? This is something we might never know precisely but we can assume that as photos and videos constitute for the most part in terms of data storage. One might question how the companies who keep all this data for free make money? A simple answer to that is ‘data’