How Big Data and Kaggle are changing the world?
“I keep saying the sexy job in the next ten years will be statisticians. People think I’m joking, but who would’ve guessed that computer engineers would’ve been the sexy job of the 1990s? The ability to take data—to be able to understand it, to process it, to extract value from it, to visualize it, to communicate it—that’s going to be a hugely important skill in the next decades, not only at the professional level but even at the educational level for elementary school kids, for high school kids, for college kids.” – Hal Varian, Google’s Chief Economist.
The Sloan Digital Sky Survey which began collecting data in 2000 from its Telescope in New Mexico, gathered more data in the first few weeks that had been collected in the entire history of astronomy. Today, its archives hold a whopping 140 terabytes of information. The Large Synoptic Survey Telescope, currently under construction, will photograph the entire sky every few nights. When the telescope receives its first light which is scheduled for 2019, it shall acquire the same quantity of data every 2 months.
The internet population has grown by 14.3% from 2011 to 2013 and now represents 2.4 billion people. Every minute of the day 204,000,000 emails are sent by users. Facebook users share 2,460,000 pieces of content. Apple users download nearly 50,000 apps. Amazon generates over $83,000 in online sales. In 2012, YouTube users uploaded 48 hours of new video every minute. This