There is a tsunami of data headed our way
Big Data, the term referring to data sets so large and complex traditional data processing applications are not sufficient enough to be able to process it. This is because we are saving data on a large scale beyond operational data which is mainly due to the rise of the internet. At this moment, Big Data is still quite manageable but there is an emerging technology that will make the current Big Data seem like Small Data.
I’m talking about the rise of the Internet of Things. Right now, this technology it is at the height of the Peak of Inflated Expectations of the Gartner Hype Cycle. It is thus expected that the amount of ‘things’ will grow exponentially in the coming years because these ‘things’ can be any object with built-in sensors like cars, phones, watches, doors, shoes, lights switches, anything.
Cisco expects that the number of connected devices will grow from 18 billion in 2015 up to 50 billion in 2020. Each of these ‘things’ will generate a massive amount of data contributing to the already large influx of data. Right now, about 4.4 ZB (that is 4.4 trillion gigabytes) of data is generated each year. This is expected to grow to more than 40 ZB in 2020. Companies saving data because of just saving data are at risk of being washed away by a tsunami of data headed their way.
NSA for example, an institution we have all heard of, is already drowning in data. They have adopted a strategy to filter out data that does not contain useful content in order to diminish the amount of data they have to save by about 20%. Instead of just taking all there is, analysts are now trying figure out what is actually necessary. Ofcourse, it is very hard to know in advance what information is useful and what is not. But companies will have to start thinking about this topic and what to do what all that data headed their way.
According to Computerworld, the coming trend in Big Data and Business Intelligence will be to structure the collection of data and to know exactly what data is collected.  I think they are quite right, I have experienced on my own that companies just collect data for sake of collecting without knowing is actually important. Only after you have done some analysis you find out what is useful and what is not. But in the coming age of the internet of things, with so many gigabytes of data coming our way, this strategy is just not feasible anymore.
Tony Jordan – 400986