Big Data

A fascinating article demonstrating the challenges of Big Data, what it is, and how companies are starting to approache the problem.

"Increasingly large amounts of data are collected and stored but to no discernible advantage. While the data is actually there, the in-house relational database tools are simply not equipped to deal with such a massive amount of data in anything like a realistic time frame. Instead, companies are turning to solutions that combine in-memory computing engines with the distributed parallel processing power of multiple servers."

But the problem as always is what to do with all the data. When you have torrents of data hitting your system, making an intelligent and accurate decisions starts to get challenging. Getting the data to tell the story you want or match your conclusions is easy enough, but letting the data tell the story is the challenge. The bigger challenge is accepting the results.