This is page 2 of:
Big Data Is Exactly What You Think It Isn’t
The biggest challenge is that Big Data is not a standalone project; it is a means to an end. If a retailer is trying to understand their customer sentiment, that sounds like it might be a Big Data project. If that same retailer is trying to create a marketing optimization platform, that sounds like it might be a Big Data project, too. And if the retailer wants to determine which potential market opportunity that the business should go after, that also sounds like it might be a Big Data project. Companies do not implement Big Data just so they can say that they have. (Let’s face it, a lot of data warehouse and data mart projects were done for simply that reason.)
If you really want to get an idea about what Big Data is and where you should go from here, the first thing that I would recommend is to go to YouTube and search for “Hadoop,” which is the leading open-source project for processing big data. I would then check out all of the great videos and training available at www.cloudera.com, one of the first movers in the Hadoop platform and consulting space. Do a Google search on “MapReduce” (the core processing component of Hadoop) and see how it enables you to process unstructured data. Also search for “No-SQL” and other column-oriented database technologies.
There are so many technical differences between how these platforms operate versus traditional data warehousing projects that you really have to spend the time to learn the underlying technologies. (It is pretty wild when you understand the difference between thinking about data in columns rather than in rows.) It will easily take you weeks, if not months, of focused effort to get through all the noise to a place where you can truly understand how these environments operate. Only then will you understand the potential of these platforms and what opportunities your business can explore.
What do you think? If you disagree (or even, heaven forbid, agree), please comment below or send me a private message. Or check out the Twitter discussion on @todd_michaud.
May 17th, 2012 at 10:17 am
Todd- Great article, thanks for clearing the “clouds” away from the “big data” hoopla. I agree that it’s going to completely change the way retailers deal with their customers (and their suppliers), but there’s going to be a whole bunch o’ garbage out there before people really understand. Thanks for helping.