Harbinger Systems
 

First Steps Towards Big Data

Wednesday, February 20th, 2013 at 11:47 am   - Posted by Prachi Kulkarni

Data crunching and analysis has always been the prowess of big organizational giants like Google and Facebook. However, the fact remains that even a small – mid scale organization has a lot of data at its disposal, as well as can benefit from the humongous amount of information available out there. So far these organizations tended to get bogged down by large data sizes and even larger costs related to big data and reached the erroneous conclusion that big data is not their specific cup of tea.

Now however, we all know that the big data trend is here to stay. There are both open source and proprietary tools available for us. With integration and gradual changes in architecture, small organizations can also get some share of the big data benefit.

I think the time has come for organizations to re evaluate their big data needs.

In this regard, following flow chart diagram can help by showing the possible first steps towards determining the big data strategy-

First Steps Towards Big Data

As outlined in the diagram, the use case and need / assets analysis is of foremost importance. Answers to these can influence the overall picture. Typical recommendation for any organization is to start small, start with what is already there, and keep on adding further capabilities and integration as the application / portal progresses. After implementation of devised approach, benefits assessment can be done. Based on the benefits the organization can decide to continue improving the portal further.

The flowchart mentions usage of tools and technologies as well as changes in database, operating systems and file system types. We will look at some of these in the subsequent posts.

3 Responses to “First Steps Towards Big Data”

  1. Sachin Katariya says:

    Informative article and the flowchart is concise and comprehensive. From a business side perspective, I see initial years [2013-2014] being focused on creating success story [large scale] in Healthcare [USA and Europe], Japan [Disaster research and prevention such as earthquake].
    It would be interesting to see how Big Data would help governments to:
    1. Optimize social services
    2. Drive down cost of Healthcare [predictive analysis part of "big Data" and R&D cost in drug research and clinical trials]

    As to Industries, BFSI sector would be first to demonstrate success story [cash generation] automobile and Transport segments would rely on Big Data for [cash preservation or lower cost of service]

    I look forward to the next blog in this series…

    Sachin

  2. Hi Prachi, I really enjoyed the post. Big data is really headache when you don’t know how to manage it. Thanks. I will share it to my friend who really needs it.

  3. Deb Johnson says:

    Hi Prachi,

    Thank you for posting this very helpful, timely article. I am currently working on a project that is combining data from multiple sources into a single datamart. I have multiple report samples, and am documenting and analyising our current data elements. The flow chart you presented above provides a great way to help manage the process.

    Thanks again!

Leave a Reply