Tuesday, April 17, 2012

Three Big HOWs to Tame Big Data

Big data is data that is too large to process using traditional methods.

In its May 2011 report on big data, the McKinsey Global Institute projected a 40 percent annual growth in global data—a doubling of data volumes every two years. Much of this data is complex, unstructured data that doesn’t submit readily to analysis. In fact, big data refers to the volumes of mostly complex, unstructured data whose analysis could yield significant dividends in terms of competitive business advantage, but cannot be analyzed by the existing structured data oriented infrastructure & framework.

Therefore it lies the chal­lenge of big data, at Three WHYs for Big Data, we explored why Big Data is Big Matter, we also further articulate Three Big WHATs to identify Big Data Challenges, and now continue the series on how to overcome the barriers to tame the Big Data?

 1. How Big Is Big Data?

While experts agree that Big Data is big, exactly how big is a matter of debate. IDC forecasts a roughly 50 percent annual growth rate for what it calls the world’s “digital universe,” more than 70 percent of which IDC estimates is generated by consumers and over 20 percent by enterprises. Between 2009 and 2020, the digital universe will swell by a factor of 44 to 35 zettabytes, or 35 million petabytes, IDC predicts

Big data is data that is too large to process using traditional methods. It originated with Web search companies who had the problem of querying very large distributed aggregations of loosely-structured data

 2.  How to start first step to tame Big Data?

If you’re creating large data sets, which most of businesses do today,  you have no choice but to embrace big data management. First Steps to Managing Big Data can be overwhelming and full of confusion, especially if the organization has a lot of existing data and data continue to grow and flow exponentially.

A) Start with business Strategy/goal: As we put in the Three Big Whys for Big Data, Big Data is the means to end, not the end. Start with end: the purpose, the business goals, the strategy;

B) And then develop a Big Data Strategy/map in which you classify:
The types of data that are important to the organization.
Various aspects of your data, such as whether it changes a lot (complexity & variety)  and how fast it’s growing (velocity).
Is much of your data critical information
Prioritize the business problems Big Data can help solve

C) The right Tools and Architecture: using traditional data warehouse solution to search through such vast amounts of often unstructured data can takes weeks, if not months. Hadoop, an open source ecosystem of data management tools and technologies that can help organizations tackle the broad problem of big data analytics, here is another nice article to recommend 7 top tools for taming Big Data.

D) Data Security & Governance: However, IT and business managers should keep cautious when it comes to implement Hadoop, which requires a fair amount of practices and serious attention & solutions to the security of massive amounts of data/ information stored in distributed clusters and potentially in public clouds


3. How to Build the Right Mindset and Culture to gain wisdom from Big Data quantitatively and qualitatively?

Extracting business value and wisdom from big data remains elusive for many organizations. For most companies today, data are abundant and readily available, but not well used. Nearly one in four survey respondents says the vast majority of its company’s data are untapped. Another 53% say they only use about half of their valuable data. Yet 73% say that data collection in their organization has increased over the last year

 The biggest challenge that business faces to manage Big Data today is more cultural than technical. Data oriented business culture need be well established to help every level of organization to make data-driven, better and faster decision. Technically, the Big Data solution need combine computer science, mathematics, statistical analysis, data visualization and even social science to gain insight and foresight about what customers need and what’s the future trend.

 There is a strong link between effective data management strategy and financial performance. Statistically, companies that use data most effectively—strategic data management of Big Data—stand out from the rest. Fifty-three percent of customers say their organizations achieve higher financial performance than their peers, compared with 36% overall.

Big-data analytics must be business led with the right mindset, time to value, and with effective data mining tools, as not all projects will be successful at finding the needle in the haystack. The organizations that can do it successfully will out beat the competitors and become the intelligent business in 21st century.
Twitter: @Pearl_Zhu



5 comments:

Global Institute Of Technology & Management

The Global Institute of Technology & Management was established in 2008 under the aegis of the Baljeet Singh Education Society (Regd.) to promote quality technical & management education of global standards in a world class environment.

Keywords-> Global Institute

5 Km Stone, Kheda Khurampur,
Farrukhnagar-Haily Mandi Road,
Gurgaon, Haryana - 122506
Contact No:0124-2016600/700/800
Admission Helpline: 08053980002/03/04

Website ->
http://www.gitmgurgaon.com/about-global-institute-of-techology-&-management.html

Global Institute Of Technology & Management

The Global Institute of Technology & Management was established in 2008 under the aegis of the Baljeet Singh Education Society (Regd.) to promote quality technical & management education of global standards in a world class environment.

Keywords-> Global Institute of Technology & Management, Global Institute
Contact Us:-
5 Km Stone, Kheda Khurampur,
Farrukhnagar-Haily Mandi Road,
Gurgaon, Haryana - 122506
Contact No:0124-2016600/700/800
Admission Helpline: 08053980002/03/04

Website ->
http://www.gitmgurgaon.com/about-global-institute-of-techology-&-management.html

Engineering Colleges Admission 2013-2014 B-Tech, M-Tech, MBA
Admission Helpline Now Admission 2013 to start in B-Tech Top Engineering Colleges, M-Tech Engineering Colleges MCA Colleges, MBA Colleges, BBA Colleges and other Medical colleges 2013 Admission
Admission Helpline provide assistance for Admission in Top Engineering Colleges of B.Tech,
M.Tech BCA, MCA, BBA, PGDM, MBA and Medical Colleges.
We provide complete assistance from counselling to Admit Card for All University for 2013, 2014 Sessions in Delhi/NCR India.


Keywords
Admission Helpline - Engineering Colleges Admission 2013, Admission Helpline, Admission 2013, Admission M-tech Helpline, Admission MBBS Colleges, BBA Admission Helpline, Admission helpline 2013, MBA Admission Helpline

Contact Us
ADMISSION HELPLINE
Call Us: +91-8800700773, 9458535100
http://www.admission-helpline.com/

I read your post and I really appreciate your experience. I will get good knowledge from there as well..Colleges for BBA in Delhi
Top BBA colleges in India
Top 10 BBA colleges in India

Hello! I liked your article very much, the tips you provide are pretty decent, also in my opinion there is one advice, that can help you in the process of big data management very much. It is the python programmer hiring - with python software engineers you can build and retain software for big data analysis in a very short terms and then update it on a regular basis without any difficulties.

Post a Comment