Types of tools typically used in Big Data Scenario

§  Where is the processing hosted?

–     Distributed server/cloud

§  Where data is stored?

–     Distributed Storage (eg: Amazon s3)

§  Where is the programming  model?

–     Distributed processing (Map Reduce)

§  How data is stored and indexed?

–     High performance schema free database

§  What operations are performed on the data?

         –     Analytic/Semantic Processing (Eg. RDF/OWL)

Big data spans three dimensions: Volume, Velocity and Variety

Volume: Enterprises are awash with ever-growing data of all types, easily amassing terabytes—even petabytes—of information.

–Turn 12 terabytes of Tweets created each day into improved product sentiment analysis
–Convert 350 billion annual meter readings to better predict power consumption –Turn 12 terabytes of Tweets created each day into improved product sentiment analysis
–Convert 350 billion annual meter readings to better predict power consumption 

  Velocity: Sometimes 2 minutes is too late. For time-sensitive processes such as catching fraud, big data must be used as it streams into your enterprise in order to maximize its value.

–Scrutinize 5 million trade events created each day to identify potential fraud.
–Analyze 500 million daily call detail records in real-time to predict customer churn faster.

The latest I have heard is 10 nano seconds delay is too much.

Variety: Bigdata is any type of data - structured and unstructured data such as text, sensor data, audio, video, click streams, log files and more. New insights are found when analyzing these data types together.–Monitor 100’s of live video feeds from surveillance cameras to target points of interest

Exploit the 80% data growth in images, video and documents to improve customer. 

Introduction To Hadoop Ecosystem and Big Data - For Beginners

Every day we create more than 2.5 quintillion bytes of data- so much that 90% of the data in the world today has been created in the last two years alone. The increase in volume of digital information is alnost tenfold every 5 years and by 2020, it is predicted to reach a threshold of 40 zettabytes (ZB). Most of the digital information is derived from multiple sources including social media, internet, blogs, sensor networks, and much more

                          

 This data is "Big Data."

                           
Huge Amount of Data:

There is huge amount of data in the world

Ø From the beginning till 2003 almost we have create 5 billion gigabytes(exabytes) of data.

Ø In the year 2011 we have created same amount of data with in every 2 days

Ø In the year 2013 we have created same amount of data with in a time of 10 minutes