Big Data/Hadoop

     

       

                              What is Big Data?

Big data literally means BIG and enormous data.
It can be referred to as Huge volumes of data which could be both structured and unstructured.

Structured data is information with a high level of organization, which means inclusion and syncing with a relational database is an easy task and can easily searched by a search engine algorithms.

Unstructured data on the other hand is opposite of structured data. Unstructured data is not really helpful and cannot provide meaningful insights to an organization.
This data can only be analyzed when it's sorted and arranged in a specific manner which could then provide a company valuable insights in the long run.

Due to the advent of new technologies, devices, and communication means like social networking sites, the amount of data produced by mankind is growing rapidly every year. 

The amount of data produced by us from the beginning of time till 2003 was 5 billion gigabytes. If you pile up the data in the form of disks it may fill an entire football field. The same amount was created in every two days in 2011, and in every ten minutes in 2013. This rate is still growing enormously. Though all this information produced is meaningful and can be useful when processed, it is being neglected.

There has to be a way of analyzing and computing this data so it makes sense for a company or an organization.

So we can conclude that Big data is a problem in today's Era and Hadoop is its solution.

                                 What is Hadoop?

Apache Hadoop is an open-source software framework used for distributed storage and processing of dataset of big data using the MapReduce programming model.

This was basically invented to be able to move from single servers to thousands of systems/machines, each offering local computation and storage.

Prerequisite for learning Hadoop is that you have prior understanding and exposure to  RDBMS concepts,Linux operating system flavors and a bit of Core Java.

Here is the Hadoop Architecture explained in detail.