Hadoop Architecture

HDFS daemons

·         Datanode

·         Namenode

·         Secondary namenode

Hadoop cluster consists of Data Storage and Data Processing

Below is a glimpse of what actually is Data storage and Data processing in Hadoop

Data Storage

·         Files

·         Blocks

·         Fsimage and edit logs

·         Metadata

·         Replication Factor

·         Checksum

·         Namenode and Secondary Namenode

·         Namenode recovery

·         Data Node

·         Safemode

Data Processing

·        Mappers and Reducers

·        MR Version 1 (Classic)

 Job Tracker

 Task Tracker

·        MR Version2 (YARN)

 Resource Manager

 Node Manager