HADOOP

 

INTRODUCTION

  • Introduction to Hadoop

  • History of Hadoop

  • Building Blocks - Hadoop Eco-System

  • Who is Behind Hadoop

  • What Hadoop is good for and what it is not

 

 

HDFS

  • Configuring HDFS

  • Interacting With HDFS

  • HDFS Permissions and Security

  • Additional HDFS Tasks

  • HDFS Overview and Architecture

  • HDFS Installation

  • Hadoop File System Shell

  • File System Java API

 

 

MAP REDUCE

  • Map/Reduce Overview and Architecture

  • Installation

  • Developing Map/Red Jobs

  • Input and Output Formats

  • Job Configuration

  • Job Submission

  • Practising Map Reduce Programs (at least 10 Map Reduce Algorithms)

 

Getting Started With Eclipse IDE

  • Configuring Hadoop API on Eclipse IDE

  • Connecting Eclipse IDE to HDFS

 

Hadoop Streaming

 

Advanced MapReduce Features

  • Custom Data Types

  • Input Formats

  • Output Formats

  • Partitioning Data

  • Reporting Custom Metrics

  • Distributing Auxiliary Job Data

 

Distributing Debug Scripts

Using Yahoo Web Services

Pig

  • Pig Overview

  • Installation

  • Pig Latin

  • Pig with HDFS

 

Hive

  • Hive Overview

  • Installation

  • Hive QL

  • Hive Unstructured Data Analyzation

  • Hive Semistructured Data Analyzation

 

HBase

  • HBase Overview and Architecture

  • HBase Installation

  • HBase Shell

  • CRUD operations

  • Scanning and Batching

  • filters

  • HBase Key Design

 

ZooKeeper

  • Zoo Keeper Overview

  • Installation

  • Server Maintainance

 

Sqoop

  • Sqoop Overview

  • Installation

  • Imports and Exports

 

CONFIGURATION

  • Basic Setup

  • Important Directories

  • Selecting Machines

  • Cluster Configurations

  • Small Clusters: 2-10 Nodes

  • Medium Clusters: 10-40 Nodes

  • Large Clusters: Multiple Racks

 

Integrations

Putting it all together

  • Distributed installations

  • Best Practices

© 2018 by The Enigma Group of Companies

  • Instagram Social Icon
  • Facebook Social Icon
  • LinkedIn Social Icon
  • Twitter Social Icon