Hadoop Testing MODULES

PLANS AND PRICING

JAVA

Training Video - 1

Duration 1 hour 30 mins

Java Basic

  • What is Java
  • How to Set path
  • JDK, JRE and JVM
  • Data Types and Operators
  • Installing Java on Unix
  • Running Java Program in Unix

Training Video - 2

Duration 1 hour

Oops Concepts

  • Objects and Classes
  • Construtors
  • Method Overlaoding
  • Method Overriding
  • Static Keyword
  • This Keyword

Training Video - 3

Duration 1 hour

Oops Concepts -part 2

  • Abstract and Interface
  • Package
  • Abstract Class
  • Encapsulation
  • Polymorphoism
  • Overloading vs Overriding

Training Video - 4

Duration Duration

Collections Api

  • List
  • Set
  • Map
  • Need of collection API

UNIX

Training Video - 5

Duration 50 mins

Unix

  • What is Unix and Architecture
  • Unix Creating file
  • Listing Files in Unix
  • Hidden Files in Unix
  • Displaying Contents of file
  • Copying Files

Training Video - 6

Duration 1 hour

Directories And File Permission

  • Home Directory
  • Creating Directory and parent Directory
  • Listing Directory
  • Removing Directory and Changing Directory
  • CHMOD command and File Access Modes
  • Changing Groups and Owners

Training Video - 7

Duration 1 hour 5 mins

Additional Commands

  • grep and sort
  • Consuming output of one command to another
  • Starting a Process in foreground and background
  • Listing Running Process
  • Stopping a Process
  • Top Command

Training Video - 8

Duration 1 hour 30 mins

Data Warehouse Concepts

  • Data Warehouse Architecture
  • OLTP v OLAP
  • What is Data Warehouse
  • What is Enterprise Data Warehouse
  • What is Data Marts

DATAWAREHOUSING

Training Video - 9

Duration 1 hour 30 mins

Component Of Datawarehouse

  • Source System and target Systems
  • Staging Area
  • Drill up and Drill down
  • Facts and Dimensions
  • Slowly Changing Dimensions

Training Video - 10

Duration 2 hours

Introduction To Big Data

  • Data and Growth
  • What is Big Data ?
  • What are three V's in Big Data
  • Big Data Storage and Processing challenges
  • Testers Role in Big Data Project ?
  • Pre-requisites for Hadoop Testers ?

HADOOP TESTING

Training Video - 11

Duration 1 hour 30 mins

Introducting Hadoop

  • What is Hadoop and Why Hadoop ?
  • Hadoop Eco-Sysstem , how solutions fit in ?
  • What Tester should know in Eco-System ?
  • What are Hadoop Core-Componets ?
  • How to Start and Stop the hadoop dameons ?
  • Hadoop Versions, Flavour and What testers need to Know ?

Training Video - 12

Duration 2 hours

Detailing Hadoop Hdfs

  • HDFS Architecture
  • What is Namenode , Data Node and Secondary Namenode
  • How to Browse the HDFS file System ?
  • Validating the logs for the HDFS dameons ?
  • Generating Test Data in HDFS
  • Basic operations like mkdir , chmod , cat in HDFS.

Training Video - 13

Duration 1 hour 30 mins

Detailing Hadoop Map-reduce

  • What is Job Tracker and Task Tracker ?
  • Explaining a Weather Data Set Program ?
  • Compiling and Verifying the Map-Reduce Program
  • Difference between traditional RDBMS and MapReduce

Training Video - 14

Duration 1 hour 30 mins

Hadoop Configuration Files And Properties

  • Location of Configuration files ?
  • What are different configuration files in Hadoop
  • Explaining the default parameters in the configuration files.
  • How to overwrite the default parameters ?
  • Testing Impact of Configuration

Training Video - 15

Duration 4 hours

Hadoop Data Loading :sqoop : Part 1

  • Hadoop Data loading :SQOOP : Part 1
  • What is Hadoop Data loading
  • What is Sqoop
  • Sqoop Architecture
  • Sqoop 1 vs Sqoop 2
  • Display Sqoop Version

Training Video - 16

Duration 1 hour 45 mins

Hadoop Data Loading :sqoop : Part 2

  • Sqoop Import Architecture
  • Code Generation
  • Testing for Data Quality and Data Consistency for Import
  • Text and Binary File Formats in Scoop Testing and Validating the output
  • Importing Large objects like CLOB
  • CLOB through SQL Insert

Training Video - 17

Duration 1 hour 40 mins

Hadoop Data Loading :sqoop : Part 3

  • Sqoop Import into Hive
  • Dealing with the delta records ?
  • last Modified and Append Modes
  • Test and Validating for Incremental Load
  • Export Architecture
  • Exporting Data from Hive to Sqoop

Training Video - 18

Duration 1 hour

Hadoop Data Loading:flume Part 1

  • What is Flume ?
  • Flume Architecture
  • Understanding the Source and Sink
  • Understanding the Memory Channel
  • Flume first Example
  • Workign with flume Configuration file

Training Video - 19

Duration 1 hour

Hadoop Data Loading:flume :part 2

  • Flume Second Example for HDFS sink
  • Testing and Validating the Output of Flume Operations
  • Overview Additional Source and Sink Support
  • Validating the Configuration and Error from output
  • Working with Twitter Source ?
  • Configuration for Twitter Source

Training Video - 20

Duration 1 hour

Pig -part 1

  • Why Pig was Created ?
  • Why Pig when Map-Reduce is there ?
  • Pig Components.
  • Pig Execution Modes
  • Pig Example : Analysis for Weather Data Set.
  • Testing Pig Output with Sampling.

Training Video - 21

Duration 1 hour 25 mins

Pig -part 2

  • Pig for Data Cleaning
  • Data Types and Models
  • Data Type like Bag, Tuple ,Map
  • Use Cases in Healthcare
  • Execution Pig Programs
  • Storing the Analysis Results from PiG

Training Video - 22

Duration 2 hours 50 mins

Pig -part 3

  • Relation Operator
  • Advance Concepts like Parallelism and Streaming
  • Functions is Pig
  • AVG
  • COUNT
  • COUNT_STAR

Training Video - 23

Duration 1hour 25 mins

Hive - Part 1

  • Hive Introduction
  • Comparision with RDBMS Databases
  • Working with Hive Shell
  • Hive Data Types
  • Hive Create Database and Drop Database
  • Hive Create Table and Alter Table

Training Video - 24

Duration 2 hours

Hive -part 2

  • Hive Functions and Operators
  • Creating View and Indexes in Hive
  • Hive QL : Select , Group , Joins , Where clauses ?
  • Analyzing Weather Data Set
  • Testing the Hive Analyzed results againt Sample Output

Training Video - 25

Duration 2 hours

Hive - Part 3

  • Hive and Metastore Derby
  • Changing the Hive Metastore to Mysql
  • Hive Managed vs External Tables
  • Hive Storage with JSON
  • Hive Storage and SerDE
  • Testing the Output from Hive

Training Video - 26

Duration 1 hour 30 mins

Hive Part 4

  • Hive UDF's
  • Configuring and Testing the UDF's
  • Hive Configurations
  • Hive Web UI
  • Hive Property Precedence
  • Running Batch commands in Hive

Training Video - 27

Duration 1 hour 30 mins

Hive Vs Pig

  • Hive and Pig Comparision
  • Using Hive Schema for Pig Load
  • What Tester need to know ?

PROJECT

Training Video - 28

Duration 4 hrs 30 mins

Testing Big Data

  • Three Key Challenges in Testing Big Data
  • Identifying the Testing Gates and Entry Points
  • Finding Bad Data and doing data Quality Checks
  • Functional and Regression Testing
  • Big Data Testing Stages and Testing Task