A Map for Big Data

Course: 10 Minutes

• Course Introduction
• Mapping Big Data
• Continuing to Map Big Data

Key Terminology for Big Data

Course: 9 Minutes

• Defining Big Data
• Terms for Data

Ecosystem for Hadoop

Course: 18 Minutes

• Mapping the Big Data Stack
• Introducing Data Repository Components
• Introducing Data Refinery Components
• Introducing Data Factory Components

Theory for Hadoop

Course: 13 Minutes

• Design Principles for Hadoop
• The Principle of Sharing Nothing
• The Principle of Embracing Failure

Data Repository for Hadoop

Course: 9 Minutes

• Hadoop Distributed File System (HDFS)
• Introducing HDFS Daemons

Data Refinery for Hadoop

Course: 12 Minutes

• Introducing Hadoop YARN
• YARN Daemons on the Master Server
• YARN Daemons on the Data Server
• Introducing MapReduce

Data Analytics

Course: 6 Minutes

• Introducing Data Analytics

Hadoop Ecosystem Complexities

Course: 7 Minutes

• Mastering the Hadoop Ecosystem

Practice: Ecosystem for Hadoop

Course: 12 Minutes

• Exercise: Identifying Hadoop Ecosystem components

Configuration of User Environments

Course: 7 Minutes

• Course Introduction
• Selecting an Environment

Pre-installation for Hadoop

Course: 23 Minutes

• Creating a Development Environment
• Installing Java
• Setting up SSH

Setup of Hadoop

Course: 1 Hour, 5 Minutes

• The History of Hadoop Versions
• Setting Up Hadoop
• Installing Hadoop
• Configuring Hadoop Environment
• Configuring HDFS
• Starting and Stopping HDFS
• Configuring YARN and MapReduce
• Starting and Stopping YARN
• Stress Testing Hadoop

Operations for Hadoop

Course: 13 Minutes

• First Use of HDFS
• Introducing WordCount
• First Use of WordCount

Monitoring for Hadoop

Course: 11 Minutes

• Hadoop Web UIs
• NameNode and Resource Manager Web UIs

Troubleshooting of Hadoop Installation

Course: 22 Minutes

• Configuration Changes
• Troubleshooting Hadoop
• Troubleshooting Installation Errors

Practice: Hadoop Installation and Configuration

Course: 12 Minutes

• Exercise: Install and Configure Hadoop

Theory of HDFS

Course: 37 Minutes

• Course Introduction
• Describing HDFS Data Blocks
• Describing HDFS URI
• Describing the NameNode
• NameNode in Detail
• Describing the DataNode
• Describing the Checkpoint Node
• Describing the Backup Node

Operations for HDFS

Course: 19 Minutes

• HDFS Command Categories
• HDFS Commands for Managing Data Files
• HDFS Commands for Managing Web Logs

Troubleshooting of HDFS

Course: 13 Minutes

• HDFS Administration
• HDFS Configuration
• Troubleshooting HDFS

Theory for NoSQL and RDBMS

Course: 6 Minutes

• Comparing NoSQL to RDBMS

Overview of HBase and ZooKeeper

Course: 24 Minutes

• Introducing HBase and ZooKeeper
• Installing ZooKeeper
• Installing HBase

Operation for HBase

Course: 25 Minutes

• Using the HBase Command Line
• Working with HBase Tables
• Working with HBase Data

Practice: Hadoop Distributed File System

Course: 6 Minutes

• Exercise: Identifying features of HDFS

The Purpose of Flume

Course: 15 Minutes

• Course Introduction
• Defining Flume Data
• Introducing cURL
• Using cURL for Web Data

Setup of Flume

Course: 8 Minutes

• Defining Flume
• Installing Flume

Operations for Flume

Course: 17 Minutes

• Creating Flume Agents
• Describing a Flume Agent
• First Flume Agent

Sources, Sinks, and Channels

Course: 13 Minutes

• Flume Sources
• Flume Sinks
• Flume Channels
• File Channel to HDFS

Serializing Data with Avro

Course: 15 Minutes

• Avro Serialization
• Using Avro Source
• Multiple Flume Agents

Multiplex Agents for Flume

Course: 30 Minutes

• Flume Timestamps
• Timestamping with Flume
• Multiple Sources with Flume
• Multi-flow Flume Agents
• Multi-source Flume Agents
• Multiple Sinks with Flume
• Multi-sink Flume Agents

Troubleshooting of Flume

Course: 9 Minutes

• Flume Troubleshooting
• Logging to the Flume Log File

Practice: Recognize Data Repository with Flume

Course: 15 Minutes

• Exercise: Configuring Flume Agents Files

Setup of MySQL

Course: 19 Minutes

• Course Introduction
• Overviewing MySQL
• Installing MySQL
• Creating a Database
• Loading Data into MySQL Tables

The Purpose of Sqoop

Course: 5 Minutes

• Overviewing Sqoop
• Architecture of Sqoop

Setup of Sqoop

Course: 8 Minutes

• Overview of Sqoop Configuration
• Installing Sqoop

Operations for Sqoop

Course: 35 Minutes

• Overview of Importing with Sqoop
• Performing a Sqoop Import
• Overview of Exporting with Sqoop
• Performing a Sqoop Export
• Sqoop and HBase
• Exporting into HBase

Troubleshooting of Sqoop

Course: 13 Minutes

• Sqoop Troubleshooting
• Correcting a Database Connect Failure

Practice: Data Repository with Sqoop

Course: 6 Minutes

• Exercise: Using Sqoop to extract data from a RDBMS

Theory for YARN

Course: 28 Minutes

• Course Introduction
• Explaining Parallel Processing
• YARN Key Concepts
• YARN Resource Manager
• YARN Node Manager
• YARN ApplicationMaster
• YARN Job Failure
• YARN Configurations

Theory for Key-value Pairs

Course: 7 Minutes

• Key-Value Pairs
• MapReduce and Key-Value Pairs

Operations for MapReduce

Course: 19 Minutes

• WordCount, the Hello World of Hadoop
• MapReduce
• MapReduce Step-by-Step

First Program for MapReduce

Course: 10 Minutes

• Exploring Hadoop Classpath
• Writing a MapReduce Job

APIs for MapReduce

Course: 10 Minutes

• The Mapper Java API
• The Reducer Java API
• The Driver Java API

Second Program for MapReduce

Course: 6 Minutes

• Writing a MapReduce Job for Inventory

Streaming for MapReduce

Course: 9 Minutes

• Hadoop Streaming
• Running a Streaming Job

Practice: Using YARN and MapReduce

Course: 10 Minutes

• Exercise: Refining Data with YARN and MapReduce

The Purpose of Hive

Course: 6 Minutes

• Course Introduction
• Overviewing Hive

Setup of Hive

Course: 23 Minutes

• Overview of Hive Configuration
• Installing Hive
• Using Derby for Hive
• Setting Up MySQL for Hive

Details of Hive

Course: 4 Minutes

• Hive Data Types
• Hive Operators

Operations for Hive

Course: 34 Minutes

• Hive CREATE Statements
• Hive SELECT Statements
• Hive SQL Statements
• Writing a First Hive Script

Joins and Views for Hive

Course: 10 Minutes

• Hive Joins and Views
• Joining and Viewing in Hive

Partitions and Buckets for Hive

Course: 19 Minutes

• Overview of Partitioning Hive Data
• Writing a Hive Partition Script
• Overview of Bucketing Hive Data
• Bucketing Hive Data

User-defined Functions for Hive

Course: 8 Minutes

• Hive User-defined Functions
• Create a Hive UDF

Troubleshooting for Hive

Course: 6 Minutes

• Hive Troubleshooting
• Using a Hive Explain Plan

Practice: Hive features, loading and querying

Course: 15 Minutes

• Exercise: Hive features, loading and querying

The Purpose of Pig

Course: 9 Minutes

• Course Introduction
• Overviewing Pig

Setup for Pig

Course: 6 Minutes

• Overview of Pig Configuration
• Installing Pig

Details of Pig

Course: 4 Minutes

• Pig Data Types
• Pig Operators

Operations for Pig

Course: 35 Minutes

• Pig Command Line
• Pig Scripts
• First Pig Script
• Pig Filtering
• Pig FOREACH
• Pig Parameters and Arguments
• Pig Functions

Working with Pig Operators

Course: 28 Minutes

• Pig JOIN
• Pig GROUP
• Pig COGROUP
• Pig FLATTEN

User-defined Functions for Pig

Course: 10 Minutes

• Pig User-defined Functions
• Creating a Pig UDF

Troubleshooting for Pig

Course: 12 Minutes

• Pig Troubleshooting
• Debugging with Pig

Practice: Configuring and Using Pig

Course: 10 Minutes

• Exercise: Working with Pig

The World of Data

Course: 11 Minutes

• Course Introduction
• The World of Data

Flowing Data with Sqoop

Course: 37 Minutes

• Sqoop and Hive
• Loading SQL Data Tables
• Importing Data into Hive
• Sqoop and Hive Exports
• Exporting Data from Hive
• Working with Date Data Types
• Importing Datetime Stamps
• Exporting Datetime Stamps

Flowing Data with Hive

Course: 18 Minutes

• Preprocessing Data
• Cleaning with Functions
• Cleaning with Regular Expressions

Administration for the Ecosystem

Course: 39 Minutes

• Selecting Additional Ecosystem Components
• Best Practices for Pseudo-Mode
• Admin Scripts in Action
• Class Paths in Action
• Config Files in Action

Practice: Data Flow for Sqoop and Hive

Course: 10 Minutes

• Exercise: Managing Data Flow with Sqoop and Hive