Kafka Concepts

Course: 28 Minutes

• Course Introduction
• What is Kafka?
• Kafka Architecture
• Partitions
• Topics
• Replicas

Kafka Components

Course: 12 Minutes

• Producers
• Consumers
• Brokers

Deployment

Course: 21 Minutes

• Hardware Specifications
• Deployment Overview
• Red Hat and CentOS deployment
• Puppet Deployment

Operating Tasks

Course: 36 Minutes

• Adding and Removing a Broker
• Balancing Data and Partitions for Performance
• Add New Topics
• Scaling Producers
• Scaling Consumers

Monitoring

Course: 25 Minutes

• Kafka Web Console
• Kafka Offset Monitor
• Monitoring with Graphite
• Monitoring with JMX
• Using Kafka Log Files

Tuning

Course: 9 Minutes

• Kernel Tuning
• Disk Throughput Tuning
• JVM Tuning

Practice: Operate Apache Kafka

Course: 7 Minutes

• Exercise: Operating Apache Kafka

Reading from Kafka

13 Minutes

• Course Introduction
• High-Level Consumer API
• Simple Consumer API
• Hadoop Consumer API

Configuration Settings

Course: 19 Minutes

• Broker Configuration Settings
• Consumer Configuration Settings
• Producer Configuration Settings
• Configuring Compression

Writing to Kafka

Course: 34 Minutes

• Producer API
• Sync Producers
• Async Producers
• Message Acknowledgement
• Batching Messages
• Keyed and Non-Keyed Messages
• Broker Discovery

Testing and Serialization

Course: 14 Minutes

• Kafka Test Suites
• Serialization
• Building a Custom Serializer

Practice: Using Kafka

Course: 5 Minutes

• Exercise: Creating a Producer and Consumer

Kafka Integration with Spark

Course: 1 Hour, 7 Minutes

• Course Introduction
• Configuring Spark and Kafka
• Reading Data from Kafka
• Reading Data from Kafka in Parallel
• Writing Data to Kafka
• Writing Data to Kafka in Parallel
• Creating a Direct Stream
• Planning for Location and Consumer Strategies
• Using an RDD
• Managing Offsets
• Creating a Kafka-Spark Word-splitting Application

Storm Integration

Course: 46 Minutes

• Course Introduction
• Configuring Storm and Kafka
• Describing the Storm-Kafka Pipeline
• Configuring and Using the KafkaSpout API
• Reading from Kafka Using the Storm Connector
• Writing to Kafka
• Creating a Kafka-Storm Word Counting Application
• Managing Offsets in Storm

Practice: Spark and Storm with Kafka

Course: 4 Minutes

• Exercise: Using Storm with Kafka

Clusters

Course: 30 Minutes

• Course Introduction
• Identifying the Benefits of Kafka Clustering
• Working with a Multi-broker Cluster
• Configuring Replication
• Working with Log Compaction
• Configuring the Log Cleaner

Advanced Clusters

Course: 30 Minutes

• Increasing the Replication Factor
• Expanding a Cluster
• Mirroring between Clusters
• Working with Rack Awareness for Replication
• Balancing Leadership and Unclean Leader Election

Real-time Kafka Applications

Course: 57 Minutes

• Course Introduction
• The Real-time Capabilities of Kafka
• Installing the Twitter Streaming API
• Creating a Producer Using the Twitter API
• Creating a Consumer to Transfer to Spark
• Using Spark to Process Tweets
• Creating a Consumer to Transfer to Storm
• Using Storm to Process Tweets
• Using Kafka, Spark, and Storm Together

Practice: Real-time Apps for Kafka

Course: 6 Minutes

• Exercise: Create Real-time Kafka Applications

Start your Apache Kafka journey today!

With 1 year of unlimited access to this rich and interactive e-learning, including progress reporting and guidance, you are ready to successfully implement Kafka in your organization.