Course Description
This 4-day instructor-led course begins by introducing Apache Kafka, explaining its key concepts & architecture, & discussing several everyday use cases. On top of that, you'll learn how to plan a Kafka deployment and then get hands-on experience by installing & configuring your own multi-node cloud-based Kafka cluster on the Cloudera Data Platform (CDP).
After that, you'll use this cluster in more than 20 practical exercises that cover a wide range of fundamental skills, starting with how to create Kafka topics, producers, and consumers before moving on to gradually more challenging facets of Kafka operations and development, like those related to scalability, reliability, and performance issues. Cloudera Manager, Schema Registry, Streams Messaging Manager, & Cruise Control are just a few of the tools you'll learn and use throughout the course as you work with Kafka.
Audience Profile
This training is designed for system administrators, data engineers, & developers.
Learning Objectives
During this course, you learn how to:
- Plan, deploy, & operate Kafka clusters
- Make & manage topics
- Develop producers & consumers
- Use replication to improve fault tolerance
- Use partitioning to improve scalability
- Troubleshoot common problems & performance issues
- Prerequisites
- All students are expected to have essential Linux experience, & basic proficiency with the Java programming language is recommended. Prior experience with Apache Kafka is optional.
Content Outline
Lessons
- High-Level Architecture
- Common Use Cases
- Cloudera's Distribution of Apache Kafka
Lessons
- System Requirements & Dependencies
- Service Roles
- Preparing for Deployment Using Kafka Services
- Exercise: Preparing the Exercise Environment
- Exercise: Using Cloudera Manager to Install the Kafka Service
- Exercise (optional): Make Metrics Dashboards
- Exercise (optional): Using the CM API
Lessons
- Make & Manage Topics
- Running Producers & Consumers
Lessons
- Streams Messaging Manager Overview
- Producers, Topics, & Consumers
- Data Explorer
- Brokers
- Topic Management
- Exercise: Controlling Topics using the CLI
- Exercise: Connecting Producers & Consumers from the Comm& Line
Lessons
- Overview of Kafka's APIs
- Topic Management from the Java API
- Exercise (optional): Controlling Kafka Topics Using the Java API
- Using Producers & Consumers from the Java API
- Exercise: Developing Producers & Consumers with the Java API
Lessons
- Replication
- Exercise: Observing Downtime Due to Broker Failure
- Considerations for the Replication Factor
- Exercise: Adding Replicas to Improve Availability
Lessons
- Partitioning
- How Messages are Partitioned
- Exercise: Examining the Effects of Partitioning on Performance
- Consumer Groups
- Exercise: Applying Consumer Groups
- Consumer Rebalancing
- Exercise: Controlling Partition Assignment with a Key
Lessons
- Delivery Semantics
- Demonstration (optional): ISRs vs. ACKs
- Producer Delivery
- Exercise: Idempotent Producer
- Transactions
- Exercise: Transactional Producers & Consumers
- Handling Consumer Failure
- Offset Management
- Exercise: Detecting & Suppressing Duplicate Messages
- Exercise: Handling Invalid Records
- Handling Producer Failure
Lessons
- End-to-End Latency
- Notifiers
- Alert Policies
- Use Cases
Lessons
- Monitoring Overview
- Monitoring using Cloudera Manager
- Charts & Reports in CM
- Monitoring Recommendations
- Metrics for Troubleshooting
- Diagnosing Service Failure
- Exercise: Monitoring Kafka
Lessons
- Controlling Kafka Topic Storage
- Demonstration (optional): Message Retention Period
- Log Cleanup & Collection
- Rebalancing Partitions
- Cruise Control
- Exercise: Installing Cruise Control
- Exercise: Troubleshooting Kafka Topics
- Unclean Leader Election
- Exercise: Unclean Leader Election
- Adding & Removing Brokers
- Exercise: Adding & Removing Brokers
- Best Practices
Lessons
- Message Structure
- Schema Registry
- Defining Schemas
- Schema Evolution & Versioning
- Schema Registry Client
- Exercise: Using an Avro Schema
Lessons
- Message Size
- Batching
- Compression
- Exercise: Observing How Compression Affects Performance
Lessons
- Cluster Sizing
- Performance Tuning Strategies for the Administrator
- Exercise: A Use Case Requires Planning Capacity
Lessons
- Encryption
- Authentication
- Authorization
- Auditing
FAQs
A: To attend the training session, you should have operational Desktops or Laptops with the required specifications and a good internet connection to access the labs.
A: We would always recommend you attend the live session to practice & clarify the doubts instantly & get more value from your investment. However, if, due to some contingency if you have to skip the class, Radiant Tech learning will help you with the recorded session of that particular day. However, those recorded sessions are not meant only for personal consumption & NOT for distribution or commercial use.
A: Radiant Tech learning has a data center containing a Virtual Training environment for participants' hand-on-practice. Participants can easily access these labs over Cloud with the help of a remote desktop connection. Radiant virtual labs allow you to learn from anywhere in the world & in any time zone.
A: The learners will be enthralled as we engage them the real-world & Oriented industry projects during the training program. These projects will improve your skills & knowledge, & you will gain a better experience. These real-time projects will help you a lot in your future tasks & assignments.
A: You can request a refund if you do not wish to enroll in the course.
A: Yes, you can.
A: We adhere to the highest Internet security standards. Any data that is kept is not disclosed to outside parties.
A: It is recommended but optional. Being acquainted with the primary course material will enable students & the trainer to move at the desired pace during classes. You can access courseware for most vendors.
A: You can buy online from the page by clicking on "Buy Now." You can view alternate payment methods on the payment options page.
A: Yes, students can pay from the course page.
A: The course completion certification will be awarded to all the professionals who have completed the training program & the project assignment given by your instructor. Using the certificate in your future job interviews will surely help you land your dream job.
A: Radiant believes in a practical & creative approach to training & development, which distinguishes it from other training & developmental platforms. Moreover, training courses are undertaken by experts with a range of experience in their domain.
A: Radiant team of experts will be available at e-mail support@radianttechlearning.com to answer your technical queries after the training program.
A: Yes, Radiant will provide you most updated, high, value-relevant real-time projects & case studies in each training program.
A: Technical issues are unpredictable & might occur with us as well. Participants must ensure access to the required configuration with good internet speed.
A: Radiant Techlearning offers training programs on weekdays, weekends & combination of weekdays & weekends. We provide you with complete liberty to choose the schedule that suits your need.
A: Radiant has highly intensive selection criteria for Technology Trainers & Consultants who deliver training programs. Our trainers & consultants undergo rigorous technical & behavioral interview & assessment processes before they are boarded in the company.
Our Technology experts/trainers & consultants carry deep-dive knowledge in the technical subject & are certified by the OEM.
Our training programs are practically oriented with 70% – 80% hands-on training technology tools. Our training program focuses on one-on-one interaction with each participant, the latest content in the curriculum, real-time projects & case studies during the training program.
Our faculty will provide you with the knowledge of each course from the fundamental level in an easy way & you are free to ask your doubts any time from your respective faculty.
Our trainers have patience & ability to explain complex concepts simplistically with depth & width of knowledge.
To ensure quality learning, we provide a support session even after the training program