Course Description
In this course, professionals will learn to form streaming data analytics solutions via AWS services, including Amazon Kinesis & Amazon Managed Streaming for Apache Kafka (Amazon MSK). Amazon Kinesis is a massively scalable & durable real-time data streaming service. Amazon MSK offers a secure, fully managed, & highly available Apache Kafka service. Professionals will learn how Amazon Kinesis & Amazon MSK combines with AWS services such as AWS Glue & AWS Lambda. The course addresses the stream storage, streaming data ingestion, & stream processing components of the data analytics pipeline. Professionals will also learn to apply security, performance, & cost management ideal practices to the operation of Kinesis & Amazon MSK.
Prerequisites
We recommend that participants of this course have the following-
- At least one-year of data analytics experience or direct experience making real-time applications or streaming analytics solutions. We advise the Streaming Data Solutions on AWS whitepaper for the ones who need a refresher on streaming concepts.
- Finished either Architecting on AWS or Data Analytics Fundamentals
- Completed Building Data Lakes on AWS
Target Audience
This course is intended for-
- Data engineers & architects
- Developers who want to build & manage real-time applications & streaming data analytics solutions
Course Objectives
In this course, professionals will learn to:
- Understand the features & benefits of modern data architecture and learn how AWS streaming services fit into a modern data architecture.
- Identify & apply appropriate techniques, such as compression, sharing, & partitioning, to optimize data storage
- Select & deploy appropriate options to ingest, transform, & store real-time & near real-time data
- Choose the appropriate streams, topics, scaling approach, clusters, & network topology for a specific business use case
- Understand how data storage & processing affect the analysis & visualization mechanisms needed to achieve actionable business insights
- Design & implement a streaming data analytics solution
- Secure streaming data at rest & in transit
- Monitor analytics workloads to identify & remediate problems
- Apply cost management best practices
Content Outline
- Data analytics use cases
- Using the data pipeline for analytics
- The importance of streaming data analytics
- The streaming data analytics pipeline
- Streaming concepts
- Streaming data services in AWS
- Amazon Kinesis in analytics solutions
- Demonstration- Explore Amazon Kinesis Data Streams
- Practice Lab- Setting up a streaming delivery pipeline with Amazon Kinesis
- Using Amazon Kinesis Data Analytics
- Introduction to Amazon MSK
- Overview of Spark Streaming
- Exploring Amazon Kinesis using a clickstream workload
- Creating Kinesis data & delivery streams
- Demonstration- Understanding producers & consumers
- Building stream producers
- Building stream consumers
- Building & deploying Flink applications in Kinesis Data Analytics
- Demonstration- Explore Zeppelin notebooks for Kinesis Data Analytics
- Practice Lab- Streaming analytics with Amazon Kinesis Data Analytics & Apache Flink
- Optimize Amazon Kinesis to achieve actionable business insights
- Security & monitoring best practices
- Use cases for Amazon MSK
- Creating MSK clusters
- Demonstration- Provisioning an MSK Cluster
- Ingesting data into Amazon MSK
- Practice Lab- Introduction to access control with Amazon MSK
- Transforming & processing in Amazon MSK
- Optimizing Amazon MSK
- Demonstration: Scaling up Amazon MSK storage
- Practice Lab: Amazon MSK streaming pipeline & application deployment
- Security & Monitoring
- Demonstration: Monitoring an MSK cluster
- Use case review
- Class Exercise- Designing a streaming data analytics workflow
Modern data architectures
FAQs
A data lake is a centralized & secured repository that collects all your data, both in its original form & prepared for analysis.
There are three methods of data storage, namely: –
- Object storage
- File storage
- Block storage
EC2 is a service that enables business clients to run application programs in the computing environment.
AWS security provides opportunities to protect the data, check out security-related activity & receive automated responses.
Radiant believes in a practical & creative approach to training & development, which distinguishes it from other activity & developmental platforms. Moreover, training courses are undertaken by experts with a range of experience in their domain.
Radiant team of experts will be available at e-mail support@radianttechlearning.com to answer your technical queries after the training program.
Yes, Radiant will provide you most updated, high, value & relevant real-time projects & case studies in each training program.
Technical issues are unpredictable & might occur with us as well. Participants must ensure they have access to the required configuration with good internet speed.
Radiant Tech learning offers training programs on weekdays, weekends & combination of weekdays & weekends. We provide you with complete liberty to choose the schedule that suits your need.