Get in Touch

Course Outline

Module 1: Streaming Overview

  • Key distinctions between batch processing and streaming
  • Use cases for Streaming Data Management
  • Streaming architecture overview
  • Kappa architecture
  • End-to-end Streaming Data Management
  • Types of Streaming data
  • Benefits of Streaming

Module 2: Edge Data Streaming (EDS) Overview

  • EDS architecture
  • Key features of EDS
  • EDS Data flow process
  • EDS User Interface
  • Creating an EDS Service
  • Creating a data flow
  • Deploying a data flow
  • Monitoring the data flow
  • Lab 1: Creating an Edge Data Streaming Service
  • Lab 2: Creating and Deploying a Data Flow

Module 3: Big Data Streaming Overview

  • Overview of Big Data Streaming
  • Stream Data Processing using Spark Streaming
  • Architecture of BDS components
  • Key features of BDS

Module 4: Kafka Overview

  • Kafka Concepts
  • Kafka Core APIs
  • Topics in Kafka
  • Kafka Models
  • Kafka Use cases
  • Lab: Creating a Kafka Connection

Module 5: Streaming Mappings

  • Sources in a Streaming Mapping
  • Targets in Streaming Mapping
  • Lookup sources
  • Properties of Kafka Data Objects
  • Lab: Creating a Mapping with Kafka Source and HDFS Target
  • Lab: Creating a Mapping with Kafka Source and Kafka Target
  • BDS Transformations
  • Lab: Enhancing Mapping Using Filter and Expression Transformations
  • Lab: Enhancing Mapping Using Window and Aggregator Transformations
  • Lab: Enhancing Mapping Using Sorter and Rank Transformations

Module 6: Monitoring Logs and Troubleshooting

  • Spark Monitoring
  • Viewing Logs
  • Troubleshooting
  • Lab: Monitoring an EDS Data Flow
  • Lab: Monitoring a BDS Mapping

Module 7: Performance Tuning and Best Practices

  • Optimizing Spark Job Performance
  • Best practices for working with streaming data

Module 8: End-to-End Use Case

  • Use Case Description
  • EDS and BDS – Final Goal
  • Lab: Converting Unstructured Streaming Data into Structured Data
  • Lab: Ingesting Data from EDS to BDS and Executing a BDS Mapping
 14 Hours

Number of participants


Price per participant

Testimonials (3)

Upcoming Courses

Related Categories