Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Structuring
- Multi-tier ETL architectures
- Creating modular and reusable components
- Hybrid strategies across different systems
Advanced Performance Engineering
- Optimization at the step level
- Strategies for parallelism and threading
- Monitoring pipelines under heavy load
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations
- Crafting custom plugins
- Expanding PDI features using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integration
- Collaboration with big data platforms
- Sophisticated file and API handling
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Ensuring data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Overseeing extensive job networks
- Designing error recovery and failover mechanisms
- Orchestration at the environment level
Repository Management, Version Control, and CI/CD
- Strategies for enterprise repositories
- Connecting PDI with Git
- Patterns for continuous deployment
Deployment, Monitoring, and Production Operations
- Transitioning solutions between environments
- Operational tools and dashboards
- Achieving complete production readiness
Wrap-up and Future Directions
Requirements
- Familiarity with ETL pipelines and data modeling concepts
- Practical experience with intermediate-level PDI transformations
- Proficiency in SQL and scripting languages
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration tasks
Testimonials (1)
It's a hands-on session.
