Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Strategy
- Multi-tier ETL architecture models.
- Crafting modular, reusable components.
- Implementing hybrid cross-system approaches.
High-Level Performance Engineering
- Step-by-step optimization techniques.
- Strategies for parallelism and threading.
- Monitoring pipelines under heavy load.
Automation, Scripting, and Custom Extensions
- Embedding scripts within transformations.
- Building custom plugins.
- Expanding PDI functionality using Java and JavaScript.
Advanced Data Processing and Integrations
- Real-time and streaming data integration.
- Interacting with big data platforms.
- Sophisticated file and API handling.
Data Governance, Security, and Compliance
- Protecting transformations and credentials.
- Ensuring data lineage and traceability.
- Addressing regulatory and compliance requirements.
Enterprise Orchestration and Scheduling
- Overseeing extensive job networks.
- Designing error recovery and failover mechanisms.
- Orchestrating across different environments.
Repository Management, Version Control, and CI/CD
- Enterprise-focused repository strategies.
- Integrating PDI with Git.
- Implementing continuous deployment workflows.
Deployment, Monitoring, and Production Operations
- Migrating solutions between environments.
- Utilizing operational tools and dashboards.
- Achieving end-to-end production readiness.
Recap and Future Directions
Requirements
- Familiarity with ETL pipelines and data modeling concepts.
- Hands-on experience with intermediate-level PDI transformations.
- Strong proficiency in SQL and scripting languages.
Target Audience
- Senior data engineers.
- ETL architects.
- Professionals responsible for managing complex data integration tasks.
21 Hours
Testimonials (1)
It's a hands-on session.