Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layered ETL architectures
- Crafting modular and reusable components
- Hybrid system integration approaches
Advanced Performance Engineering
- Optimization at the step level
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Utilizing scripting within transformations
- Creation of custom plugins
- Extending PDI capabilities through Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integration
- Interaction with big data platforms
- Sophisticated file and API handling
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Data lineage and traceability
- Adherence to regulatory and compliance standards
Enterprise Orchestration and Scheduling
- Oversight of extensive job networks
- Designing error recovery and failover mechanisms
- Orchestration at the environment level
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories
- Integration of PDI with Git
- Patterns for continuous deployment
Deployment, Monitoring, and Production Operations
- Migrating solutions across various environments
- Utilization of operational tools and dashboards
- Achieving full production readiness
Conclusion and Future Directions
Requirements
- Foundational knowledge of ETL pipelines and data modeling
- Proficiency with intermediate-level PDI transformations
- Strong capabilities in SQL and scripting
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration tasks
Testimonials (1)
It's a hands-on session.
