Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Strategy
- Multi-tiered ETL architectures
- Creating modular and reusable components
- Hybrid methodologies spanning various systems
Advanced Performance Optimization
- Step-by-step performance tuning
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations
- Building custom plugins
- Expanding PDI capabilities using Java and JavaScript
Complex Data Handling and Integrations
- Real-time and streaming data connections
- Interaction with big data platforms
- Sophisticated file and API handling
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Overseeing extensive job networks
- Error recovery and failover mechanisms
- Orchestration at the environment level
Repository Management, Version Control, and CI/CD
- Enterprise repository strategies
- Connecting PDI with Git
- Patterns for continuous deployment
Deployment, Monitoring, and Production Operations
- Migrating solutions across different environments
- Operational tools and dashboards
- Ensuring end-to-end production readiness
Recap and Future Pathways
Requirements
- Familiarity with ETL pipelines and data modeling concepts
- Proficiency with intermediate-level PDI transformations
- Strong SQL and scripting competencies
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration tasks
21 Hours
Testimonials (1)
It's a hands-on session.
