- Knowledge of- IBM Datastage Architecture, Stages/Transformations, Design, ETL flow, advanced SQLs

- Develop Datastage Parallel Extender jobs using different stages like Aggregator, Join, Merge, Lookup, Source dataset, External Filter, Row generator, Column Generator, Change Capture, Copy, Funnel, Short, Peek stages, XML stage, Java stage, etc.

- Using Datastage Director for running and monitoring the jobs

- Created Datastage sequences to run the batch jobs

- Knowledge of Best Practices in- Datastage, Performance improvements, implementing CDC, UDFs

- Strong Understanding of- Unix/Linux system, file systems, shell scripting

- Strong understanding of scheduling tools such- as Autosys, Control- M, Tivoli etc.

- Good knowledge on- MF file structures along with RDBMS

- Provides expertise in determining the strategic technical direction and system architecture for initiatives

Key Responsibilities :

ETL Design & Development :

- Design, develop, and build complex ETL solutions using IBM DataStage v11.x, adhering to industry best practices.

- Develop parallel extender jobs using various stages, including :

Aggregator, Join, Merge, Lookup
Source Dataset, External Filter
Row Generator, Column Generator
Change Capture, Copy, Funnel, Sort, Peek
XML Stage, Java Stage, and other advanced DataStage components

- Create and maintain DataStage sequences for orchestration and batch processing.

- Utilize DataStage Director for scheduling, monitoring, and troubleshooting ETL jobs.

Database & Data Integration :

- Work extensively with backend RDBMS, preferably DB2, including writing advanced SQL queries, stored procedures, and performance-tuned transformations.

- Integrate data from multiple sources, including mainframe file structures and relational systems.

- Implement Change Data Capture (CDC) and User-Defined Functions (UDFs) where required.

System Architecture & Technical Leadership :

- Participate in and contribute to design and architecture review sessions (minimum 2 years experience expected).

- Provide expert guidance on technical direction, ETL architecture, and overall data integration strategy.

- Ensure solutions meet enterprise standards for scalability, performance, and reliability.