Flyers Soft - Data Engineer - Informatica

Job Description :

Key Responsibilities :

- Design, develop, and maintain data pipelines using Informatica DEI in a Hadoop and Azure Cloud Data Lake environment.

- Build and optimize large-scale data ingestion, transformation, and integration processes across diverse data sources.

- Collaborate with architecture, analytics, and business teams to deliver high-quality, scalable, and reliable data solutions.

- Integrate and orchestrate data workflows using Azure Data Lake, Azure Databricks, Azure Synapse, and Azure Stream Analytics.

- Develop and maintain shell scripts for automation, monitoring, and troubleshooting in Unix/Linux environments.

- Write efficient, well-tuned SQL and Hive queries for data extraction, validation, and reporting.

- Leverage Python or Scala for advanced data transformations and pipeline automation.

- Understand and manage Informatica repositories, services, and connectors for various data sources.

- Ensure adherence to data governance, security, and performance optimization standards.

- Work closely with QA and support teams to maintain production stability and reliability.

Qualifications & Experience :

- Must have Minimum 7+ years of exp in Informatica Data Engineering tool in Hadoop environment and Big Data Ecosystem.

- Must have Minimum 5+ years of experience in designing Data Pipeline in Azure Cloud Data Lake and Informatica Data Engineering.

- Must have a understanding of Azure Stack (Azure Data Bricks, Azure streaming Analytics & Azure Synapse).

- Must Have Unix knowledge for writing shell scripts and troubleshoot of existing shell scripts.

- Experience in any programming language like Python/Scala.

- Must have SQL knowledge of writing & tuning complex query/script in RDBMS/Hive.

- Understanding of informatica components/services/Repository.

- Good understanding of informatica different type of connectors.

- Experience in Financial & Banking domain will added advantage.