Data Engineer - SQL/Python

About Company :

Over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from your business, your people and your machines.

We help enterprises store, enrich, activate and monetise their data to improve their customers experiences, develop new revenue streams and lower their business costs.

Over 80% of the Fortune 100 trust our client for data solutions.

The companys consolidated revenues for fiscal 2024 (ended March 31, 2024). Approximately $57.5 billion USD, and the company has approximately 296,000 employees worldwide.

It delivers digital solutions utilising Lumada in five sectors, including Mobility, Smart Life, Industry, Energy and IT, to increase our customers social, environmental and economic value.

Location : Hyderabad, Bangalore, Pune (Remote).

Experience : 6- 9 yrs.

Notice Period : Immediate joiners Only.

Job Description :

We are seeking a highly skilled and motivated Data Engineer with 7 to 10 years of hands-on experience in Data Engineering or a related role.

The ideal candidate will have expertise in modern data engineering practices, a deep understanding of AWS cloud services, and the ability to build robust data pipelines and architectures.

Key Responsibilities :

- Build and optimize data architectures and models to support analytics and reporting needs.

- Work extensively with AWS services such as Lambda, Glue, Athena, S3, Redshift, and EC2 for data processing and storage.

- Ensure data integrity, quality, and security by implementing robust ETL processes and monitoring solutions.

- Debug and troubleshoot data pipeline issues with strong analytical and problem-solving skills.

- Implement modern data practices, including data lakes and real-time streaming processing capabilities.

- Collaborate with cross-functional teams and adapt to rapidly changing technological landscapes.

- Leverage tools like GIT and CI/CD pipelines for version control and deployment automation.

Required Qualifications :

- Strong expertise in AWS cloud services (AWS Lambda, Glue, Athena, S3, etc.)

- Proficiency in Python and SQL.

- Solid understanding of data architecture and modeling concepts.

- Experience with ETL tools (e.g., Pentaho, SSIS, Informatica, HVR).

- Knowledge of database, data warehouse, and big data technologies.

- Experience with monitoring and logging solutions.

Preferred Skills :

- Experience with REST APIs and Salesforce APIs.

Technologies :

- Airflow, Spark, Linux.