Wissen Technology - Senior Data Engineer

Job Title : Senior Data Engineer

About the Role :

We are seeking a seasoned Python developer with deep expertise in data engineering, ETL, and enterprisescale integration. The candidate will design, build, and maintain highperformance data pipelines, realtime streaming solutions, and APIdriven ingestion frameworks that connect multiple business systems.

Key Responsibilities :

- Design, develop, and maintain robust ETL processes and data pipelines using Python and enterprisegrade processing frameworks.

- Implement eventdriven architectures and realtime streaming solutions with Apache Kafka, ensuring lowlatency data flow across systems.

- Build, optimize, and tune PostgreSQL databases, writing advanced SQL queries and performing performance tuning.

- Develop and integrate RESTful APIs for data ingestion, transformation, and delivery across enterprise applications.

- Manage filebased data feeds (SFTP, CSV, flat files, XML, JSON), handling ingestion, validation, transformation, and reconciliation.

- Ensure data quality, consistency, and governance through automated validation and reconciliation processes.

- Collaborate with crossfunctional teams to define integration requirements and deliver scalable solutions that meet business objectives.

Required Skills :

- 7+ years of professional Python development experience with a focus on data engineering and integration.

- Proven expertise in building ETL pipelines and data processing workflows at enterprise scale.

- Minimum 3 years of handson experience with Apache Kafka for realtime streaming and eventdriven architectures.

- Advanced proficiency in PostgreSQL, including complex SQL development, query optimization, and performance tuning.

- Strong experience designing and consuming REST APIs for enterprise data ingestion and processing.

- Handson experience with SFTP, CSV, flat files, XML, JSON, and other filebased data formats.

- Deep understanding of data transformation, validation, reconciliation, and dataquality best practices.

- Ability to design scalable, maintainable data integration solutions across multiple enterprise systems.