Data Engineer - Python/SQL

Description :

Key Responsibilities :

- Design, build, and maintain scalable data pipelines for structured and unstructured financial datasets.

- Work with real-time and batch data processing systems for investment research workflows.

- Develop ETL/ELT pipelines using modern cloud-native technologies.

- Integrate market, financial, and alternative data sources into centralized data platforms.

- Optimize data architecture for performance, reliability, and scalability.

- Collaborate with AI/ML teams to support agentic workflows and intelligent automation.

- Build and maintain data models for analytics, reporting, and research use cases.

- Ensure data quality, governance, security, and compliance standards are maintained.

- Support scaling of platform components from MVP/v0.1 to stable production-ready systems.

- Participate in architecture discussions and contribute to system design decisions.

Required Skills :

- Strong experience with Python, SQL, and data processing frameworks.

- Hands-on experience with cloud platforms such as Microsoft Azure/AWS/GCP.

- Expertise in ETL/ELT pipeline development.

- Experience with Databricks, Spark, Kafka, or similar distributed data technologies.

- Strong understanding of data warehousing and lakehouse architectures.

- Experience working with APIs, streaming data, and large-scale datasets.

- Knowledge of CI/CD and DevOps practices for data platforms.

- Understanding of data governance and security best practices

(Data Engineering - Fintech Domain - Mandatory)