Junior Data Engineer - Python/PySpark

Role Overview :

We are seeking a Junior Palantir Data Engineer with a solid foundation in Python, PySpark, and AWS to support the development of scalable data pipelines and contribute to analytics and data product initiatives.

You will work closely with senior engineers and product teams to deliver efficient and reliable data solutions using Palantir Foundry.

This role is ideal for candidates with hands-on experience in distributed data systems and an eagerness to build deep expertise in the Palantir ecosystem.

Key Responsibilities :

- Design and implement basic to intermediate ETL/ELT pipelines using Python and PySpark.

- Assist in data integration workflows on Palantir Foundry, working on ontology objects and pipeline building.

- Contribute to AWS-based data engineering tasks, such as ingesting data via S3, orchestrating with Lambda or Glue, and managing IAM roles securely.

- Work with version control and CI/CD tools to build automation workflows.

- Support the development of internal tooling for monitoring, data validation, and reporting.

- Participate in troubleshooting and debugging data issues across dev, staging, and production environments.

- Collaborate with cross-functional teams to implement business logic within pipelines and data models.

Technical Skills Required :

- Languages : Proficient in Python, with working knowledge of PySpark

- Cloud : Practical exposure to AWS (S3, Lambda, CloudWatch, IAM)

- Data Platforms : Foundational understanding or hands-on experience with Palantir Foundry

- Version Control & CI/CD : Git, GitLab or Bitbucket, Jenkins or AWS CodeBuild

- SQL : Ability to write optimized queries for large datasets

- Operating Systems : Proficiency in Linux/Unix for scripting and data handling

- Monitoring & Debugging : Basic understanding of tools like CloudWatch or ELK

Qualifications :

- Bachelors degree in Computer Science, Information Systems, Data Engineering, or equivalent