Curriculum Associates - Principal Engineer - Data Analytics

Key Responsibilities :

- Architect and implement robust, scalable, and high-performance solutions for complex data processing challenges in a product-driven environment.

- Collaborate closely with product managers, data scientists, and engineering teams to deliver innovative data products and features.

- Drive best practices in code quality, testing, and continuous integration to ensure maintainability and reliability of data pipelines.

- Mentor and guide engineering teams on Scala and Spark development, performance tuning, and troubleshooting.

- Engage in technical strategy and roadmap planning aligned with business goals.

- Stay current with the latest trends and advancements in big data technologies, and

proactively evaluate new tools and frameworks.

- Participate in architecture reviews, design sessions, and provide technical leadership across cross-functional teams.

Required Skills & Experience :

- Deep expertise in Scala programming language and Apache Spark framework.

- Strong experience building, deploying, and managing large-scale distributed data processing

systems.

- In-depth understanding of data structures, algorithms, and system design principles relevant

to big data platforms.

- Proficiency with Spark SQL, Spark Streaming, and optimization techniques for large datasets.

- Experience with cloud-based big data ecosystems (AWS, Azure, or GCP) is a plus.

- Hands-on knowledge of related technologies such as Kafka, Hadoop, and container orchestration (Kubernetes/Docker) is advantageous.

- Strong leadership and mentorship skills with experience managing senior engineers or technical leads.

- Excellent problem-solving skills, architectural thinking, and ability to work in a collaborative, agile environment.

- Strong verbal and written communication skills.

Preferred Qualifications :

- Experience contributing to open-source Scala/Spark projects or communities.

- Prior experience in a technical leadership role within a product companys data engineering

or platform team