Quantexa Data Engineering Specialist - Scala/Spark

Key Responsibilities :

- Design, build, and optimize robust data pipelines and workflows using Quantexa, Apache Spark (Scala), and Hadoop.

- Contribute to the development and deployment of enterprise-scale data solutions that support fraud detection, risk assessment, customer intelligence, and other use cases.

- Perform ETL development, data transformation, and data cleansing operations for large and complex datasets.

- Collaborate with data architects, analysts, and business stakeholders to understand requirements and translate them into scalable data solutions.

- Execute performance tuning and optimization of Spark jobs and data pipelines to ensure minimal latency and high reliability.

- Utilize PL/SQL and Unix Shell Scripting for back-end data processing, automation, and integration with legacy systems.

- Support unit testing, UAT, and production rollout of data solutions, ensuring alignment with quality and compliance standards.

- Work within Agile delivery models, participating in daily stand-ups, sprint planning, and retrospectives using tools like JIRA.

- Provide technical documentation, version control, and knowledge transfer to other team members and stakeholders.

-Stay updated with emerging technologies and recommend tools/strategies to improve the architecture and performance.

Must-Have Skills & Experience :

6+ years of overall IT experience, including strong experience in :

- Quantexa platform (Certified Quantexa Developer is a plus, but not mandatory)

Apache Spark and Scala

- Hadoop ecosystem tools (e.g., HDFS, Hive, HBase, etc.)

- PL/SQL and Unix Shell Scripting

- Strong command of ETL processes, data modeling, and data architecture.

- Hands-on experience with RDBMS and Data Warehousing concepts.

- Proven ability to deliver high-quality data solutions in enterprise application environments.

- Exposure to banking, financial services, or risk analytics domains is desirable.

Soft Skills & Other Requirements :

- Excellent problem-solving and analytical skills, with attention to detail.

- Strong verbal and written communication skills for effective stakeholder collaboration.

- Ability to work independently and collaboratively in fast-paced project settings.

- Comfortable with Agile methodologies and version control tools.

- Self-motivated and willing to take initiative on new challenges.

Preferred Qualifications :

- Quantexa Developer Certification (Preferred but not mandatory)

- Familiarity with CI/CD pipelines, Cloud data platforms, and containerization tools is a plus.