HamburgerMenu
hirist

Senior Data Engineer - Spark/Python

Aays Analytics
Multiple Locations
6 - 8 Years

Posted on: 14/09/2025

Job Description

Position : Sr. Data Engineer


Desired Experience : 6+ years


Job Description :


You will play a key role in collaborating with partners and senior client stakeholders to design and implement advanced big data and analytics solutions.


Strong communication, organizational skills, and a problem-solving mindset are essential for this position.


What is in it for you :


- Work alongside a world-class team of business consultants and engineers to solve complex business challenges using data and analytics.


- Accelerate your career in a fast-paced, entrepreneurial work environment.


- Receive an industry leading remuneration package.


Desirable Skills :


- Proficiency in any of the emerging Big Data technologies : Python, Spark, Hadoop, Clojure, Git, SQL, Databricks, and visualization tools like Tableau and Power BI.


- Familiarity with cloud platforms, containerization, and microservice architectures will be a plus.


- Hands-on experience in data modeling, query optimization, and complexity analysis will be preferred.


- Understanding of agile methodologies (e.g., Scrum) and prior experience in agile work environments will be a plus.


- Ability to collaborate with development teams and product owners to gather and interpret requirements.


- Certifications in any of the above-mentioned will be a plus.


Your duties will include :


- Develop data solutions in Big Data environments, particularly on Azure or other cloud platforms.


- Work with diverse datasets to support Data Science and Analytics teams.


- Design and build data architectures using tools such as Azure Data Factory, Databricks, Data Lake, and Synapse.


- Collaborate with the CTO, Product Owners, and Operations teams to develop engineering roadmaps, including upgrades, technical refreshes, and new implementations.


- Perform data mapping activities to define source data, target data, and the necessary transformations.


- Support the Data Analytics team in creating KPIs and reports using tools like Power BI and Tableau.


- Execute data integration, transformation, and modeling tasks.


- Maintain comprehensive documentation and knowledge bases.


- Research and recommend new database products, services, and protocols.


Essential Personal Traits :


- You should be able to work independently and communicate effectively with remote teams.


- Timely communication/escalation of issues/dependencies to higher management.


- Curiosity to learn and apply emerging technologies to solve business problems.


- A strong willingness and eagerness to learn, adapt, and continuously improve by exploring new tools, technologies, and methodologies in the ever-evolving data engineering landscape.


info-icon

Did you find something suspicious?