Engineering Manager - Big Data Technologies

Description :

Engineering manager

9+yrs of experience

Pune location

Immediate joinees (Dec joinees )

Engineering Manager :

Lets be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities. With us, you can always bring your full self to work. Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together.

Role & responsibilities :

- Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders

- Design, develop, and maintain highly scalable data processing applications

- Write efficient, reusable and well documented code

- Deliver big data projects using Spark, Scala , Python, SQL

- Maintain and tune existing Spark applications to the fullest.

- Find opportunities for optimizing existing spark applications.

- Work closely with QA, Operations and various teams to deliver error free software on time

- Actively lead / participate daily agile / scrum meetings

- Take responsibility for Apache Spark development and implementation

- Translate complex technical and functional requirements into detailed designs

- Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions

- Serve as a mentor for junior staff members by conducting technical training sessions and reviewing project outputs

Qualifications :

- Engineering graduates in computer science backgrounds preferred with 12+ years of software development experience with Hadoop framework components(HDFS, Spark, Spark, Scala, PySpark)

- Excellent at verbal, written and presentation skills

- Ability to present and defend a solution with technical facts & business proficiency

- Understanding of data-warehousing and data-modeling techniques

- Strong data engineering skills

- Knowledge of Core Java, Linux, SQL, and any scripting language

- At least 6+ years of experience using Python / Scala, Spark, SQL

- Knowledge of shell scripting is a plus

- Knowledge of Core and Advance Java is a plus.

- Experience in developing and tuning spark applications

- Excellent understanding of spark architecture, data frames and tuning spark

- Strong knowledge of database concepts, systems architecture, and data structures is a must

- Process oriented with strong analytical and problem solving skills

- Experience in writing Python standalone applications dealing with PySpark API

- Knowledge of DELTA.IO package is a plus.

Behaviors :

As well as the technical skills, experience and attributes that are required for the role, our shared behaviors sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviors throughout the business within their day-to-day role :

- Stay Curious : Being hungry to learn and grow, always asking the big questions

- Seek Clarity : Embracing complexity to create clarity and inspire action

- Own the Outcome : Being accountable for decisions and taking ownership of our choices

- Center on the Client : Relentlessly adding value for our customers

- Be a Challenger : Never complacent, always striving for continuous improvement

- Champion Inclusivity : Fostering trust in relationships engaging with empathy, respect and integrity

- Commit to each other : Contributing to making Circana a great place to work for everyone