Senior Data Engineer - Spark/Hadoop

Description :

Job description :

The Sr Data Engineer is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems or building new solutions from ground up. This role will work with developers, architects, product managers and data analysts on data initiatives and ensure optimal data delivery with good performance and uptime metrics.

Your behaviors align strongly with our values because ours do.

Some of What Youll Do :

Scope of the Role :

Direct Reports : This is an individual contributor role with no direct reports

Key Responsibilities :

- Create, enhance, and maintain optimal data pipeline architecture and implementations.

- Analyze data sets to meet functional / non-functional business requirements.

- Identify, design, and implement data process : automating processes, optimizing data

delivery, etc.

- Build infrastructure and tools to increase data ETL velocity.

- Work with data and analytics experts to implement and enhance analytic product features.

- Provide life cycle support the Operations team for existing products, services, and

functionality assigned to the Data Engineering team.

Experience, Education, and Certifications :

- Bachelor s degree in Computer Science, Statistics, Informatics or related field or equivalent work experience.

- 5+ years of Software Development experience, including 3+ years of experience in Data Engineer fields.

Experience in building and optimizing big data pipelines, architectures, and data sets :

- Experience with big data tools : Hadoop, Spark, Kafka, etc.

- Experience with relational SQL databases, such as PostgreSQL, MySQL, etc.

- Experience with stream-processing systems : Flink, KSQL, Spark-Streaming, etc.

- Experience with programming languages, such as Java, Scala, Python, etc.

- Experience with cloud data engineering and development, such as AWS, etc.

Additional Requirements :

- Familiar with Agile software design processes and methodologies.

- Good analytic skills related to working with structured and unstructured datasets.

- Knowledge of message queuing, stream processing and scalable big data stores.

- Ownership/accountability for tasks/projects with on time and quality deliveries.

- Good verbal and written communication skills.

- Teamwork with independent design and development habits.

- Work with a sense of urgency and positive attitude.