Title: Senior Data Engineer

Experience : 6-7 years

Location : Remote

About the Role :

Data Pipeline Design & Development :

- Architect and implement scalable data pipelines, ETL processes, and data models to support analytics and business intelligence.

- Build and optimize data architectures for data collection, processing, and storage.

Data Integrity and Compliance :

- Ensure data accuracy, availability, and consistency across all platforms.

- Maintain data privacy and compliance with industry standards.

Real-Time Analytics :

- Work on real-time data processing for faster insights and decision-making.

Collaboration:

- Work closely with Data Scientists, Product Managers, and Engineering teams to understand business needs and deliver robust data solutions.

Automation and Optimization :

- Develop scripts and automation for data ingestion and transformation to streamline workflows.

- Monitor data pipeline performance and implement optimizations for reliability and efficiency.

Requirements :

Experience & Background :

- 6-7 years of experience in Data Engineering or related roles, preferably in a startup environment.

- Proven experience building and scaling data pipelines and ETL processes from the ground up.

- Hands-on expertise with cloud platforms (AWS, GCP, or Azure).

- Strong expertise in SQL, Python, and big data technologies (Spark, Kafka, Hadoop).

- Hands-on experience with data warehousing solutions (Redshift, BigQuery, Snowflake).

- Solid understanding of API integrations, data streaming, and distributed systems.

- Familiarity with CI/CD pipelines and version control (Git).

Preferred Skills :

- Experience with real-time analytics and event-driven architectures.

- Background in Machine Learning pipelines is a plus.

- Exposure to compliance frameworks.

Personal Attributes :

- Self-starter with a proactive approach to problem-solving.

- Strong communicator, capable of presenting insights to both technical and non-technical stakeholders.

- Detail-oriented, organized, and adaptable with a growth mindset that embraces continuous learning and iteration.