Data Engineer - ETL/ELT Pipelines

Description :

This job description template is tailored for a Data Engineer with 4+ years of experience, emphasizing the balance between core engineering, cloud infrastructure, and collaborative problem-solving.

Position Overview :

Responsibilities :

- Manage and evolve data warehouse solutions and database architectures, ensuring performance, reliability, and security.

- Collaborate with data scientists, analysts, and product teams to translate business requirements into efficient data engineering solutions.

- Implement data quality frameworks, monitoring systems, and automated testing to ensure data accuracy and reliability.

- Drive process improvements by automating repetitive manual tasks and refining infrastructure deployment workflows.

- Stay updated on emerging technologies, evaluate new tools, and mentor junior team members on engineering best practices.

Technical Requirements :

- Strong proficiency in Python or Java for data processing and scripting.

- Expert-level SQL skills for complex querying, database design, and query optimization.

- Hands-on experience with cloud platforms (AWS, GCP, or Azure) and their native data services.

- Familiarity with distributed computing and big data frameworks (e.g., Apache Spark, Kafka).

- Experience in designing dimensional data models and working with both relational and NoSQL databases.

- Understanding of DevOps fundamentals, including CI/CD pipelines and containerization (Docker, Kubernetes).