HamburgerMenu
hirist

Job Description

Job Role : Senior Data Engineer

Experience : 8+yrs


Location : Bengaluru


Notice Period : Max 30days


Key Responsibilities :


- Design, develop, and optimize DBT models for scalable, maintainable data transformations.


- Architect and implement modern ELT pipelines leveraging DBT and orchestration tools such as Apache Airflow or Prefect.


- Lead query optimization and performance tuning for DBT models on Snowflake, Redshift, or Databricks.


- Integrate DBT workflows and pipelines with AWS services (S3, Lambda, Step Functions, RDS, Glue) and event-driven architectures.


- Build robust ingestion processes from diverse sources, including Manufacturing Execution Systems (MES), manufacturing stations, and web applications.


- Manage and monitor orchestration tools to ensure automated, reliable execution of DBT models.


- Implement CI/CD best practices for DBT, including version control, automated testing, and streamlined deployment workflows.


- Troubleshoot and resolve pipeline issues while optimizing for cost and performance.


Required Skill :


- 5+ years of hands-on DBT experience, including model design, testing, and optimization.


- 8+ years of strong SQL experience, with proven skills in query optimization and database performance tuning.


- 5+ years of programming experience, including custom DBT macros, scripting, APIs, and AWS integrations using boto3.


- 3+ years of experience with orchestration tools like Apache Airflow or Prefect.


- Proven experience with cloud data platforms (Snowflake, Redshift, Databricks, or BigQuery).


- Hands-on knowledge of AWS data services (S3, Lambda, Step Functions, RDS, SQS, CloudWatch).


- Familiarity with serverless architectures and infrastructure as code (CloudFormation, Terraform).


- Strong communication skills with the ability to deliver MVPs aligned with sprint timelines.


- Excellent analytical and problem-solving abilities, with a track record of cross-functional collaboration.


info-icon

Did you find something suspicious?