Databricks & Fivetran Support Engineer

Experience: 4 - 6 Years

Skills: Databricks, Fivetran Data Engineering Platform

Job Summary:

We are looking for a Data Engineering Support Engineer with hands-on experience in Databricks, Apache Spark, Fivetran, SQL, and data observability to monitor, troubleshoot, and support data platforms in production environments.

Must-Have Skills:

- Databricks workspace, cluster, job & notebook monitoring

- Apache Spark troubleshooting and performance optimization

- Hands-on Fivetran pipeline monitoring & troubleshooting

- Acceldata or similar data observability tools

- Strong SQL querying and troubleshooting

- ETL/ELT concepts

- AWS cloud platform knowledge

- Data Warehousing concepts

- Monitoring tools: Datadog, Splunk, Prometheus, or Grafana

Key Responsibilities:

- Monitor and support Databricks workspaces, clusters, jobs, and notebooks.

- Troubleshoot Spark job failures, performance bottlenecks, and data processing issues.

- Monitor cluster utilization and optimize performance.

- Monitor and troubleshoot Fivetran data pipelines.

- Perform Root Cause Analysis (RCA) for production incidents.

- Use observability and monitoring tools to identify and resolve data platform issues.

- Support production operations and ensure platform stability.

Preferred:

- Experience with Acceldata Observability and AWS-based data platforms.