AWS Data Engineer - Azure Databricks

Client : Disney

Job Title : AWS Data Engineer (Databricks Focus)

Location : Hyderabad

Type : Full-Time with Info Services

Position Overview :

We are looking for an AWS Data Engineer with strong Databricks and PySpark experience to help design, develop, and optimize scalable data pipelines. The role requires a strong blend of data engineering expertise, AWS development experience, and a proactive mindset to innovate and lead technical efforts across the stack.

Key Responsibilities :

- 10+ years of total work experience is required.

- Develop and optimize data pipelines using Databricks (PySpark).

- Implement AWS AppSync and Lambda-based APIs for integration with Neptune and OpenSearch.

- Collaborate with React developers (AWS CloudFront) and backend teams to enhance architecture.

- Ensure secure development practices, especially around IAM roles and AWS security.

- Drive performance, scalability, and reliability improvements across the data ecosystem.

- Take full ownership of assigned tasks and deliverables.

Required Skills :

- Strong experience in Databricks and PySpark for building data pipelines.

- Proficient with AWS Neptune and OpenSearch.

- Hands-on experience with AWS AppSync and Lambda functions.

- Solid grasp of IAM, CloudFront, and API development in AWS.

- Familiarity with React.js front-end applications (a plus).

- Strong problem-solving, debugging, and communication skills.

- Ability to work independently and drive innovation.

Preferred Qualifications :

- Production experience with graph databases and search platforms.