Cloud Engineer

Job Summary :

We are looking for a highly skilled Cloud Engineer with a strong background in real-time and batch data ingestion and data processing, azure products-devops, azure cloud.

The ideal candidate should have a deep understanding of streaming architectures and performance optimization techniques in cloud environments, preferably in subsurface domain.

Key Responsibilities :

- Automation experience essential : Scripting, using PowerShell.

- ARM Templates, using JSON (PowerShell also acceptable).

- Azure DevOps with CI/CD, Site Reliability Engineering.

- Must be able to understand the concept of how the applications function.

- The ability to priorities workload and operate across several initiatives simultaneously.

- Update and maintain the Kappa-Automate database and connectivity with the pi historian and data lake.

- Participate in troubleshooting, performance tuning, and continuous improvement of the Kappa Automate platform.

- Designing and implementing highly configurable Deployment pipelines in Azure.

- Configuring Delta Lake on Azure Databricks.

- Apply performance tuning techniques such as partitioning, caching, and cluster.

- Working on various Azure storage types.

- Work with large volumes of structured and unstructured data, ensuring high availability and performance.

- Collaborate with cross-functional teams (data scientists, analysts, business users).

Qualifications :

- Bachelors or Masters degree in Computer Science, Information Technology, or a related field.

- 8+ years of experience in data engineering or a related role.

- Proven experience with Azure technologies.