We are looking for Senior Data Engineer

Overview :

We are seeking a talented Senior Data Engineer specializing in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimizing Starburst installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis.

Responsibilities :

- Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations, overseeing environment setup, configuration, maintenance, upgrades, and ensuring optimal performance.

- Configure various server and application settings and parameters.

- Integrate Starburst with various data sources to create a unified data platform.

- Design and tune the container solution for performance and scalability.

- Set up and configure data catalogs in various modes.

- Implement robust security controls for data access, ensure compliance with data regulations, and manage potential vulnerabilities.

- Coordinate with various support partners and vendor teams.

- Troubleshoot and investigate server related issues and provide root cause analysis for incidents.

- Perform daily server administration and monitoring, and leverage automation (such as Ansible) for efficient maintenance.

- Plan and execute disaster recovery testing.

- Create documentation and provide training on Starburst administration and best practices.

Qualifications :

Required Skills & Experience :

- Bachelor's degree in Computer Science, Information Systems, Data Science, Engineering or related field (or equivalent work experience).

- Proven experience with Trino/Starburst Enterprise/Galaxy administration / CLI.

- Implementation experience with container orchestration solutions (Kubernetes/OpenShift).

- Knowledge of Big Data (Hadoop/Hive/Spark) and Cloud technologies (AWS, Azure, GCP).

- Understanding of distributed system architecture, high availability, scalability, and fault tolerance.

- Familiarity with security authentication systems such as LDAP, Active Directory, OAuth2, Kerberos.

- Excellent Unix/Linux skills.

- Familiarity with JDBC / ODBC

Preferred Skills :

- Certification: Starburst Certified Practitioner.

- Experience Python and/or Java programming.

- Proficient with infrastructure automation tools such as Ansible.

- Knowledge of data requirements for AI and machine learning workloads.

- Familiarity with Data Federation and Cached Services

- Familiarity with Data pipeline (Series of steps that move and transform data from one source to another for analyses and storage)

- Experience with Dell Data Lakehouse administration.

- Experience in Demand Driven Adaptive Enterprise (DDAE) administration

Working Conditions :

- This position may require evening and weekend work for time-sensitive project implementations.