Accion Labs - ELK Developer

Description :

We are looking for an experienced ELK SME to join our Data Engineering team and take ownership of the Elastic platform supporting log ingestion, observability, monitoring, alerting, reporting, platform operations and operational analytics. This is a hands-on engineering role for someone who can independently drive ELK architecture, platform administration, ingestion engineering, deployment, migration, troubleshooting, performance tuning and production support across multiple business critical use cases.

The ideal candidate will bring strong expertise in Elasticsearch, Logstash, Kibana, AWS integrations and OpenShift-based ELK environments along with sound engineering discipline, operational ownership and the ability to work closely with cross-functional teams. Hands-on experience with the latest Elastic Stack 9.3.1 and the ability to support periodic version upgrades and migration efforts will be highly valued.

Key Responsibilities :

- Own and manage the ELK platform across development, test and production environments

- Design, build, enhance and troubleshoot Logstash pipelines for ingestion, parsing, enrichment, filtering, routing and indexing of structured and unstructured data

- Build and support integrations between ELK and enterprise or cloud data sources including AWS services, HTTP endpoints, event-driven sources and agent-based ingestion frameworks

- Administer and optimise Elasticsearch clusters including index design, mappings, templates, component templates, lifecycle controls, data quality checks, storage planning and search performance

- Support and administer Kibana for data views, saved objects, dashboards, reporting, alerting, monitoring visibility, role-based access, spaces and platform usability

- Lead and support ELK deployment, migration, upgrade, version uplift and cutover activities including validation and post-deployment monitoring

- Manage and support OpenShift-hosted ELK / ECK deployments including operational stability, resilience and recovery readiness

- Implement and maintain stack monitoring, operational dashboards and alerting for Elasticsearch, Logstash, Kibana, Elastic Agent and related ingestion components

- Investigate and resolve ingestion failures, mapping conflicts, schema drift, missing data, continuity issues, cluster health problems and production incidents

- Support security, authentication, access control, SSL/TLS and role and permission configuration across the ELK ecosystem

- Drive backup, recovery, disaster recovery validation and platform readiness activities

- Work closely with analytics, engineering, infrastructure and business stakeholders to ensure data availability, reliability and usability for dashboards, reporting and downstream use cases

- Maintain technical documentation, operational runbooks, standard operating procedures and knowledge transfer artefacts for platform continuity and support readiness

- Follow disciplined DevOps and release practices for ELK configurations, pipelines, templates, dashboards and platform changes through version-controlled workflows

Required Skills and Qualifications :

- 5 to 8 years of overall experience with strong hands-on experience in ELK / Elastic Stack engineering and administration

- Deep expertise in Elasticsearch, Logstash and Kibana with strong experience in Logstash pipeline development and troubleshooting

- Strong understanding of ELK architecture, deployment models, platform design and production operations

- Proven experience in ELK deployment, migration, upgrade, version uplift and production support in enterprise environments

- Hands-on experience with current Elastic Stack releases including version 9.3.1

- Experience working with both on-premises and cloud-based ELK environments

- Strong working knowledge of AWS especially services commonly integrated with ELK for ingestion, infrastructure and platform operations

- Strong experience with OpenShift and ELK deployments running on containerised platforms

- Good understanding of Docker and working knowledge of Kubernetes / OpenShift concepts

- Strong knowledge of monitoring, alerting, backup and recovery, access control and platform operations in ELK environments

- Experience with Elastic Agent, Beats, stack monitoring, Kibana alerting, reporting, saved object management, Kibana spaces, roles, role mappings and RBAC

- Strong troubleshooting skills across platform, pipeline, indexing, visualisation and operational issues

- Working knowledge of Python for scripting, automation and ELK-related engineering tasks

- Good understanding of DevOps practices, deployment discipline and operational support models

- Hands-on experience with Git-based version control preferably GitHub for managing pipeline code, configuration changes, templates and deployment artefacts

- Strong communication and stakeholder management skills with the ability to work independently and collaborate effectively across teams

Preferred Skills :

- Experience with Infrastructure as Code and environment provisioning practices

- Exposure to Terraform or similar infrastructure automation tools

- Exposure to Ansible or equivalent automation tooling

- Experience with SSO / SAML / ADFS / external identity integration for ELK platform access management

- Experience with ILM, snapshot and restore strategies and upgrade planning

- Exposure to performance optimisation, capacity planning and storage management for Elastic environments

- Experience in enterprise observability, centralised logging, operational analytics or platform support roles

Candidate Profile :

- Strong independent contributor and team player who can function as the primary ELK Subject Matter Expert for the team

- Able to take ownership from problem identification through root-cause analysis, solution design, implementation, validation and documentation

- Comfortable balancing platform engineering, migration work, production support and stakeholder collaboration

- Able to work effectively with analytics teams, dashboard users, architects, infrastructure teams and business stakeholders

- Must be willing to work from office