Senior Consultant - ElasticSearch

Description :

Key Responsibilities :

Architecture & Deployment :

- Design and implement highly available and scalable Elasticsearch clusters.

- Conduct architecture reviews, capacity planning, and performance optimization.

- Ensure robust security configurations, including access controls and encryption.

Data Migration :

- Develop and execute data migration strategies, including snapshot and restore mechanisms.

- Ensure seamless data movement across multiple clusters while maintaining data integrity.

Observability & Monitoring :

- Set up log collection pipelines using Beats and Logstash, normalizing data to Elastic Common Schema (ECS).

- Deploy and configure uptime monitoring (Heartbeat), APM agents for Java applications, and synthetic monitoring.

- Define ILM policies for optimized data retention and management.

Custom Integrations & Security :

- Implement and configure third-party integrations with Elasticsearch.

- Develop custom parsers and ingestion pipelines for structured and unstructured data.

- Enforce role-based access control (RBAC) and security best practices.

Dashboards & Alerting :

- Develop custom Kibana dashboards for monitoring system health and business metrics.

- Implement 20+ detection rules and alerts for proactive system monitoring.

- Work closely with stakeholders to define observability use cases and data visualizations.

Requirements :

- 5 to 8 years of experience in Elasticsearch, Observability, or Cloud Data Engineering.

- Excellent communication skills are mandatory for effective client interactions and solution presentations.

- Strong expertise in Elasticsearch, Logstash, Kibana, and Beats.

- Experience in Elastic Security, ILM, and data migration strategies.

- Proficiency in cloud platforms (AWS, GCP, or Azure) and Kubernetes.

- Hands-on experience in log collection, normalization, and custom pipeline development.

- Strong knowledge of Linux environments, scripting, and automation.

- Excellent problem-solving skills and ability to work in a client-facing role.