Description :

Job Title : Golang Developer

Experience : 5+ Years

Work Type : Remote

Shift : 10:00 AM - 7:00 PM IST

Role Overview :

We are looking for an experienced Golang Developer to design and build a high-throughput microservice responsible for deduplicating IT asset records from multiple discovery platforms such as CrowdStrike, Qualys, AWS, and ServiceNow into trusted golden records.

The system will operate at high scale (10,000+ records per second) while maintaining 99.9% precision in entity resolution. The developer will be responsible for the full backend lifecycle including Pub/Sub consumers, entity matching algorithms, Neo4j graph storage, and GraphQL APIs.

This role operates within a small, senior engineering team with strong ownership, where engineers are responsible for designing, building, and optimizing backend services end-to-end.

Key Responsibilities :

Matching Engine Development :

- Design and implement blocking strategies to efficiently process large volumes of asset records.

- Develop deterministic and probabilistic entity matching algorithms.

Implement string similarity algorithms such as :

1. Levenshtein Distance

2. Jaro-Winkler

3. Soundex

4. N-gram matching

- Build composite scoring systems for entity resolution.

- Implement Union-Find clustering mechanisms to group related asset records.

Golden Record Management :

- Design and implement a survivorship rule engine to determine authoritative attributes for golden records.

- Perform Neo4j graph merges and manage entity relationships.

- Implement provenance tracking to maintain lineage of merged records.

- Build unmerge capabilities to support data correction and rollback of merges.

Stewardship API Development :

- Design and implement GraphQL APIs for manual data stewardship workflows.

- Build GraphQL mutations and queries to support record review processes.

- Implement RBAC-protected operations including merge, reject, and override actions.

- Ensure high API performance with p95 latency under 200ms.

Dual-Database Architecture Implementation :

- Use Neo4j for entity graph storage and relationship management.

- Use PostgreSQL to maintain immutable audit logs and system history.

- Implement reliable transaction handling and ensure data consistency between systems.

Mandatory Technical Skills :

Golang :

- Strong experience with Go (Golang) for backend service development.

Deep understanding of concurrency patterns including :

1. Worker pools

2. Channels

3. Fan-out / Fan-in pipelines

- Experience with performance profiling using pprof.

- Ability to conduct benchmarking and performance optimization for high-throughput systems.

Google Cloud Platform :

- Experience deploying services on Google Kubernetes Engine (GKE).

Strong experience with Google Pub/Sub, including :

1. Pull subscriptions

2. Ordering keys

3. Dead Letter Queues (DLQ)

Graph Database and Modeling :

- Hands-on experience with Neo4j and Cypher query language.

- Ability to design and manage graph-based entity models.

- Experience performing node and relationship CRUD operations.

- Knowledge of Neo4j Go driver usage and transaction management.

GraphQL :

- Experience designing GraphQL schemas and implementing resolvers.

- Hands-on experience with gqlgen in Go.

- Ability to maintain high query performance and low latency APIs.

Security :

- Implementation of TLS 1.2+ encryption.

- Data encryption using AES-256.

- Experience implementing multi-tenant systems using tenant_id scoping.

- Design and implementation of Role-Based Access Control (RBAC).

Testing and Validation :

- Writing table-driven unit tests in Go.

- Experience using Testcontainers for Neo4j and PostgreSQL integration testing.

- Ability to validate entity matching accuracy using precision and recall metrics.

Good to Have Skills :

- Strong experience with PostgreSQL, including JSONB and table partitioning.

- Experience with gRPC and Protocol Buffers.

- Monitoring and observability using Prometheus and Grafana.

- Experience with Kubernetes and Helm.

- Infrastructure provisioning using Terraform.

- Familiarity with string similarity algorithms and data matching techniques.

- Prior experience in Entity Resolution, Master Data Management (MDM), or Data Deduplication systems.

- Exposure to AI-assisted development tools such as Claude or similar systems.

Work Environment :

- Remote working environment.

- Collaboration within a senior engineering team with strong ownership and minimal hierarchy.

- Opportunity to build high-scale distributed systems and complex data resolution platforms.