Description :

Role : Database Architect

Key Responsibilities :

Architecture & Design :

- Design end-to-end data architecture on AWS (batch + real-time)

- Define data ingestion patterns (Kafka/MSK, Kinesis, APIs)

- Build scalable data lake architecture (S3 + Glue + Lake Formation)

- Design time-series and monitoring systems (InfluxDB / Prometheus / Timestream)

- Create multi-layered architecture :

1. Raw (ingestion)

2. Processed (ETL)

3. Curated (analytics-ready)

Data Engineering & Pipelines :

- Architect and guide implementation of:

1. Streaming pipelines (MSK, Kafka, Telegraf, Flink/Spark Streaming)

2. Batch pipelines (Glue, EMR, Athena)

- Define schema evolution and data contracts

- Optimize data partitioning, compression, and storage formats (Parquet/ORC)

Real-Time Monitoring & Analytics :

- Design real-time device/event monitoring systems

- Integrate :

1. Kafka ? Time-series DB (InfluxDB / Timestream)

2. Prometheus / AMP for alerting

3. Grafana / AMG for visualization

- Define alerting strategies (SNS, Alertmanager)

AWS Services Expertise :

- Architect solutions using :

1. MSK (Kafka)

2. S3 (Data Lake)

3. Glue (ETL & Catalog)

4. Athena / Redshift

5. Lambda / Step Functions

6. Timestream / DynamoDB (as needed)

7. AMP (Managed Prometheus), AMG (Grafana)

8. SNS / SQS / EventBridge

Data Governance & Security :

- Implement :

1. Data encryption (at rest & in transit)

2. IAM-based access control

3. Lake Formation governance

- Define data quality, lineage, and cataloging strategies

Performance & Cost Optimization :

- Optimize :

1. Query performance (Athena/Redshift)

2. Storage cost (S3 lifecycle, compression)

3. Streaming throughput (Kafka partitions, retention)

- Design for high availability and fault tolerance