Profile: Data Engineer with AI

Location: Chennai

Experience: 5 - 9 Years

Must Have Skillset:

- Data Engineer with Python and GCP

- SQL (4+ Years)

- Python or PySpark (4+ Years)

- GCP services (3+ Years)

- BigQuery

- Dataflow or Dataproc

- Pub/Sub

- Scheduled Query

- Cloud Functions

- Monitoring Tools Dashboard

- Apache Kafka

- Terraform scripting (2+ Year)

- Airflow/Astronomer/Cloud Composer (2+ Year)

Good to have Skillset:

- Data fusion

- Tekton pipeline/CI-CD Pipeline

- Cloud Secrete Manager

Soft Skills:

- Strong all-round communication skills (written / presentation, one-to-one / group) and Excellent analytical, problem-solving and communication skills

Additional Notes:

- When hiring for a Data Engineer with GCP experience, it is important to look for candidates with a strong understanding of both data warehousing and data processing technologies.

Good to have:

- The exposure to translate business problems into data/ML solutions and advanced analytics

- Good Knowledge in Prompt Engineering, Gen AI, LLM, Agentic AI frameworks such as Lang graph, Crew AI or OpenAI SDK or Google ADK