Job Description :

- PySpark and Advanced SQL is a must.

- We are looking for a Data Engineer with excellent SQL skills and advanced Python and PySpark along with other required skillsets.

- 5 - 7 years of experience as a Data Engineer with extensive working experience using PySpark, Advanced SQL, Snowflake, complex understanding of SQL and Skills, Spark, Snowflake, Glue and Airflow.

- AWS expertise including Lambda, Glue, S3 etc.

- Experience in working with Snowflake and understanding of Snowflake architecture along with concepts like internal, external tables, stages, masking policies etc.

- Experienced on Big Data platforms.

- Used SQL, PL/SQL and similar languages, and UNIX shell scripting.

- Experienced with data modeling, design patterns, and building highly scalable and secured solutions.

- Knowledge of agile software development process and familiarity with performance metric tools.

- Experience working with JSON, yaml, parquet, xml etc.

- Data Governance (Knowledge about meta data management, data catalog/access).

- Experience in software development, CI/CD, and Agile methodology.

- Event based and real time data streaming using Kafka.

- Hands-on experience with AI-assisted development tools (e.g., Cursor, Claude, GitHub Copilot) for spec-driven development, code generation, debugging, SQL optimization, code reviews, and validating AI-generated code.