HamburgerMenu
hirist

Data Engineer - Python/PySpark

Circuit Compilers
Hyderabad
2 - 5 Years

Posted on: 13/07/2025

Job Description

Job Description :

- 2 - 5 years of diversified experience in design, development, analysis, testing and implementation of data pipelines using AWS services, Python, Apache Spark, Jupyter Notebook.

- Excellent understanding and hand on experience in AWS Architecture and services; DynamoDB, Lambda, EC2, S3, ELB, EMR, Redshift.

- Extensively worked on AWS Data pipelines using Python and also leveraged python libraries such as numPY and Pandas for data analytics.

- Hands on experience in using data warehousing technologies such as AWS Redshift, Oracle and Teradata.

- Experience working on API development.

- Hands-on experience in Data Visualization tools like Tableau, Power BI.

- Experience in RDBMS like MySQL ,programming languages like Pyspark

- Hands on experience with Python IDE's like Pycharm, Jupyter Notebook.

- Knowledge on GIT processes and UNIX machines.

- Performance Tuning of long running SQL queries and procedures and effectively reduced SLA breaches.

- Worked on scripting with python in spark for transforming the data from various - les like Text - les, CSV and JSON Demonstrated experience in effective decision making within a high-pressure environment.

- Excellent analytical and problem solving skills and ability to quickly learn new technologies

- Good communication and interpersonal skills, team player and can work independently.


info-icon

Did you find something suspicious?