Role: Python Developer with Pyspark

Location : Chennai, Hyderabad, Pune, Bangalore, Cochi, Bhubaneshwar

Experience : 5- 10 years

Key Responsibilities :

- 3+ years experience as Python Developer / Designer

- Performance Improvement understanding and able to write effective, scalable code

- Experience in building ETL/ Data Warehouse transformation process.

- Implementing data ingestion pipelines from different types of data sources i.e Databases, S3, Files etc..

- Developing scalable and re-usable, self-service frameworks for data ingestion and processing.

- Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data,

- Processing performance analysis and optimization,

- Experience working with structured and unstructured data security and data protection solutions

- Expertise in at least one popular Python framework (like Django, Flask or Pyramid)

- Knowledge of object-relational mapping (ORM)

- Developing Big Data and non-Big Data cloud-based enterprise solutions in PySpark and SparkSQL and related frameworks/libraries,

- Bringing best practices in following areas :

1. Design & Analysis

2. Automation (Pipelining, IaC)

3. Testing

4. Monitoring

5. Documentation.

Good to have (Knowledge) :

- Experience in cloud-based solutions

- Knowledge of data management principles.

- Familiarity with front-end technologies (like JavaScript and HTML5)