Pauls Techno Crafts Pvt Ltd is a leading technology solutions provider specializing in data engineering and analytics services. We empower businesses across various industries, including finance, healthcare, and e-commerce, to unlock the full potential of their data. Our expertise lies in building robust and scalable data pipelines, enabling data-driven decision-making and driving business growth. We operate on a national scale, serving a diverse clientele with cutting-edge data solutions.

Role Overview:

As a Data Engineer at Pauls Techno Crafts, you will be instrumental in designing, developing, and maintaining our data infrastructure. You will collaborate closely with data scientists, analysts, and business stakeholders to understand data requirements and build efficient ETL pipelines. Your work will directly impact the quality and accessibility of data, enabling better insights and informed business strategies.

Key Responsibilities:

- Design and implement scalable and reliable ETL pipelines to ingest, transform, and load data from various sources into our data warehouse.

- Develop and maintain data models and schemas to ensure data consistency and integrity.

- Optimize data pipelines for performance and efficiency to meet the growing demands of our business.

- Collaborate with data scientists and analysts to understand their data needs and provide them with the necessary data infrastructure and tools.

- Implement data quality checks and monitoring to ensure data accuracy and reliability.

- Troubleshoot and resolve data-related issues to minimize disruption to business operations.

- Stay up-to-date with the latest data engineering technologies and trends to continuously improve our data infrastructure.

- Contribute to the development of data governance policies and procedures to ensure data security and compliance.

Required Skillset:

- Demonstrated expertise in designing and implementing ETL processes using tools like Apache Airflow or similar orchestration tools.

- Proficient in writing complex SQL queries for data extraction, transformation, and loading.

- Strong programming skills in Python, with experience in data manipulation libraries like Pandas and NumPy.

- Hands-on experience with cloud platforms such as AWS (e.g., S3, EC2, Lambda, Glue, Redshift) or Azure (e.g., Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure Synapse Analytics).

- In-depth knowledge of Azure Databricks and PySpark for large-scale data processing.

- Ability to work independently and collaboratively in a fast-paced environment.

- Excellent communication and interpersonal skills to effectively interact with stakeholders.

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Adaptable to work in a remote or hybrid work environment.