Vsquare Systems - Data Engineer - ETL

Description :

Vsquare Systems Pvt Ltd is on the lookout for talented Data Engineers with 2 to 5 years of hands-on experience in Databricks Development to join our dynamic team.

If you are passionate about data engineering and thrive in a collaborative environment, this role based in Bengaluru/Pune could be your next career move.

As a Databricks Developer at Vsquare Systems, your primary responsibility will involve designing, developing, and maintaining ETL processes to efficiently load data into our data lake and data warehouse.

Working closely with data engineers, data scientists, and BI teams, you will play a crucial role in optimizing data workflows to meet analytical and reporting needs.

Key Responsibilities :

- Design and implement ETL processes using Databricks PySpark

- Construct data pipelines adhering to the Medallion Architecture (Bronze, Silver, Gold layers)

- Develop and enhance advanced data pipelines utilizing Databricks workflows

- Craft and fine-tune intricate SQL queries for in-depth analysis

- Collaborate across teams to deliver effective data solutions

- Establish monitoring, error handling, and documentation for ETL processes

Required Qualifications :

- 3+ years of hands-on experience in Databricks PySpark development

- Proficiency in Python programming and debugging

- Expertise in Spark SQL, DataFrames, RDDs, and Spark architecture

- Strong skills in SQL query optimization

- Experience in large-scale data warehousing and ETL frameworks

- Strong problem-solving and team collaboration abilities

Preferred Skills :

- Familiarity with cloud platforms (AWS preferred)

- Exposure to Snowflake, Tableau, or similar data tools

- Understanding of data governance and data quality principles

- Relevant Databricks or Spark certifications