Big Data Analyst - Azure Databricks

Description :

Role & responsibilities :

Big Data Analyst

We are looking for an experienced Big Data Analyst with strong expertise in big data technologies, data engineering, and analytics. The ideal candidate should have hands-on experience in building scalable data solutions using PySpark and Databricks, along with strong visualization and reporting capabilities using Power BI.

Key Responsibilities :

- Design, develop, and optimize large-scale data pipelines and big data solutions.

- Work extensively on PySpark and Databricks for data processing, transformation, and analytics.

- Develop dashboards and business insights using Power BI.

- Build and maintain scalable big data architectures for high-volume data processing.

- Collaborate with business and technical stakeholders to understand analytics requirements.

- Support AI/ML use cases using basic knowledge of TensorFlow and PyTorch.

- Ensure data quality, performance optimization, and governance across platforms.

- Participate in solution design, code reviews, and production support activities.

Mandatory Skills :

- Expert-level experience in PySpark

- Expert-level expertise in Databricks

- Expert-level proficiency in Power BI

- Strong understanding of Spark and Big Data Architecture

- Beginner-level exposure to TensorFlow and PyTorch

Good to Have Skills :

- Java

- Hadoop

- SQL/Scala

- Automotive domain knowledge

Experience :

- 5 to 9 years experience in Big Data, Data Analytics, or Data Engineering roles.

- Experience working with enterprise-scale data platforms and cloud environments is preferred.

Preferred Candidate Profile :

- Strong analytical and problem-solving skills.

- Ability to work in a fast-paced and collaborative environment.

- Excellent communication and stakeholder management skills.

- Experience in handling large datasets and performance tuning.