Description :

We are looking for a highly skilled Big Data Analyst with strong expertise in PySpark, Databricks, and Power BI to design, develop, and optimize scalable big data solutions.

The ideal candidate should have hands-on experience in processing large-scale datasets, building analytical pipelines, and delivering business insights through interactive dashboards and advanced analytics.

The role requires strong analytical thinking, data engineering capabilities, and an understanding of modern big data architectures within enterprise environments, preferably in the automotive domain.

Key Responsibilities :

Big Data Engineering & Analytics :

- Design, develop, and maintain scalable big data processing pipelines using PySpark.

- Build and optimize data workflows on the Databricks platform.

- Process and analyze structured and unstructured datasets from multiple data sources.

- Perform data cleansing, transformation, validation, and aggregation for analytics use cases.

- Develop reusable ETL/ELT frameworks and data ingestion pipelines.

- Optimize Spark jobs for performance, scalability, and cost efficiency.

Dashboarding & Reporting :

- Create interactive dashboards and business reports using Power BI.

- Translate business requirements into meaningful visualizations and analytical reports.

- Build KPI tracking dashboards for operational and management reporting.

- Ensure data accuracy, consistency, and governance across reporting solutions.

Big Data Architecture :

- Understand and contribute to enterprise big data architecture and distributed computing environments.

- Work with large-scale datasets using Spark ecosystem technologies.

- Support cloud-based or distributed analytics solutions.

AI/ML Support :

- Collaborate with data science teams for ML model integration and data preparation.

- Assist in implementing basic workflows using TensorFlow and PyTorch.

- Support model training data pipelines and inference workflows.

Collaboration & Stakeholder Management :

- Work closely with business analysts, data engineers, and cross-functional teams.

- Participate in requirement gathering, technical discussions, and solution reviews.

- Provide technical guidance and support to junior team members.

Mandatory Skills :

Expert Level :

- PySpark

- Databricks

- Power BI

- Analytics and digital engineering solutions.