Big Data Engineer - Spark/Hadoop

EXP - 5 TO 8 years

Job Description :

- 3+ years of experience in Data abbreviation, standardization, linking, rebooting

- 3+ years of experience in Bigdata technologies like Spark, and Hadoop.

- 3+ years of experience in RDBMS

- Good understanding of Linux environment (shell scripting) - Knowledge

- Understanding of data-warehousing and data-modeling techniques

- Knowledge of industry-wide visualization and analytics tools

Location - Hyderabad

Responsibilities :

- Develop and maintain data pipelines using ETL processes

- Take responsibility for Apache Hadoop development and implementation

- Work closely with data science team to implement data analytics pipelines

- Help define data governance policies and support data-versioning processes

- Maintain security and data privacy, working closely with data protection officer

- Analyze vast number of data stores to uncover insights