Persistent Systems - Big Data Architect

Note : Women Candidates Preferred

Job Description :

- Define data retention policies

- Monitor performance and advise any necessary infrastructure changes

- Mentor junior engineers and work with other architects to deliver best in class solutions

- Implement ETL / ELT process and orchestration of data flows

- Recommend and drive adoption of newer tools and techniques from the big data ecosystem

- 10+ years in industry, building and managing big data systems

- Building, monitoring, and optimizing reliable and cost-efficient pipelines for SaaS is a must

- Building stream-processing systems, using solutions such as Storm or Spark-Streaming

- Dealing and integrating with data storage systems like SQL and NoSQL databases, file systems and object storage like s3

- Reporting solutions like Pentaho, PowerBI, Looker including customizations

- Developing high concurrency, high performance applications that are database-intensive and have interactive, browser-based clients

- Working with SaaS based data management products will be an added advantage

- Proficiency and expertise in Cloudera / Hortonworks

- Spark

- HDF and NiFi

- RDBMS, NoSQL like Vertica, Redshift, Data Modelling with physical design and SQL performance

optimization

- Messaging systems, JMS, Active MQ, Rabbit MQ, Kafka

- Big Data technology like Hadoop, Spark, NoSQL based data-warehousing solutions

- Data warehousing, reporting including customization, Hadoop, Spark, Kafka, Core java, Spring/IOC, Design patterns

- Big Data querying tools, such as Pig, Hive, and Impala

- Open-source technologies and databases (SQL & NoSQL)

- Proficient understanding of distributed computing principles

- Ability to solve any ongoing issues with operating the cluster

- Scale data pipelines using open-source components and AWS services

- Cloud (AWS), provisioning, capacity planning and performance analysis at various levels

- Web-based SOA architecture implementation with design pattern experience will be an added advantage

- Competitive salary and benefits package

- Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications

- Opportunity to work with cutting-edge technologies

- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

- Annual health check-ups

- Insurance coverage : group term life , personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents