Arista Networks - Software Engineer - ELT Data Pipelines

Description :

As a Software Engineer, you will be a member of the Wi-Fi Data team, which is a part of the broader Software Engineering team.

With increasing amounts of data being ingested into the cloud, the Wi-Fi Data team will play a crucial role in the success of Arista's Cognitive Wi-Fi solution.

Because this team is small and relatively new, there is a lot of room for growth and making an impact.

As part of the Wi-Fi Data team, you will work closely with the Data Scientists to build and maintain data and AI/ML pipelines that operate at scale. These may include anomaly detection, root cause analysis, automatic remediation and analytics use cases.

You would also work on developing ELT data pipelines for extracting data from multiple Wi-Fi data sources and ingesting them into a data warehouse.

In most cases, you will have to work directly on the product backend to extract the data for further processing.

Apart from these core responsibilities, you will also be developing and owning the CI/CD pipelines for the deployment of your data pipelines.

Depending on the project, you may get a chance to share your work with a larger community through talks and blog posts.

Requirements :

- Bachelor's degree in Computer Science or a related field with 5-10years of work experience.

- Proficient with Python or Go.

- Experience working with databases (Relational and/or NoSQL).

- Hands-on experience with DevOps tools such as Jenkins, Git, Docker, Kubernetes, Ansible, and CI/CD pipelines.

- Experience with data processing libraries, such as Apache Beam and knowledge of data manipulation libraries, such as Pandas (Python), would be a plus.

Education and Certifications :

- Bachelor's degree in Computer Science, Information Systems, or a related technical field

- Certifications in Snowflake, SQL, or cloud platforms (AWS, Azure, GCP) are a plus.

Required Experience :

- 1- 4 years of hands-on experience in data platform support or operations roles

- Working knowledge of Snowflake architecture, query optimization, security model, and platform features.

Essential Skills :

- Proficiency in SQL with the ability to troubleshoot query issues and monitor query performance in Snowflake

- Understanding of Snowflake components such as virtual warehouses, roles, stages, and tasks

- Experience in supporting Snowflake user management, permissions, and role-based access control

- Familiarity with scheduling and orchestration tools (e.g., Airflow, dbt, or native Snowflake tasks)

- Ability to work with data engineers and analysts to resolve data refresh and access-related issues

- Strong verbal and written communication skills for documenting issues and coordinating with global stakeholders

Desired Skills :

- Exposure to cloud platforms such as AWS or Azure, especially in relation to data storage and cost optimization

- Experience with scripting languages like Python or Bash for automating routine tasks

- Knowledge of observability and logging tools (e.g., Datadog, CloudWatch, or Grafana) for monitoring Snowflake usage and performance

- Understanding of data governance practices, including PII handling, audit logs, and data masking

- Awareness of ITIL-based processes (Incident, Change, and Problem Management)

- Foundational understanding of AI-driven automation in IT operations

- Familiar with integrating machine learning models into operational workflows

- Experience in consuming and integrating RESTful APIs for system interactions.

Role & Responsibilities :

Delivery and Execution :

- Monitor Snowflake platform health, including query performance, storage usage, and virtual warehouse efficiency

- Respond to incidents and service requests related to Snowflake access, slow queries, pipeline failures, and data visibility issues

- Perform routine support tasks such as access provisioning, job reruns, and environment syncs in coordination with engineering teams

- Assist in query tuning and collaborate with users to resolve performance bottlenecks or data availability issues

- Track issues through ticketing systems, ensuring accurate status updates, timely closure, and root cause documentation

Support and Enablement :

- Act as the first point of contact for Snowflake-related issues and coordinate with DevOps and platform leads for advanced troubleshooting

- Participate in platform updates, patch rollouts, and maintenance windows as required

- Maintain detailed logs of incidents, configurations, and troubleshooting steps for knowledge reuse

- Engage in support calls, sprint reviews, and operations stand-ups to stay aligned with evolving priorities

yeh dkhna data wala