OCI AIDP Engineer

We are looking for a highly skilled OCI AIDP Engineer to design, build, and manage scalable AI/ML data platforms on Oracle Cloud Infrastructure. This role focuses on creating robust data pipelines, deploying machine learning models, and enabling enterprise-grade AI solutions using OCIs native services.

Key Responsibilities :

AI Data Pipeline Engineering :

- Design and implement scalable, high-performance data pipelines using OCI services such as :

1. Object Storage (data lake architecture)

2. Data Flow (Apache Spark-based processing)

3. OCI Data Science

- Build ingestion pipelines for :

1. Structured data (databases, ERP systems)

2. Unstructured data (documents, logs, media files)

- Ensure pipelines are resilient, reusable, and optimized for large-scale data processing

Machine Learning Development & Deployment :

- Build, train, and deploy machine learning models using OCI AI/ML services

- Work across ML lifecycle :

1. Data preparation

2. Feature engineering

3. Model training and validation

4. Deployment and inference

- Implement model versioning, monitoring, and lifecycle management

- Support use cases like :

1. Predictive analytics

2. Forecasting

3. Classification and anomaly detection

Data Transformation & Workflow Orchestration :

- Develop ETL/ELT workflows using Python, SQL, and Spark

- Orchestrate pipelines with scheduling tools and event-driven triggers

- Manage schema evolution, metadata, and data lineage

- Ensure high data quality and consistency across systems

Integration with Enterprise Systems :

- Integrate AI/ML solutions with enterprise applications using :

1. REST APIs

2. Event-driven architectures

- Connect with systems such as ERP, CRM, and external data sources

- Enable seamless data exchange between OCI services and business platforms

Performance Optimization & Cost Management :

- Optimize pipelines and models for :

1. Performance (latency, throughput)

2. Scalability (large data volumes)

3. Cost efficiency (OCI resource utilization)

- Tune Spark jobs, storage strategies, and compute resources

Data Governance, Security & Compliance :

- Implement enterprise-grade data governance frameworks

- Ensure :

1. Data security (encryption, IAM policies)

2. Compliance with regulatory standards

- Apply best practices in :

1. Role-based access control (RBAC)

2. Secure API integrations

Monitoring, Troubleshooting & Maintenance :

- Monitor production pipelines and ML models for :

1. Failures and performance issues

2. Data drift and model degradation

- Troubleshoot and resolve incidents quickly

- Maintain high availability and reliability of AI platforms

Business Collaboration & Solutioning :

- Work closely with business stakeholders to :

1. Understand requirements

2. Translate them into AI-driven solutions

- Communicate insights, model outcomes, and technical designs effectively

- Support decision-making with data-driven approaches

Required Skills & Experience :

Must-Have Skills :

- Strong experience with OCI (Oracle Cloud Infrastructure)

- Hands-on expertise in :

1. Object Storage

2. Data Flow (Apache Spark)

3. OCI Data Science

- Strong programming skills in :

1. Python

2. SQL

- Experience building end-to-end ML pipelines

- Knowledge of :

1. Data engineering (ETL/ELT)

2. Machine learning algorithms

- Experience with :

1. REST APIs and integrations

- Understanding of :

1. Data governance, security, and compliance

Good-to-Have Skills :

- Experience with :

1. Generative AI / NLP use cases

- Knowledge of :

1. Containerization (Docker, Kubernetes)

2. CI/CD pipelines

- Exposure to :

1. Multi-cloud environments (AWS, Azure, GCP)