HamburgerMenu
hirist

Oracle Big Data Service Consultant

Techmynd Consulting
Remote
5 - 7 Years

Posted on: 19/11/2025

Job Description

Description :


Location : Remote

Experience : 5+ Years

BDS Infrastructure Setup, Administration & Performance Tuning


Position Overview :


We are seeking an experienced Oracle Big Data Service (BDS) Specialist to design, implement, and maintain our Oracle BDS infrastructure.


The ideal candidate will have deep expertise in Oracle BDS cluster setup, configuration, administration, and performance optimization, with hands-on experience managing Hadoop ecosystem components within Oracle Cloud Infrastructure (OCI).


Key Responsibilities :


Oracle BDS Cluster Setup & Configuration :


- Design and deploy Oracle BDS clusters on Oracle Cloud Infrastructure (OCI)

- Configure BDS cluster topologies including HA and non-HA setups

- Set up and configure cluster nodes (master, utility, worker, edge nodes)

- Implement cluster security including Kerberos authentication and Ranger policies

- Configure network settings, VCN integration, and security lists

- Set up cluster auto-scaling policies and node management

- Integrate BDS with OCI Object Storage and other OCI services


BDS Administration & Maintenance :


- Perform day-to-day administration of Oracle BDS clusters

- Manage cluster lifecycle operations : patching, upgrades, and node operations

- Monitor cluster health, resource utilization, and service availability

- Configure and maintain Hadoop ecosystem services (HDFS, YARN, Hive, Spark, HBase, Kafka)

- Implement backup and disaster recovery strategies for BDS

- Manage user access, authentication, and authorization using Ranger

- Troubleshoot cluster issues and service failures

- Perform cluster capacity planning and scaling operations


Performance Tuning & Optimization :


- Analyze and optimize BDS cluster performance for data processing workloads

- Tune HDFS configurations for optimal storage performance

- Optimize YARN resource allocation and job scheduling

- Tune Spark job configurations and executor settings

- Optimize Hive query performance and metastore operations

- Monitor and optimize data ingestion and ETL pipeline performance

- Implement compression strategies and file format optimizations

- Identify and resolve bottlenecks in data processing workflows

- Optimize network throughput and disk I/O performance


Integration & Data Pipeline Support :


- Integrate BDS with Apache Airflow for workflow orchestration

- Configure connectivity between BDS and Oracle databases

- Set up data ingestion pipelines using Sqoop, Spark, and Kafka

- Configure BDS integration with Object Storage for data lake architecture

- Support ETL/ELT workflows running on BDS infrastructure

- Implement monitoring and alerting for data pipelines on BDS


info-icon

Did you find something suspicious?