Prama.ai - Databricks Architect

Position : Databricks Architect

Company Overview :

Prama.ai specializes in AI-powered and Generative AI solutions across Data, Cloud, and APIs, helping businesses build intelligent platforms and scalable AI-driven products.

With 500+ projects delivered globally and 30+ engagements currently in progress, Prama.ai brings deep expertise in Data Engineering, AI/ML, and Advanced Analytics across industries such as SaaS, FinTech, Healthcare, and EdTech. We have also built 6 proprietary products, reflecting our strong product engineering DNA.

Finomics.ai is Prama.ai's in-house financial intelligence and analytics platform, reinforcing our commitment to building practical, real-world solutions that deliver measurable business impact.

Prama.ai is ISO 27001 certified and SOC 2 Type II compliant, demonstrating our strong commitment to security and compliance. We are a trusted partner with AWS, Google Cloud Platform (GCP), Snowflake, and Databricks.

Headquartered in Phoenix, Prama.ai operates globally with offices in the USA (Chandler, AZ), Canada (Toronto), and India (Ahmedabad and Bangalore).

Job Location : Ahmedabad/Bangalore/Remote

Primary Skills : Databricks, GCP, GCP-to-Databricks Migration, Data Architecture, Oracle, MySQL, SQL, Database Modernization

Notice Period : Immediate/2 weeks/1 month

Role Summary :

Prama.ai is looking for a highly capable Databricks Architect to lead enterprise data architecture, database modernization, and cloud migration initiatives for our Enterprise Financial Services client.

The ideal candidate must have strong experience working as a Data Architect or Databricks Architect, with hands-on expertise in migrating data platforms and workloads from Google Cloud Platform (GCP) to Databricks.

The candidate should also have deep knowledge of enterprise databases such as Oracle and MySQL, along with strong architectural and engineering capabilities. This role involves assessing existing data environments, defining migration strategies, designing scalable Databricks architectures, and ensuring successful modernization of legacy database platforms.

A valid Databricks certification is mandatory. We are looking for someone who can independently drive architectural decisions, lead complex migration initiatives, and collaborate with data engineering teams, database administrators, cloud teams, and business stakeholders.

Key Responsibilities :

1. Databricks Architecture and Design

- Design and implement scalable, secure, and high-performance data architectures using Databricks.

- Define data platform architecture, ingestion patterns, transformation frameworks, and storage strategies.

- Establish best practices for data processing, performance optimization, scalability, and cost management.

- Design solutions using Delta Lake, Lakehouse architecture, and Medallion architecture patterns.

- Define standards for data quality, governance, access control, and data lifecycle management.

2. GCP to Databricks Migration :

- Lead the architecture and execution strategy for migrating data platforms, workloads, and pipelines from GCP to Databricks.

- Assess existing GCP data environments, architecture, services, and dependencies to define the migration approach.

- Identify opportunities to modernize existing data pipelines and optimize workloads during migration.

- Design migration strategies covering data ingestion, transformation, storage, orchestration, and integration.

- Define migration roadmaps, architecture standards, validation approaches, and cutover strategies.

- Ensure data consistency, integrity, reconciliation, security, and performance throughout the migration.

- Identify migration risks, dependencies, and technical challenges and recommend appropriate solutions.

3. Database Architecture and Modernization :

- Provide architectural guidance across Oracle, MySQL, and other relational and enterprise database platforms.

- Assess existing database environments and recommend modernization, integration, and migration strategies.

- Design approaches for moving data from legacy databases into Databricks-based data platforms.

- Evaluate database performance, indexing, query execution, schema design, and data access patterns.

- Identify opportunities to improve database reliability, scalability, maintainability, and performance.

- Address data consistency, reconciliation, and validation during migration and integration.

4. Data Engineering and Integration :

- Define scalable data ingestion and transformation pipelines connecting enterprise databases with Databricks.

- Design batch and incremental data processing patterns, including Change Data Capture (CDC), where applicable.

- Work with structured and semi-structured data across different source systems.

- Establish reusable data engineering frameworks and development standards.

- Collaborate with data engineers to implement reliable and maintainable pipelines.

5. Performance Optimization and Cost Management :

- Optimize Databricks workloads, SQL queries, data layouts, and processing strategies.

- Identify and resolve performance bottlenecks across data pipelines and database integrations.

- Establish monitoring and performance measurement practices.

- Optimize compute utilization and platform costs without compromising performance or reliability.

6. Technical Leadership and Collaboration :

- Act as a technical authority for data architecture and database engineering decisions.

- Work closely with data engineers, database administrators, cloud teams, and business stakeholders.

- Review technical designs and ensure alignment with architecture standards and business requirements.

- Evaluate technologies and recommend appropriate solutions based on scalability, performance, security, and cost.

- Mentor engineers and promote engineering best practices.

- Communicate technical decisions, risks, and recommendations clearly to stakeholders.

Required Qualifications - Must-Have Skills

• Proven experience working as a Data Architect, Databricks Architect, or Cloud Data Architect on enterprise-level data architecture projects.
• Mandatory hands-on experience in GCP-to-Databricks migration projects, including architecture design, migration planning, and implementation.
• Databricks certification is mandatory. Candidates must hold a valid, relevant Databricks certification.
• Strong hands-on experience designing and implementing enterprise data architectures using Databricks.
• Deep understanding of GCP data services and their integration or migration to Databricks.
• Strong experience with Oracle and MySQL, including database architecture, schema design, SQL, query optimization, and performance tuning.
• Strong knowledge of relational database concepts, data modeling, indexing, partitioning, and transaction management.
• Experience designing and executing data migration and modernization solutions involving legacy databases and modern data platforms.
• Strong SQL skills and the ability to troubleshoot complex queries and data processing issues.
• Experience designing scalable data ingestion, transformation, and integration pipelines.
• Strong understanding of data warehousing, Lakehouse architecture, and enterprise data engineering principles.
• Ability to independently make architectural decisions and solve complex technical challenges.
• Excellent communication, problem-solving, and stakeholder-management skills.