Azure Databricks Solutions Architect

We are seeking an experienced Azure Databricks Solutions Architect to lead enterprise-scale data architecture, engineering, analytics, and cloud modernization initiatives.

The ideal candidate will bring extensive experience designing enterprise data platforms using Microsoft Azure and Databricks, with strong expertise in Lakehouse architecture, data engineering, data governance, and AI-enabled analytics.

You will work closely with business stakeholders, engineering teams, data specialists, and technology leaders to define end-to-end architecture, drive cloud transformation, and deliver scalable, secure, and high-performance data solutions.

Experience with Databricks Genie, Unity Catalog, Delta Lake, and modern Data Intelligence capabilities is particularly valuable.

Key Responsibilities

• Define and lead end-to-end enterprise data architecture using Microsoft Azure and Databricks.
• Design scalable Lakehouse architectures and modern data platforms using Azure Data Services, Azure Databricks, Delta Lake, and Unity Catalog.
• Architect enterprise data ingestion, integration, ETL/ELT, batch processing, and streaming solutions.
• Design AI-enabled analytics solutions using Databricks Genie, natural language analytics, semantic models, and governed data access.
• Establish enterprise data governance, security, metadata management, data lineage, and observability standards.
• Lead enterprise data platform modernization, cloud migration, and transformation initiatives.
• Define architecture standards, reusable frameworks, reference architectures, and DataOps practices.
• Provide technical leadership throughout solution design, development, testing, migration, deployment, and production readiness.
• Conduct architecture reviews, assess technical risks, and recommend scalable and cost-effective solutions.
• Drive platform performance optimization, reliability, and cloud cost management.
• Collaborate with data engineers, AI specialists, cloud architects, platform teams, and client stakeholders.
• Support client workshops, technical presentations, RFP responses, solutioning, and effort estimation.
• Mentor architects and engineering teams while promoting technical excellence and best practices.

Required Qualifications & Technical Skills

• 14+ years of experience in Enterprise Data Architecture, Data Engineering, Azure Data Platforms, and Cloud Modernization.
• Proven experience designing enterprise-scale solutions using Microsoft Azure and Databricks.
• Strong hands-on expertise in:
• Microsoft Azure Data Services
• Azure Databricks
• Databricks Genie
• Unity Catalog
• Delta Lake
• Python, PySpark, and SQL
• Extensive experience designing and implementing Lakehouse architectures and enterprise data platforms.
• Strong understanding of the Databricks Data Intelligence Platform, including Databricks SQL, Workflows, Lakeflow, MLflow, Serverless, and performance optimization.
• Experience developing AI-enabled analytics solutions using natural language analytics, semantic models, and governed data access.
• Deep understanding of data engineering, including ETL/ELT, batch and streaming integration, APIs, orchestration, and data quality.
• Strong knowledge of enterprise data architecture, data modeling, data products, semantic layers, and master/reference data management.
• Experience implementing enterprise security, governance, and compliance controls, including IAM/RBAC, encryption, privacy, masking, auditing, and data retention.
• Proven experience in architecture definition, HLD/LLD documentation, NFR assessment, migration planning, and technical governance.
• Experience supporting cloud transformation, solution architecture, RFP responses, effort estimation, and client-facing discussions.
• Understanding of BFSI regulatory, security, privacy, resilience, and audit requirements.
• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related discipline.

Preferred Qualifications

• Azure Solutions Architect, Azure Data Engineering, or Databricks certifications.
• Experience with Databricks Genie and AI-powered analytics implementations.
• Knowledge of responsible AI practices and enterprise AI governance.
• Experience with advanced data governance, metadata, lineage, and DataOps frameworks.
• Enterprise Architecture or Data Management certifications.

Leadership & Consulting Expectations

• Strong leadership and stakeholder management capabilities.
• Excellent communication and presentation skills across technical and executive audiences.
• Ability to lead cross-functional and geographically distributed teams.
• Strong consulting mindset with the ability to translate business requirements into technical architectures.
• Experience mentoring architects and engineers and developing technical capabilities.
• Ability to manage project risks, dependencies, escalations, and competing priorities.
• Strong client-facing experience conducting architecture workshops and technical presentations.