Azure Databricks Architect

@ Tredence Inc.

Toutes ses offres

Canada

Temps plein

Postuler

SIGNAUX

En bref

Tredence Inc. is hiring an Azure Databricks Architect to lead the design, implementation and scaling of its enterprise data and AI platform. The role covers Lakehouse architecture on Azure Databricks and Delta Lake, Unity Catalog governance and security, and Spark performance and cost optimization.

Responsabilités :

Design enterprise Lakehouse architectures on Azure Databricks and Delta Lake
Manage Unity Catalog governance, access controls and auditing
Lead Spark performance tuning and cloud cost optimization
Integrate Databricks with the Azure ecosystem

Résumé des exigences :

Experience designing Azure Databricks and Delta Lake platforms
Hands-on Unity Catalog and data governance experience
Expertise in Spark optimization and cluster configuration
Knowledge of Azure data services and security

Outils et compétences

Azure Databricks Delta Lake Unity Catalog Azure Data Lake Storage Gen2 Azure Data Factory Microsoft Entra ID Azure Monitor

Source et dates

Type de source non vérifié · apify-linkedin

Date publiée par l’employeur: 2026-11-01
Première détection par notre source: 2026-11-10
Mise à jour du dossier source: 2026-11-10

Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.

Détails du poste

Niveau	Senior
Domaine	Développement logiciel
Heures par semaine	40 (estimé)
Milieu de travail	Bureau
Position	Surtout assis
Exigences physiques	physique faible · ordinateur élevé

Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.

Postuler

Tredence Inc.

Toutes ses offres

Champ	Valeur
Offres sur Jobsy	1

Description

We are seeking an experienced and visionary Azure Databricks Architect to lead the design, implementation, and scaling of our enterprise data and AI platform. In this role, you will define the core architecture for our Lakehouse environment, champion governance standards using Databricks Unity Catalog, and spearhead end-to-end performance tuning and cost optimization initiatives. You will work closely with data engineering teams, cloud infrastructure teams, security officers, and business stakeholders to deliver a robust, secure, and high-performance data ecosystem.

Key Responsibilities

1. Lakehouse Architecture & Design

Design and implement enterprise-grade Lakehouse architectures using Azure Databricks and Delta Lake, following Medallion Architecture (Bronze, Silver, Gold layers).
Architect secure, scalable, and highly available cloud data pipelines supporting batch and real-time streaming workloads.
Integrate Azure Databricks seamlessly with the broader Azure ecosystem (e.g., Azure Data Lake Storage Gen2, Azure Data Factory, Microsoft Entra ID, and Azure Monitor).

2. Data Governance & Security (Unity Catalog)

Design, deploy, and manage Databricks Unity Catalog for centralized metadata management, data discovery, and lineage tracking across multi-workspace environments.
Implement fine-grained access controls (RBAC/ABAC), row-level security (RLS), and column-level masking (CLM) to protect sensitive assets (PII/PHI).
Establish auditing procedures, data sharing frameworks, and compliance guardrails using Unity Catalog audit logs.

3. Performance Tuning & Cost Optimization

Drive Databricks and Spark optimization strategies, including managing shuffle partitions, resolving data skew, tuning cache, and applying Adaptive Query Execution (AQE).
Implement layout strategies such as Z-ordering, data compaction (OPTIMIZE), and vacuum scheduling to curtail I/O overhead and boost query performance.
Optimize cluster configurations, autoscaling parameters, spot instances, and serverless compute pools to maximize cost efficiency without compromising SLAs