Connexion Inscription gratuite
Postuler

Publié il y a 2 mois

Principal Data Engineer – Databricks

@ Staffmax

Toutes ses offres Site Web

Toronto, Ontario

Temporaire12+ ans d’expérience
Postuler
SIGNAUX

En bref

Staffmax is hiring a Principal Data Engineer on a temporary basis in Toronto, onsite with 4 days in office. The role leads Cloudera-to-Databricks modernization, Lakehouse architecture and finance/risk data platforms for enterprise reporting. The posting states a salary of $150K–$180K and 12–18 years of experience.

Responsabilités :

  • Lead Cloudera-to-Databricks modernization initiatives
  • Design Lakehouse and Medallion Architecture pipelines
  • Refactor Hive/Impala logic into PySpark and Spark SQL
  • Build finance and risk data models and reporting layers
  • Govern data quality, lineage and security controls

Résumé des exigences :

  • 12–18 years of data engineering experience
  • 8+ years with enterprise Data Warehouse and Data Lake platforms
  • 5+ years of hands-on Databricks and Spark at scale
  • Experience with AWS or Azure and CI/CD tooling
  • Technical leadership and mentoring of senior engineers

Outils et compétences

DatabricksClouderaHiveImpalaHBaseAirflowdbtTerraformJenkins
Source et dates

Site carrière / système de candidatures · careerpage

Date publiée par l’employeur
2026-08-28
Première détection par notre source
2026-10-11
Mise à jour du dossier source
2026-10-11

Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.

Détails du poste

NiveauChef d’équipe
DomaineDonnées et analytique
Expérience12 an(s) et plus
Déplacementsavion : aucun · route : aucun
Milieu de travailBureau
PositionSurtout assis
Exigences physiquesphysique faible · ordinateur élevé
LanguesEnglish

Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.

Postuler
ChampValeur
Offres sur Jobsy150
Description

Location: Toronto, ON
Work Arrangement: Onsite / 4 Days in Office
Salary: $150K–$180K
Experience: 12–18 Years

We are looking for a Principal Data Engineer – Databricks to lead enterprise-scale data modernization initiatives, with a strong focus on Cloudera-to-Databricks migration, Lakehouse architecture, finance/risk data, and large-scale data engineering.

Key Responsibilities & Requirements

  • 12–18 years of overall data engineering experience.
  • 8+ years of experience with enterprise Data Warehouse and Data Lake platforms.
  • 5+ years of hands-on experience with Databricks and Spark at scale.
  • Lead modernization of legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse.
  • Redesign ingestion, transformation, and consumption patterns from HDFS-based architecture to cloud object storage and Delta Lake.
  • Refactor legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelines.
  • Design and govern enterprise Data Warehouse, Data Lake, and Lakehouse architectures.
  • Implement Medallion Architecture (Bronze, Silver, Gold) and layered data platforms.
  • Develop and optimize large-scale pipelines using PySpark, Spark SQL, Delta Lake, and Databricks SQL.
  • Optimize workloads using Z-ORDER, OPTIMIZE, caching, and cluster configurations.
  • Build semantic and consumption layers for BI, reporting, and analytics.
  • Work with finance and risk data models, including General Ledger, Sub-ledger, financial hierarchies, and credit/liquidity/market risk exposure models.
  • Support reporting capabilities including aggregation, drill-down, and drill-back.
  • Implement data governance, data quality, reconciliation, lineage, metadata, security, and compliance controls.
  • Work with AWS or Azure cloud platforms.
  • Implement CI/CD using Git, Terraform, Jenkins, or Azure DevOps.
  • Use orchestration tools such as Airflow or Databricks Workflows.
  • Experience with dbt is an asset.
  • Act as a technical authority, lead architecture decisions, mentor senior engineers, and establish engineering standards.
  • Partner with finance, risk, analytics, and governance stakeholders to deliver business-ready data solutions.

Nice to Have

  • Experience in BFSI, Capital Markets, or regulatory reporting.
  • Exposure to SAP Finance, Oracle Financials, or S/4HANA.
  • Experience supporting AI/ML workloads.
  • Databricks or cloud certifications.

Impact

  • Lead Cloudera-to-Databricks transformation initiatives.
  • Shape enterprise finance and risk data platforms.
  • Support regulatory, management, and analytical reporting systems.

Emplois semblables

  • Principal Data Engineer

    Toronto, ON

    Scotiabank

    12+ ansCandidates need 12+ years in data engineering, including 8 years designing enterprise data platforms, plus experience as a technical leader on large programs. Cloud experience on Google Cloud Platform, AWS or Azure, and familiarity with DevOps and CI/CD are required.

    Data engineering, ML, Sales, Regulatory compliance, Anti-money laundering, Data warehousing

  • Principal Data Engineer

    Brampton, ON
    140k–160k $/anHybrideTemps plein

    Bed Bath & Beyond

    10+ ansCandidates need a bachelor's degree in a technical field and at least 10 years of data engineering experience. They should have expert SQL and data-modelling skills, strong Python, and deep cloud expertise, preferably with Microsoft Azure.

    Azure Data Factory, Databricks, Azure Synapse, Microsoft Fabric, Azure Data Lake, Azure DevOps

  • Principal Data Engineer

    Toronto, ON
    HybrideTemps plein

    RAVL

    Candidates need advanced Python and SQL, plus Scala or Java, and hands-on Databricks, Apache Spark, and Delta Lake experience. They also need deep cloud platform expertise in AWS, Azure, or GCP, Terraform and CI/CD skills, and knowledge of IAM, encryption, and responsible AI.

    Databricks, Apache Spark, Delta Lake, MLflow, PyTorch, TensorFlow

  • Principal Data Engineer, User Success (Agentic Experiences)

    Toronto, ON +1
    Sur placeTemps plein

    Autodesk

    10+ ansAutodesk needs candidates with 10+ years of data engineering or distributed systems experience, strong Python, Spark and advanced SQL skills, and hands-on AWS and streaming experience. Experience with LLM ecosystems, vector databases and RAG is also required.

    Python, PySpark, Spark, SQL, Kafka, Flink

  • Principal Data Engineer – Databricks

    Toronto, ON

    Astra North Infoteck Inc.

    12+ ansCandidates need 12 to 18 years of data engineering experience, with deep Databricks, Spark, Delta Lake and PySpark skills. They also need legacy Cloudera migration experience, finance and risk data modelling, and cloud (AWS or Azure) and CI/CD experience.

    Databricks, Apache Spark, PySpark, Delta Lake, Cloudera, Hive

  • Principal Data Engineer

    Toronto, ON
    Temps plein

    Altus Group Limited/Groupe Altus Limitée

    Candidates need extensive experience running data engineering solutions in production, strong skills in Python, SQL and Spark, and practical Databricks experience. They should have created standards or platform capabilities adopted across teams, and ideally have worked with finance, credit or commercial real estate data.

    Databricks, Spark, Python, SQL

Lieux et modes de travail

Lieux

Tout le CanadaTélétravail · Hybride · Sur place · Sur le terrain

Astuce : ajoutez le télétravail pour élargir la recherche.

Exclure des lieux

Mode de travail

Offres de cette entreprise dans les résultats

Voici les offres de cette entreprise chargées dans votre recherche. Elle peut avoir d’autres postes ouverts.