Connexion Inscription gratuite
Postuler

Publié il y a 8 mois

GCP Data Engineer

@ Astra North Infoteck Inc.

Toutes ses offres

Toronto, Ontario

Temps plein6+ ans d’expérience
Postuler
SIGNAUX

En bref

Astra North Infoteck Inc. is hiring a Senior GCP Data Engineer, a full-time role requiring 6 to 8 years of experience. The work involves designing and maintaining scalable data pipelines and cloud-native data architectures on Google Cloud Platform, supporting enterprise workloads and ML data preparation.

Responsabilités :

  • Design and build GCP data architectures and batch and streaming pipelines
  • Develop and optimize ELT/ETL pipelines with Dataform and Airflow
  • Implement data quality, metadata and lineage practices
  • Automate cloud infrastructure and CI/CD with Terraform and Jenkins
  • Support ML data preparation and legacy-to-GCP migrations

Résumé des exigences :

  • 6 to 8 years of experience in data engineering
  • Hands-on GCP experience with BigQuery, Dataflow and Dataproc
  • Proficiency in Python, SQL, Spark and PySpark
  • Experience with Airflow DAG development and Terraform
  • Knowledge of data modeling, warehousing and governance

Outils et compétences

BigQueryDataflowDataprocDataformCloud ComposerAirflowApache SparkPySparkKafkaTerraform
Source et dates

Type de source non vérifié · zoho

Date publiée par l’employeur
2026-03-12
Première détection par notre source
2026-10-11
Mise à jour du dossier source
2026-10-11

Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.

Détails du poste

NiveauSenior
DomaineDéveloppement logiciel
Expérience6 an(s) et plus
Heures par semaine40 (estimé)
Déplacementsavion : aucun · route : aucun
Milieu de travailBureau
PositionSurtout assis
Exigences physiquesphysique faible · ordinateur élevé
LanguesEnglish

Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.

Postuler

Astra North Infoteck Inc.

Toutes ses offres
ChampValeur
Offres sur Jobsy426
Description

Job Description: Experience Required: 6–8 years

​

  • Skills: Cloud & Big Data Engineering • GCP • Distributed Data Processing • ELT/ETL • Data Architecture

  • Job Description

  • We are seeking a highly skilled Senior Data Engineer with deep expertise in Google Cloud Platform (GCP), distributed data processing, and cloud-native data architectures.

  • This role involves designing, building, optimizing, and maintaining scalable data pipelines and analytical platforms supporting enterprise‑grade workloads.

  • The ideal candidate brings strong hands‑on experience in BigQuery, Dataflow, DataProc, Dataform, Cloud Composer (Airflow), PySpark, and end‑to-end ELT/ETL frameworks, along with robust knowledge of metadata, lineage, data quality, and CI/CD automation.

  • Key Responsibilities

    1. Data Engineering & Architecture: Design and implement end‑to‑end data architectures on GCP, including data lakes, data marts, and warehouse models. Build scalable batch and streaming pipelines using Dataflow, DataProc (Spark), Dataform, and Pub/Sub. Architect low‑latency, high‑throughput processing solutions supporting advanced analytics and ML workloads. Develop pre‑aggregated models, materialized views, and optimized analytical structures in BigQuery.

    1. ETL/ELT Pipeline Development: Design, develop, test, and optimize ELT/ETL pipelines for structured and unstructured data. Use Dataform and Cloud Composer (Airflow) for orchestration, dependency management, and metadata logging. Implement best practices for ingestion, transformation, storage, and data access patterns.

    1. Data Quality, Metadata & Governance: Implement enterprise‑grade data quality checks using Great Expectations or custom Python frameworks. Manage metadata, lineage tracking, data cataloging, and compliance with governance standards. Ensure data integrity, schema enforcement, and security‑by‑design principles across all data pipelines.

    1. Cloud Infrastructure & DevOps: Build and automate cloud infrastructure using Terraform, Jenkins, GitLab CI, and IaC best practices. Develop CI/CD workflows for pipeline deployments, testing gates, and operational automation. Monitor pipelines using Cloud Monitoring & Logging, optimizing for performance and cost.

    1. Cross‑Functional Collaboration: Work closely with data scientists, analysts, platform engineering, and product owners to translate complex business needs into scalable data solutions. Support legacy-to-GCP migration initiatives, including Hadoop and on‑premise workloads. Enable advanced analytics and ML workloads through ML‑ready data pipelines.

    1. Advanced Analytics & ML Support: Support feature engineering and ML data preparation for Vertex AI, Gemini, HuggingFace, or other ML platforms. Enable vector database workflows and generative AI data pipelines.

  • Required Technical Skills

  • Cloud & Big Data: Google Cloud Platform: BigQuery, DataProc, Dataflow, Cloud Composer (Airflow), GCS, Cloud Run, EventArc. Distributed Computing: Apache Spark, PySpark, Kafka. Data Lake & Lakehouse Architectures.

  • Programming & Tools: Python, SQL, Java. Git, Bitbucket, Jenkins, GitLab CI. Terraform (IaC). REST APIs, FastAPI. Airflow DAG development.

  • Data Engineering Competencies: Data modeling (OLTP/OLAP). Data Warehousing. ELT/ETL pipelines. Streaming & real‑time processing. Data profiling and validation. Metadata, lineage, quality management.

    • ​


    Emplois semblables

    • GCP Data Engineer

      Télétravail au Canada
      TélétravailContrat

      Querentia Inc.

      5+ ansCandidates need at least 5 years of data engineering experience, strong SQL, hands-on BigQuery and GCP data services, and DBT. They also need data warehousing knowledge, basic to intermediate Python, and Git.

      BigQuery, DBT, Git, Python

      GCP Data Engineer – B2

      Toronto, ON
      Contrat

      Querentia Inc.

      5+ ansCandidates need five years of data engineering experience, strong SQL skills, and hands-on BigQuery and GCP data services experience. A bachelor's degree in a related field, basic to intermediate Python, and Git familiarity are also required.

      BigQuery, DBT, Python, Git

    • Senior GCP Data Engineer

      Mississauga, ON

      Capgemini

      Candidates need strong SQL, Python, Java or Scala skills, hands-on Google Cloud data experience, and familiarity with Spark, Beam, CI/CD, Git and infrastructure-as-code. A Google Cloud Professional Data Engineer certification is a plus.

      BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Composer, Terraform

    • Dairy Clerk Part Time Day

      Toronto, ON
      Temps partiel

      Loblaw

      Candidates need no prior experience, since training is provided. They must be a team player with attention to detail, able to work independently in a fast-paced setting, and able to move up to 50 lbs and stay mobile for a full shift.

    • Dairy Clerk Part Time Day

      Toronto, ON
      Temps partiel

      Loblaws Inc.

      Candidates need to be a team player with attention to detail who can work independently in a fast-paced setting. They must be flexible with days, evenings and weekends, and able to lift up to 50 lbs and stay mobile for a full shift.

      Customer service, Merchandise display, Health and safety, Work independently, Leadership

    • Senior Manager, Licensing & Account Management – NBA Canada

      Toronto, ON
      Temps plein

      CAN NBA Canada

      7+ ansCandidates need a bachelor's degree and 7+ years of work experience, ideally in media, entertainment, licensing, marketing or retail, with sports experience an asset. Strong Excel, PowerPoint and Word skills, financial analysis and forecasting, and excellent communication and presentation skills are required.

      Microsoft Excel, Microsoft PowerPoint, Microsoft Word, Flowhaven, NBA business approval portal

      Director, Marketing Partnerships Lead – NBA Canada

      Toronto, ON
      Temps plein

      CAN NBA Canada

      8+ ansCandidates need 8+ years of sales, business development or account management experience, a bachelor's degree, and strong negotiation and senior-level communication skills. Knowledge of sponsorship agreements, the Canadian market and fluent English are required.

    • Critical Environment Electrical Engineering

      Toronto, ON
      86k–169k $/anSur placeTemps plein

      Microsoft: Every company has a mission.

      2+ ansCandidates need a bachelor's or master's degree in electrical or computer engineering plus relevant engineering experience, and must be registered as a P.Eng. in Ontario. Critical environment and electrical infrastructure experience is preferred.

      Blueprints, Building management systems, Switchgear, UPS systems, Standby diesel generators

    Lieux et modes de travail

    Lieux

    Tout le CanadaTélétravail · Hybride · Sur place · Sur le terrain

    Astuce : ajoutez le télétravail pour élargir la recherche.

    Exclure des lieux

    Mode de travail

    Offres de cette entreprise dans les résultats

    Voici les offres de cette entreprise chargées dans votre recherche. Elle peut avoir d’autres postes ouverts.