Publié il y a 2 mois
Senior Data Engineer (AI Systems & ML)
@ GuruLink
Toronto, Ontario
En bref
GuruLink is hiring a Senior Data Engineer to build the data infrastructure behind large-scale machine learning and recommendation systems. The role owns Spark-based pipelines feeding production ML models, on a remote or Toronto basis, full time, with a base salary of $144K to $188K CAD.
Responsabilités :
- Design and optimize production data pipelines for AI and ML workloads
- Develop and tune Apache Spark batch processing on Google Cloud
- Build a centralized data platform for ML training and inference
- Provide reliable datasets to ML engineers and data scientists
- Monitor and improve reliability and scalability of data systems
Résumé des exigences :
- 5+ years of professional data engineering experience
- Strong Apache Spark and PySpark DataFrame API expertise
- Strong Python development with unit testing and CI/CD
- Experience with Parquet, Delta Lake and Kafka
- Hands-on cloud infrastructure experience, preferably Google Cloud
Outils et compétences
Source et dates
Type de source non vérifié · jsonld
- Date publiée par l’employeur
- 2026-09-23
- Première détection par notre source
- 2026-10-27
- Mise à jour du dossier source
- 2026-11-05
Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.
Détails du poste
| Niveau | Senior |
| Domaine | Développement logiciel |
| Expérience | 5 an(s) et plus |
| Heures par semaine | 40 (estimé) |
| Déplacements | avion : aucun · route : aucun |
| Milieu de travail | Domicile, Bureau |
| Position | Surtout assis |
| Exigences physiques | physique faible · ordinateur élevé |
| Langues | English |
Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.
GuruLink
| Champ | Valeur |
|---|---|
| Offres sur Jobsy | 13 |
Location: REMOTE / Toronto, Ontario
This job allows you to work remotely.
We're looking for a Senior Data Engineer to join a team responsible for building the data infrastructure that powers large-scale machine learning and recommendation systems. You'll help design, develop, and optimize the data platform behind billions of intelligent decisions each day, supporting enterprise customers across a wide range of digital experiences.
In this role, you'll own the Spark-based data pipelines that feed production machine learning models, working closely with ML engineers, data scientists, and software engineers to build reliable, scalable, and high-performance data systems. You'll play a key role in developing the infrastructure that enables advanced AI-driven products and personalization capabilities, with the opportunity to influence architecture and solve complex data engineering challenges at scale.
What You'll Do
- Design, build, maintain, and optimize production data pipelines supporting AI and machine learning workloads at enterprise scale.
- Develop and scale Apache Spark batch processing pipelines, including cluster configuration, performance tuning, and optimization within Google Cloud.
- Build and maintain a centralized data platform that supports machine learning training, experimentation, and production inference.
- Partner closely with Machine Learning Engineers and Data Scientists to provide high-quality, reliable datasets for model development and evaluation.
- Monitor, troubleshoot, and improve the performance, reliability, and scalability of data processing systems.
- Collaborate with platform and distributed systems engineers to evolve the overall data architecture.
- Continuously improve the efficiency, reliability, and maintainability of the data infrastructure.
- Deliver data solutions and platform enhancements that provide measurable business impact.
Must Have Skills:
What We're Looking For
- 5+ years of professional experience in Data Engineering.
- Strong expertise with Apache Spark, including extensive experience using the PySpark DataFrame API to solve large-scale data processing challenges.
- Experience designing, optimizing, and operating distributed data processing pipelines.
- Strong Python development skills, including unit testing, version control, code reviews, and CI/CD practices.
- Experience working with modern data storage formats such as Parquet and Delta Lake.
- Experience building or consuming streaming data pipelines using technologies such as Kafka.
- Hands-on experience with cloud infrastructure, preferably Google Cloud Platform.
- Strong understanding of query optimization and data processing performance tuning.
- Experience working with modern software development practices, including Docker, Kubernetes, GitHub Actions, and automated deployment pipelines.
- Excellent collaboration skills with cross-functional engineering teams, including Machine Learning Engineers, Data Scientists, and Platform Engineers.
- Comfortable working in a fast-moving, highly collaborative environment where ownership and continuous improvement are valued.
The base pay range for this position is $144K CAD - 188K CAD
Journal
Visible seulement par vous. Conservé sur cet appareil, et dans votre compte une fois connecté.