Publié il y a 6 jours
Junior Data Engineer – Azure Databricks / ADF / PySpark
@ ThoughtStorm
Toronto, Ontario
En bref
ThoughtStorm is hiring a junior data engineer on contract to build and maintain Azure-based data pipelines using Azure Data Factory, Databricks and PySpark. The role covers ETL/ELT development, Delta Lake and Medallion Architecture work, and data quality and CI/CD practices. The posting states a contract employment type; pay.
Responsabilités :
- Develop ADF, ADLS and Databricks data engineering solutions
- Build ETL/ELT pipelines and batch or near real-time processing
- Develop Databricks notebooks, workflows and Delta Lake tables
- Validate data quality, reconcile data and troubleshoot pipelines
- Deploy code through Azure DevOps and CI/CD pipelines
Résumé des exigences :
- Degree or diploma in computer science, software engineering or IT
- Hands-on Azure Data Factory, ADLS and Databricks experience
- Strong Python, SQL, PySpark and Apache Spark skills
- Knowledge of Delta Lake and Medallion Architecture
- Experience with Git, CI/CD and automated testing
- Agile/Scrum teamwork experience
Outils et compétences
Source et dates
Type de source non vérifié · apify-linkedin
- Date publiée par l’employeur
- 2026-11-04
- Première détection par notre source
- 2026-11-10
- Mise à jour du dossier source
- 2026-11-10
Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.
Détails du poste
| Niveau | Débutant |
| Domaine | Développement logiciel |
| Milieu de travail | Bureau |
| Position | Surtout assis |
| Exigences physiques | physique faible · ordinateur élevé |
| Langues | English |
| Formation | Collégial (DEC) (exigé) |
| Domaines d’études | Computer Science, Software Engineering, Information Technology |
Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.
ThoughtStorm
| Champ | Valeur |
|---|---|
| Offres sur Jobsy | 9 |
Required Skills & Qualifications
- Degree or diploma in Computer Science, Software Engineering, Information Technology, or a related field.
- Hands-on experience developing data engineering solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Databricks.
- Strong programming skills in Python, SQL, PySpark, and Apache Spark for data processing and transformation.
- Experience developing and maintaining ETL/ELT pipelines, data ingestion frameworks, and scalable batch or near real-time data processing solutions.
- Hands-on knowledge of Delta Lake, Lakehouse Architecture, and Medallion Architecture (Bronze, Silver, Gold).
- Experience developing Databricks notebooks, workflows, data processing jobs, and optimizing Delta Lake tables.
- Strong understanding of data validation, data quality, reconciliation, monitoring, and troubleshooting of data pipelines.
- Experience with Azure DevOps, Git, CI/CD pipelines, automated deployments, and version control.
- Knowledge of REST APIs, data integration patterns, automation frameworks, and reusable development utilities.
- Understanding of data governance, metadata management, data cataloguing, security, privacy, and access control.
- Experience with software development best practices, including code reviews, automated testing, documentation, and secure coding.
- Strong communication and collaboration skills, with experience working in Agile/Scrum teams alongside architects, data engineers, analysts, and business stakeholders.
Journal
Visible seulement par vous. Conservé sur cet appareil, et dans votre compte une fois connecté.