Publié il y a 3 mois
Senior Data Engineer (AWS, Big Data, ETL, Netezza, Spark, Kafka, Data Warehousing)
@ Astra North Infoteck Inc.
Toronto, Ontario
En bref
Astra North Infoteck Inc. is hiring a senior data engineer on contract to design, build and support scalable data pipelines, and to lead on-prem to AWS data platform migration with a Netezza background. The work covers ETL/ELT, Airflow orchestration and real-time streaming with Kafka and Spark. The posting states a minimum of 10 years of data engineering or big data experience and mandatory Netezza experience.
Responsabilités :
- Design, develop and support scalable data pipelines on Big Data and AWS technologies
- Lead on-prem to AWS data platform migration
- Develop and manage ETL/ELT processes using SSIS, Pentaho or similar
- Build orchestration workflows with Airflow
- Work with Kafka and Spark Streaming for real-time data
Résumé des exigences :
- 10+ years in data engineering, big data or platform engineering
- Mandatory Netezza experience
- Strong AWS services experience (EMR, S3, Redshift, Glue)
- Strong SQL and shell scripting skills
- Strong Unix/Linux experience
- Python is a good-to-have skill
Outils et compétences
Source et dates
Type de source non vérifié · zoho
- Date publiée par l’employeur
- 2026-07-30
- Première détection par notre source
- 2026-10-11
- Mise à jour du dossier source
- 2026-10-11
Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.
Détails du poste
| Niveau | Senior |
| Domaine | Données et analytique |
| Expérience | 10 an(s) et plus |
| Déplacements | avion : aucun · route : aucun |
| Milieu de travail | Bureau |
| Position | Surtout assis |
| Exigences physiques | physique faible · ordinateur élevé |
| Langues | English |
Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.
Astra North Infoteck Inc.
| Champ | Valeur |
|---|---|
| Offres sur Jobsy | 425 |
Senior Data Engineer | AWS Cloud | Big Data | ETL | Netezza | Spark | Kafka | Data Platform Modernization
Job Summary
The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing.
This role involves working on data platform modernization, cloud migrations, Data Warehousing, and ETL in a fast-paced enterprise environment.
Required Technical Skills
Cloud Technologies
• Strong experience in AWS Cloud services:
• EMR
• EC2
• S3
• VPC
• RDS
• Redshift
• AWS Glue
• IAM
• CloudWatch
• CloudFormation
• Experience with:
• Airflow (or AWS Managed Workflows)
Databases
• Experience working with:
• Netezza (Mandatory)
• SQL-based systems:
• SQL Server
• PostgreSQL
• Data warehouses:
• Teradata
• Redshift
• Netezza
ETL Tools
• Hands-on experience with:
• SSIS
• Pentaho or similar ETL tools
Programming & Scripting
• Strong proficiency in:
• SQL
• Shell scripting
• Good to have:
• Python
Operating Systems
• Strong experience in Unix/Linux environments.
Key Qualifications
• 10+ years of experience in Data Engineering / Big Data / Platform Engineering.
Key Responsibilities
• Design, develop, maintain, and support scalable data pipelines using Big Data and AWS technologies.
• Lead and support data platform migration initiatives (On-Prem to AWS Cloud), ideally with Netezza background.
• Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar.
• Implement and manage AWS services such as:
• EMR
• S3
• EC2
• Redshift
• Glue
• Airflow
• Build and optimize data workflows and orchestration pipelines using Airflow.
• Work with real-time streaming technologies such as:
• Kafka
• Spark Streaming
• Perform data ingestion, transformation, and validation from multiple data sources.
• Optimize SQL queries for performance and scalability.
• Monitor system performance, troubleshoot issues, and ensure system reliability.
• Collaborate with cross-functional teams including:
• Developers
• Architects
• Infrastructure teams.
Journal
Visible seulement par vous. Conservé sur cet appareil, et dans votre compte une fois connecté.