Publié il y a 4 mois
Copy of Senior Python Developer (AI Evaluation & Benchmarking)
@ Lifted, an Upwork Company™
Ottawa, Ontario
En bref
Lifted, an Upwork Company, is hiring a senior Python developer on a fully remote contract to design coding benchmarks and evaluate AI-generated code for a client building frontier AI models. The work involves writing and reviewing Python, building data pipelines, and analyzing code for correctness and edge cases. The posting states 10 to 39 hours per week, paid at $80 to $100 USD per hour with weekly payments.
Responsabilités :
- Design and develop coding benchmarks for frontier AI models
- Analyze AI-generated code for correctness and edge cases
- Build and maintain scalable data pipelines for AI evaluation
- Write clean, well-tested Python code
Résumé des exigences :
- 4+ years of professional software engineering experience (required)
- Expert-level proficiency in Python
- Proficiency in another language such as JavaScript, Go or C++
- Experience with CI/CD and automated testing frameworks
Outils et compétences
Source et dates
Site carrière / système de candidatures · smartrecruiters
- Date publiée par l’employeur
- 2026-06-29
- Première détection par notre source
- 2026-10-08
- Mise à jour du dossier source
- 2026-10-21
Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.
Détails du poste
| Niveau | Senior |
| Domaine | Développement logiciel |
| Expérience | 4 an(s) et plus |
| Déplacements | avion : aucun · route : aucun |
| Milieu de travail | Domicile |
| Position | Surtout assis |
| Exigences physiques | physique faible · ordinateur élevé |
| Langues | English |
Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.
Lifted, an Upwork Company™
Profil d’entreprise sauvegardé
Renseignements historiques provenant d’un profil The Jobs API sauvegardé (champs LinkedIn/Crunchbase). Ils ne sont pas vérifiés en temps réel; les chiffres peuvent avoir changé. Les valeurs manquantes restent inconnues.
One solution built for enterprise companies to source, contract, manage, and pay any type of contingent talent.
Description complète de l’entreprise
Lifted is the first talent, country and contract agnostic contingent workforce management solution, unifying the ability to source, contract, manage, and pay any type of contingent talent, anywhere in the world. Designed to embed into existing contingent workforce ecosystems, Lifted provides enterprises with global reach, embedded compliance, and a seamless experience across the entire contingent workforce.
- Abonnés LinkedIn
- 6 800
- Personnes associées sur LinkedIn
- 282
- Catégories d’activité
- Information Technology
- Internet
- Autres noms enregistrés
- Lifted
- Lifted, an Upwork Company™
- Lifted, an Upwork Company
- Le profil indique une agence de recrutement
- Non
- Investissement total déclaré
- 0
La devise et la date d’observation ne sont pas fournies; ce n’est ni une valorisation actuelle ni une ronde de financement.
Lifted is the first talent, country and contract agnostic contingent workforce management solution, unifying the ability to source, contract, manage, and pay any type of contingent talent, anywhere in the world. Designed to embed into existing contingent workforce ecosystems, Lifted provides enterprises with global reach, embedded compliance, and a seamless experience across the entire contingent workforce.
| Champ | Valeur |
|---|---|
| Secteur | Technology, Information and Internet |
| Taille | 201-500 employees |
| Type d’organisation | Public Company |
| Fondée en | 2025 |
| Offres sur Jobsy | 32 |
| Voir la page |
Company Description
An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platform that enables organizations to build intelligent applications through high-quality human feedback, AI evaluation, and model alignment.
The selected consultants will contribute to AI research by designing programming benchmarks, evaluating AI-generated code, and helping improve the performance, reasoning, and reliability of frontier AI models. This is an excellent opportunity for experienced software engineers who enjoy solving complex technical problems while contributing to the future of Generative AI.
Job Description
This opportunity is ideal for senior software engineers with strong Python expertise who enjoy writing high-quality code, reviewing technical solutions, and working on AI-related projects.
What You'll Do:
- Design and develop coding benchmarks used to evaluate frontier AI models.
- Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows.
- Create structured programming scenarios to test reasoning, debugging, and code quality.
- Work with large codebases and multi-language software environments.
- Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
- Write clean, maintainable, and well-tested Python code following software engineering best practices.
Qualifications
Requirements:
- 4+ years of professional software engineering experience (required).
- Expert-level proficiency in Python.
- Experience working at a high-growth technology company or top-tier software organization.
- Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar.
- Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit.
- Strong understanding of software engineering best practices, debugging, and code quality.
- Excellent analytical and problem-solving skills.
Nice to Haves:
- Experience with AI/ML evaluation, model benchmarking, or Generative AI.
- Background in security engineering.
- Significant contributions to open-source software projects.
- Experience working with large-scale distributed systems or enterprise software platforms.
Additional Information
- Fully remote contract opportunity.
- Compensation ranges from $80–$100 USD per hour.
- Expected workload is 10–39 hours per week, depending on project needs.
- Weekly payments for approved work completed during the previous week.
- Work volume may fluctuate throughout the duration of the engagement.
Hiring Process:
- Submit your proposal.
- Complete a short qualification form provided by the client.
- Qualified candidates will receive an Upwork contract offer and onboarding instructions.
- After accepting the contract, candidates will gain access to the client's evaluation.
- Candidates who successfully pass the evaluation will be invited to a technical interview with the client.
Journal
Visible seulement par vous. Conservé sur cet appareil, et dans votre compte une fois connecté.