Connexion Inscription gratuite
Postuler

Première détection par notre source: il y a 5 jours

Software Engineering, Data Science & Systems Design Experts (AI Model Evaluation)

@ Union Rebellion

Toutes ses offres

Télétravail au Canada

TélétravailContrat3+ ans d’expérience
Postuler
SIGNAUX

En bref

Union Rebellion is hiring Technical AI Evaluators on an independent contractor basis to assess and improve AI-generated responses to coding and software engineering tasks. The work involves executing and testing code, identifying bugs and logical flaws, annotating outputs, and fact-checking technical claims. The role is fully remote with flexible hours, full-time or part-time, with weekly payments based on services rendered.

Responsabilités :

  • Evaluate AI-generated code responses for accuracy and clarity
  • Execute and test code to validate correctness
  • Identify bugs, inefficiencies and logical flaws
  • Annotate responses with detailed feedback
  • Fact-check technical claims against authoritative sources

Résumé des exigences :

  • Bachelor's, Master's or PhD in Computer Science or related field
  • 3+ years of professional software or data experience
  • Strong proficiency in at least two programming languages
  • Ability to solve medium to hard algorithmic problems
  • Experience working with LLMs in coding workflows

Outils et compétences

PythonJavaScriptC++JavaSQLGoRust
Source et dates

Type de source non vérifié · dover

Date publiée par l’employeur
Non fourni
Première détection par notre source
2026-11-04
Mise à jour du dossier source
2026-11-04

Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.

Détails du poste

NiveauIntermédiaire
DomaineDéveloppement logiciel
Expérience3 an(s) et plus
Déplacementsavion : aucun · route : aucun
Milieu de travailDomicile
PositionSurtout assis
Exigences physiquesphysique faible · ordinateur élevé
LanguesEnglish
FormationBaccalauréat (exigé)
Domaines d’étudesComputer Science
Avantages mentionnésHoraire flexible

Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.

Postuler

Union Rebellion

Toutes ses offres
ChampValeur
Offres sur Jobsy5
Description

Role Overview

As a Technical AI Evaluator, you will assess and improve AI-generated responses to coding and software engineering tasks. Your work will directly impact how accurately and effectively AI systems solve problems, write code, and communicate technical concepts.

This is a hands-on, intellectually rigorous role suited for professionals with strong coding, analytical, and problem-solving skills.

Key Responsibilities

  • Evaluate AI-generated responses for accuracy, reasoning, clarity, and completeness

  • Execute and test code to validate correctness and performance

  • Identify bugs, inefficiencies, and logical flaws in model outputs

  • Annotate responses with detailed feedback and improvement suggestions

  • Assess code quality, readability, and adherence to best practices

  • Fact-check technical claims using reliable and authoritative sources

  • Apply structured evaluation frameworks and guidelines consistently

What We’re Looking For

  • Bachelor’s, Master’s, or PhD in Computer Science or a related field

  • 3+ years of professional experience in software engineering, data science, or related roles

  • Strong proficiency in at least two programming languages (e.g., Python, JavaScript, C++, Java, SQL, Go, Rust, etc.)

  • Ability to independently solve medium to hard algorithmic problems

  • Experience working with or alongside LLMs in coding workflows

  • Strong attention to detail and ability to evaluate complex technical reasoning

Nice to Have

  • Experience with AI model evaluation, RLHF, or data annotation

  • Background in competitive programming

  • Contributions to open-source projects (merged pull requests preferred)

  • Experience reviewing production-level code

  • Ability to explain complex technical concepts clearly to non-experts

What Success Looks Like

  • You consistently identify subtle bugs, flawed logic, and edge cases

  • Your feedback improves the accuracy and clarity of AI-generated code

  • You produce structured, reproducible evaluation outputs

  • AI systems become more reliable for real-world engineering tasks

Compensation & Terms

  • Independent contractor engagement

  • Fully remote with flexible working hours (open to US and non-US candidates)

  • Full-time or part-time contract options available

  • Weekly payments based on services rendered

Equal Opportunity

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Emplois semblables

  • Software Engineering - Systems Test Engineer P1

    Burnaby, BC

    OSI Maritime Systems: OSI Maritime Systems is a leading provider of integrated navigation and tactical solutions designed for naval and maritime security operations.

    Candidates need a degree in computer science, software, electrical or computer engineering, engineering physics or mathematics, and 0-2 years of software experience. Experience testing on Windows and Linux, knowledge of TCP/IP, UDP or real-time systems, and security clearance are needed.

    Bug-tracking software, Version control repository

  • Software Engineering

    Hamilton, ON
    65k–85k $/anTemps plein

    Liburdi

    Candidates need a Bachelor in Software Engineering and experience with C#, .NET Framework, WinForms and Visual Studio. Object-oriented programming knowledge is required, and WPF experience and multithreading are assets.

    Visual Studio, WinForms, WPF

  • Sr. Software Engineering - LV Power Distribution

    Markham, ON
    HybrideTemps plein

    GM of Canada Company

    5+ ansCandidates need a BS in engineering or computer science, at least 5 years of embedded controls software experience, and strong C/C++ skills. Automotive safety (ISO 26262), SiL/HiL testing, CAN/LIN communication and OBDII diagnostics experience are also required.

    JIRA, Matlab Simulink, CAN, LIN, ARXML, Ethernet

    Senior Software Engineering - Autonomy Build & Integration

    Markham, ON
    TélétravailTemps plein

    GM of Canada Company

    3+ ansGM of Canada Company needs candidates with 3+ years leading large cross-team initiatives, a bachelor's degree or equivalent experience, and hands-on work with CI/CD platforms, Python, Docker and build systems like Bazel or CMake.

    Buildkite, Jenkins, GitHub Actions, Python, Docker, Bazel

    Senior Software Engineering - Device Data Capture

    Markham, ON +1
    TélétravailTemps plein

    GM of Canada Company

    5+ ansCandidates need 5+ years building production backend services, ideally in Java and Spring Boot, plus strong distributed-systems skills and experience leading technical direction. Comfort with AI-assisted developer tools is also required.

    Spring Boot, Java, MCP clients

    Senior Software Engineering, Vehicle Data Platform

    Markham, ON +1
    HybrideTemps plein

    GM of Canada Company

    4+ ansCandidates need a bachelor's degree, 4+ years of C, C++, Java or Kotlin development, and production experience on limited-resource ECUs or embedded devices. They also need distributed systems, security protocol and testing experience.

    Azure, AWS S3, Firestore, Android, Linux, QNX

  • Software Engineering, Backend (All Teams)

    Toronto, ON
    Temps plein

    DoorDash Canada

    2+ ansCandidates need a computer science degree or equivalent and 2+ years of backend experience. They should know REST APIs, service-oriented design, SQL and NoSQL databases, and use AI coding tools in their daily work.

    Claude Code, Codex, Cursor, Postgres, Redis, Elasticsearch

    Senior Software Engineering, Backend (All Teams)

    Toronto, ON
    Temps plein

    DoorDash Canada

    5+ ansCandidates need 5+ years of industry experience, a degree in Computer Science or equivalent, and prior backend work. They must know REST APIs, service-oriented architecture, SQL and NoSQL databases, and use AI coding tools in daily development.

    Redis, Elasticsearch, RabbitMQ, Claude Code, Codex, Cursor

Lieux et modes de travail

Lieux

Tout le CanadaTélétravail · Hybride · Sur place · Sur le terrain

Astuce : ajoutez le télétravail pour élargir la recherche.

Exclure des lieux

Mode de travail

Offres de cette entreprise dans les résultats

Voici les offres de cette entreprise chargées dans votre recherche. Elle peut avoir d’autres postes ouverts.