Postuler

Publié hier

AI Voice Evaluation Specialist - 3 month contract

@ Innodata Inc.

Télétravail au Canada

20–25 $/hTélétravail
Postuler
SIGNAUX

En bref

Innodata is hiring an AI Voice Evaluation Specialist on a 3-month W2 full-time contract, 40 hours per week. The role has the specialist hold real-time voice conversations with two AI models on the same scenario, compare them across five defined dimensions, and write a rationale for the preferred model. Pay is $20-$25 CAD per hour, based on experience, skills and qualifications.

Salaire :

20 $–25 $ de l’heure

Responsabilités :

  • Hold comparable voice conversations with two AI models on the same scenario
  • Evaluate each model across five defined dimensions
  • Identify and categorize error clusters in audio and conversation
  • Select the stronger model and write a detailed rationale
  • Apply guidelines consistently across scenarios

Résumé des exigences :

  • Bachelor's degree
  • Strong attention to detail and listening skills
  • Clear, objective written communication
  • Ability to follow detailed evaluation guidelines
  • Comfort role-playing conversations
  • Familiarity with AI assistants or voice-based AI
Source et dates

Site carrière / système de candidatures · greenhouse

Date publiée par l’employeur
2026-11-16
Première détection par notre source
2026-11-16
Mise à jour du dossier source
2026-11-16

Ces dates décrivent le dossier source, pas une vérification en direct du recrutement. Consultez l’offre originale.

Détails du poste

NiveauDébutant
DomaineAssurance qualité
Heures par semaine40
Déplacementsavion : aucun · route : aucun
Milieu de travailDomicile
PositionSurtout assis
Exigences physiquesphysique faible · ordinateur élevé
LanguesEnglish
FormationBaccalauréat (exigé)

Résumé et détails rédigés par l’IA à partir de l’offre; l’offre de l’employeur fait foi.

ChampValeur
Taille1001-5000
Siège socialHackensack
Offres sur Jobsy5
Description

Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.

About this Role:

This role is a 3-month, W2, full-time contract (40 hours per week.)

Scope of the Role:

We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact with two different AI models using the same assigned scenario, carefully compare their responses, and provide structured evaluations based on defined quality criteria.

The goal of the evaluation is to create a fair, consistent comparison between models and identify which model delivers the stronger overall conversational experience.

What You’ll Own:

  • Review an assigned scenario and roleplay a natural conversation with two different AI models.
  • Conduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible.
  • Maintain approximately the same number of conversational turns with each model to support a fair comparison.
  • Record your voice during each interaction and pay close attention to the quality and behavior of the model's responses.
  • Evaluate each model across five defined evaluation dimensions.
  • Identify and categorize relevant error clusters that may occur in the audio or conversation.
  • Compare the performance of Model A and Model B based on the evaluation criteria and your observations.
  • Select the model that demonstrated the stronger overall performance according to the defined evaluation framework.
  • Write a detailed rationale explaining your final preference, referencing specific examples and observations from both conversations.
  • Apply evaluation guidelines consistently across different scenarios and model interactions

You’ll Thrive in This Role If You Have

  • Bachelors Degree
  • Strong attention to detail and ability to notice subtle differences in conversational quality.
  • Excellent listening and comprehension skills.
  • Strong written communication skills, particularly the ability to explain observations clearly and objectively.
  • Ability to consistently follow detailed evaluation guidelines.
  • Comfort speaking naturally and role-playing different conversational scenarios.
  • Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation.
  • Strong critical-thinking and analytical skills.
  • Reliability and consistency when completing structured evaluation tasks.
  • Familiarity with AI assistants, voice-based AI, or conversational systems

The expected hourly salary range for this position is $20-$25 CAD p/hour, based on experience, skills, and qualifications.

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams.

If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at [email protected] and consider reporting it to the FTC at ReportFraud.ftc.gov.

Lieux et modes de travail

Lieux

Tout le CanadaTélétravail · Hybride · Sur place · Sur le terrain

Astuce : ajoutez le télétravail pour élargir la recherche.

Exclure des lieux

Mode de travail

Offres de cette entreprise dans les résultats

Voici les offres de cette entreprise chargées dans votre recherche. Elle peut avoir d’autres postes ouverts.