Senior Systems Testing/QA Specialist

We are seeking an experienced Senior Systems Testing/QA Specialist to act as a QA Lead, driving end-to-end quality assurance, test automation, and cutting-edge AI-assisted testing for enterprise applications. In this role, you will be responsible for defining Master Test Plans, executing full-layer software testing across web, mobile, and cloud environments, and developing AI-powered QA agents using Agentic AI and LLM technologies. Working closely with cross-functional Agile and DevOps delivery teams, you will validate system performance, lead UAT co-ordination, and execute AI-specific testing—including hallucination checks, prompt injection security, and response accuracy evaluations.

Location: Toronto, ON (Hybrid – Up to 3 days onsite)

Duration: 6-month contract.

Advantages
Cutting-Edge AI Testing Focus: Gain hands-on leadership experience building Agentic AI agents and evaluating LLM safety, accuracy, and security.

Enterprise Full-Layer Scope: Direct testing across UI, API integration, cloud-native platforms, mobile devices, and performance domains.

Advanced Tooling Stack: Work with industry-leading AI and testing tools, including DeepEval, Promptfoo, Applitools, Selenium, and JMeter.

Flexible Hybrid Model: Balance collaborative onsite teamwork in Toronto with remote work flexibility.

Responsibilities
QA Leadership & Master Test Planning: Lead end-to-end quality assurance activities across assigned projects, authoring Master Test Plans, test scenarios, test cases, and formal Test Completion Reports for gating processes.

AI-Powered & Agentic Testing: Develop and deploy AI-powered QA agents using Agentic AI, LLMs, and chatbot frameworks to automate test case generation, execution, and pipeline integration.

AI System Validation & Security: Conduct specialized AI testing, including response accuracy, hallucination detection, prompt testing, safety checks, and AI-security/privacy testing (e.g., prompt injection mitigation).

Multi-Layer Test Execution: Execute comprehensive functional, system integration, regression, load, performance, usability, and accessibility testing across on-premise web solutions, cloud integrations, and mobile platforms.

Automation & Performance Engineering: Build and maintain automated testing frameworks using tools like Selenium, Cucumber, or Micro Focus UFT, while conducting load and stress testing using JMeter or LoadRunner.

Defect Lifecycle & Issue Tracking: Manage the full defect lifecycle—from identification and root-cause analysis to verification and resolution tracking—using OpenText ALM, Octane, Jira, or Visual Studio.

UAT Facilitation & Collaboration: Collaborate with business analysts, architects, and business stakeholders to design realistic test data and lead business users through User Acceptance Testing (UAT).

Qualifications
Enterprise QA Experience: 10+ years of hands-on experience performing multi-layer testing for large-scale applications across web, cloud-based integrations, and mobile platforms (Strictly Required).

AI-Assisted & Agentic Testing: 3+ years of solid experience in AI-assisted testing, including hands-on experience developing AI-powered QA agents using Agentic AI, LLMs, and chatbot applications (Strictly Required).

Full-Layer Testing Proficiency: Extensive experience executing testing across all layers: UI, Integration, Regression, Performance, AI-enabled systems, and UAT (Strictly Required).

Specialized AI Evaluation Tools: Proven ability to execute AI testing activities using specialized platforms such as DeepEval, Promptfoo, Applitools, SaolaAI, Reflect AI, or Copilot Studio Kit (Strictly Required).

Automation & Defect Tracking: Hands-on proficiency with automated testing frameworks (Selenium, Cucumber, Micro Focus UFT/ALM) and issue-tracking platforms (Jira, Octane, Azure DevOps) (Strictly Required).

Nice-to-Have Assets:
Prior public sector or broader public sector testing experience.

Certification in Software Quality Engineering (CSQE) or equivalent credentials.

Experience testing enterprise platforms such as Salesforce, ServiceNow, or SAP.

Summary
If you're interested in the "Senior Systems Testing/QA Specialist" role based in Toronto, we encourage you to apply online at www.randstad.ca.
Only qualified candidates will be contacted for the next steps. We look forward to hearing from you!

Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.

Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to [email protected] to ensure their ability to fully participate in the interview process.

This posting is for existing and upcoming vacancies.