Workiy Logo

Workiy

QA Lead – Agentic AI Platform

Posted 6 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Lead QA for an Agentic AI platform: define and execute testing strategy, implement automation, validate LLM outputs and conversational workflows, oversee functional/integration/regression/performance testing, integrate CI/CD, mentor QA engineers, and promote quality best practices across teams.
The summary above was generated by AI

This is a remote position.

Job Description :

We are seeking an experienced QA Lead to oversee quality assurance efforts for a next-generation Agentic AI platform. The ideal candidate will be responsible for defining and executing comprehensive testing strategies that ensure the reliability, accuracy, scalability, and performance of AI-driven applications. This role requires close collaboration with product managers, software engineers, data scientists, and business stakeholders to validate end-to-end system functionality and deliver high-quality releases.

The QA Lead will drive the implementation of automated testing frameworks, establish quality standards and release criteria, and oversee functional, integration, regression, performance, and user acceptance testing activities. The role also involves validating AI model outputs, conversational workflows, API integrations, data pipelines, and overall user experience. Candidates should possess strong leadership skills, hands-on experience with test automation, API testing, CI/CD processes, and data validation, along with a deep understanding of Agile development practices.

The successful candidate will mentor QA engineers, promote quality best practices across teams, identify risks early in the development lifecycle, and continuously improve testing processes to support the delivery of robust, enterprise-grade AI solutions. Experience with Generative AI, Large Language Models (LLMs), Agentic AI systems, cloud platforms, and modern software quality engineering methodologies is highly preferred.



Requirements
  • AI/LLM Testing and Validation
  • Agentic AI and Conversational AI Platforms
  • Test Automation Frameworks (Selenium, Playwright, Cypress, or equivalent)
  • API Testing (REST, GraphQL)
  • Python or Java for Test Automation
  • Data Quality and Data Validation Testing
  • SQL and Database Testing
  • CI/CD Pipeline Integration (Jenkins, GitHub Actions, GitLab CI)
  • Functional, Integration, Regression, and End-to-End Testing
  • Performance and Load Testing
  • Defect Management and Test Planning
  • Quality Strategy, Release Gates, and Risk-Based Testing
  • Agile/Scrum Methodologies
  • QA Leadership and Team Mentoring
  • Strong Analytical and Problem-Solving Skills
  • Experience with Cloud Platforms (AWS, Azure, or GCP)


Similar Jobs

3 Hours Ago
In-Office or Remote
Alberta, AB, CAN
Mid level
Mid level
Productivity • Software • App development • Automation
The Account Executive will manage software sales, qualify leads, close deals, and collaborate with technical teams to propose solutions.
Top Skills: Outreach DoolySales NavigatorSalesforce CRMZoominfo
3 Hours Ago
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Productivity • Software • Automation
As a Sr. Applied AI Engineer at Zapier, you will build and enhance AI platform capabilities, focusing on LLM Ops and ML Ops to support scalable AI development across teams.
Top Skills: Cloud InfrastructureLlm OpsMl OpsPythonTypescript
7 Hours Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Senior level
Senior level
AdTech • Cloud • Marketing Tech • Productivity • Software • Analytics • Automation
Design, build, and ship production AI systems for Acquia DAM. Architect agentic, stateful multi-agent workflows, own AI observability and RAG architectures, evaluate LLM providers and tooling, mentor engineers, and ensure enterprise-grade security, scalability, and compliance for AI features.
Top Skills: AWSAzureCi/CdClaudeContainerizationCopilotCrewaiCursorDigital Asset ManagementDrupalEmbedding ModelsGCPHermes AgentLangchainLangfuseLanggraphLlamaindexLlm Fine-TuningOpenclawOpencodeOpenspecPydanticPythonRagTemporalVector Databases

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account