Workiy Logo

Workiy

QA Lead – Agentic AI Platform

Reposted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Lead QA for an Agentic AI platform: define and execute testing strategy, implement automation, validate LLM outputs and conversational workflows, oversee functional/integration/regression/performance testing, integrate CI/CD, mentor QA engineers, and promote quality best practices across teams.
The summary above was generated by AI

This is a remote position.

Job Description :

We are seeking an experienced QA Lead to oversee quality assurance efforts for a next-generation Agentic AI platform. The ideal candidate will be responsible for defining and executing comprehensive testing strategies that ensure the reliability, accuracy, scalability, and performance of AI-driven applications. This role requires close collaboration with product managers, software engineers, data scientists, and business stakeholders to validate end-to-end system functionality and deliver high-quality releases.

The QA Lead will drive the implementation of automated testing frameworks, establish quality standards and release criteria, and oversee functional, integration, regression, performance, and user acceptance testing activities. The role also involves validating AI model outputs, conversational workflows, API integrations, data pipelines, and overall user experience. Candidates should possess strong leadership skills, hands-on experience with test automation, API testing, CI/CD processes, and data validation, along with a deep understanding of Agile development practices.

The successful candidate will mentor QA engineers, promote quality best practices across teams, identify risks early in the development lifecycle, and continuously improve testing processes to support the delivery of robust, enterprise-grade AI solutions. Experience with Generative AI, Large Language Models (LLMs), Agentic AI systems, cloud platforms, and modern software quality engineering methodologies is highly preferred.



Requirements
  • AI/LLM Testing and Validation
  • Agentic AI and Conversational AI Platforms
  • Test Automation Frameworks (Selenium, Playwright, Cypress, or equivalent)
  • API Testing (REST, GraphQL)
  • Python or Java for Test Automation
  • Data Quality and Data Validation Testing
  • SQL and Database Testing
  • CI/CD Pipeline Integration (Jenkins, GitHub Actions, GitLab CI)
  • Functional, Integration, Regression, and End-to-End Testing
  • Performance and Load Testing
  • Defect Management and Test Planning
  • Quality Strategy, Release Gates, and Risk-Based Testing
  • Agile/Scrum Methodologies
  • QA Leadership and Team Mentoring
  • Strong Analytical and Problem-Solving Skills
  • Experience with Cloud Platforms (AWS, Azure, or GCP)


Similar Jobs

2 Minutes Ago
Remote or Hybrid
Canada
Junior
Junior
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Support daily administration, configuration, and optimization of the Salesforce platform. Translate business requirements into scalable declarative solutions, maintain data quality and security settings, triage support tickets, document processes, and collaborate with senior team members on platform improvements.
Top Skills: Flow BuilderSales CloudSalesforceService Cloud
An Hour Ago
Remote or Hybrid
Mid level
Mid level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead client engagements to deliver Lead-to-Cash transformations using SAP BRIM and related SAP cloud solutions. Drive solution design, stakeholder management, team coaching, and deployment of subscription and entitlement billing capabilities to enable XaaS business models.
Top Skills: Sap BrimSap C/4 MarketingSap C/4 SalesSap C/4 ServiceSap Cloud For CustomerSap CommerceSap CpqSap CrmSap Entitlement ManagementSap S/4 Sales And DistributionSap Subscription Billing
An Hour Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead strategy and business development for SAP CRM applications. Analyze client requirements, implement SAP CRM/Cloud for Customer solutions, provide training and support, drive growth, mentor teams, maintain executive client relations, and promote innovation and thought leadership across engagements.
Top Skills: Sap BrimSap Cloud For CustomerSap Crm

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account