Top Tech Jobs & Startup Jobs in Toronto

Evaluate AI model outputs, conduct audit-based reviews, identify patterns and failure modes, apply and improve evaluation guidelines, and document actionable findings. The role requires native-level Marathi, strong English, structured writing, GenAI safety knowledge, critical thinking, and comfort making judgment calls in ambiguous situations. Associates collaborate with leads and stakeholders, participate in calibrations, and help refine quality standards. This is a full-time, one-year, 100% onsite contract role in specified U.S. cities.

Evaluate AI model outputs, audit data and model behavior, identify edge cases and failure modes, apply and improve evaluation guidelines, communicate performance trends, participate in calibration discussions, and document actionable findings. The role requires native-level Tamil, strong English and writing skills, critical judgment, attention to detail, and familiarity with GenAI safety considerations. This is a full-time, one-year, 100% onsite contract position.

Evaluate AI outputs, perform audit-based reviews, identify failure modes and trends, apply and refine guidelines, communicate findings, participate in calibrations and stakeholder syncs, and help improve evaluation frameworks for human-in-the-loop AI.

Evaluate AI outputs, audit model behavior, apply and refine labeling guidelines, identify failure modes and trends, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.

Audit and review data labeling outputs, provide actionable feedback, train and support labeling teams, monitor workflows, identify recurring issues and edge cases, participate in calibrations and stakeholder syncs, and help improve guidelines and processes in human-in-the-loop AI workflows.

Audit and ensure quality of data labeling outputs, coach and onboard Data Labeling Associates, provide actionable feedback, monitor workflows, identify patterns and edge cases, and help improve guidelines and processes in human-in-the-loop AI workflows.

Audit and ensure quality of labeled data by reviewing DLA outputs, providing feedback and coaching, supporting onboarding and training, monitoring workflows, identifying recurring issues and edge cases, and contributing to guideline and process improvements in human-in-the-loop AI workflows.

Evaluate AI model outputs, perform audit-based reviews, identify failure modes and trends, apply and improve guidelines, document findings, and collaborate with leads and cross-functional teams to refine quality standards.

Evaluate AI model outputs, perform audit-style reviews to find patterns and failure modes, apply and refine labeling/evaluation guidelines, document findings, communicate insights to leads and stakeholders, and participate in team calibrations to improve model evaluation and data quality.

Evaluate AI model outputs, perform audit-based reviews, apply and refine guidelines, identify performance trends and failure modes, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.