Top Tech Jobs & Startup Jobs in Toronto

Audit and monitor data labeling outputs, provide actionable feedback, support onboarding and training of annotators, enforce and improve guidelines, escalate workflow issues, and document findings to maintain high-quality human-in-the-loop AI data processes.

Audit and ensure quality of data labeling work for ML using human-in-the-loop processes. Provide feedback, train and support annotators, monitor workflows, identify recurring issues, and help improve guidelines and processes.

Evaluate AI outputs, perform audit-based reviews, identify patterns and failure modes, apply and improve annotation/evaluation guidelines, document findings, and communicate insights to cross-functional teams to improve model performance and evaluation frameworks.

Evaluate AI model outputs, perform audit-based reviews to identify patterns and failure modes, apply and refine guidelines, document findings, and collaborate with leads and cross-functional teams to improve model evaluation and data quality.

Leads English-to-Bosnian Cyrillic localization quality for UI, marketing, product, legal, informational, and support content. Owns client alignment, arbitration, quality audits, reviewer coaching, style guide analysis, monthly reporting, and continuous improvement. Serves as the primary linguistic contact for the client Language Manager and ensures consistent quality standards across the review community.

Join Welo Data’s Swahili contributor network for potential remote AI projects involving text, image, or audio annotation; search, advertising, or chatbot evaluation; prompt creation; and cultural and linguistic accuracy review. Applicants must be native or near-native Swahili speakers based in Kenya, Tanzania, or the Democratic Republic of Congo, with English proficiency, digital-tool comfort, and strong attention to detail. Projects vary in duration and compensation, with details provided before participation.

Own Serbian Cyrillic localization quality for UI, marketing, product, legal, support, and informational content. Lead client alignment, arbitration, quality audits, reviewer coaching, roundtables, reporting, and style guide improvements. Serve as the primary linguistic contact for the client’s Language Manager and drive consistency across the language community.

Own English-to-Kazakh localization quality for UI, marketing, product, legal, informational, and support content. Serve as the primary client-facing linguistic expert, interpret quality standards, manage arbitration and escalations, coach reviewers, facilitate alignment sessions, analyze quality data, publish monthly reports, and propose style guide improvements. Requires native-level Kazakh, professional English, strong localization quality assurance experience, stakeholder management, and expertise with RQE, LQE, error rubrics, and severity mapping.

Leads English-to-Kyrgyz localization quality for UI, marketing, product, legal, support, and informational content. Owns quality standards, reviewer coaching, alignment sessions, arbitration records, client stakeholder communication, quality reporting, and continuous improvement. Analyzes style guides, error trends, severity patterns, and client expectations to improve consistency and review performance across the locale.

Own Ukrainian localization quality for UI, marketing, product, legal, informational, and support content. Serve as the primary client-facing language expert, interpret quality standards, manage arbitration and escalations, coach reviewers, facilitate alignment sessions, analyze quality metrics, and drive style guide and process improvements.