Leads technical and writing teams delivering generative AI products, coordinating customers, data, product, and research teams. Tracks annotator metrics, manages labeling initiatives, creates prompts and responses, develops stakeholder guidelines, and trains teams on LLM and dataset best practices. The role includes customer interaction, quality assurance, and exposure to potentially toxic or sensitive content.
If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login
When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.
Thank you!
NOTICE: For Privacy Policy please review here
Job Responsibilities:
The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products. This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Exposure to potentially sensitive content may be required.Responsibilities:
- Lead technical and writing teams to deliver NEMO products.
- Act as the liaison between customers, DataFactory teams, product teams, and research teams.
- Track annotator metrics to ensure top-quality deliverables.
- Write creative prompts and responses across diverse topics.
- Manage labeling initiatives with third-party firms and internal customers.
- Develop and update detailed guidelines and specifications for stakeholders.
- Train teams on best practices for creating large language models and datasets.
- Handle potentially toxic or offensive content as required (e.g., sexually explicit, graphic, or disturbing material).
Additional Job Details:
Requirements:
- Proven track record of delivering quality products on time.
- Native-level English proficiency with excellent written and verbal communication skills.
- Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools.
- Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
- 4-year accredited college degree or equivalent experience.
Ways to Stand Out:
- Over 1 year of experience delivering products in the LLM space.
- College degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or relevant domain knowledge.
- Deep understanding of large language models and RLHF.
- Experience in labeling and tagging frames/tasks/prompts for DNN preparation.
- QA/testing experience.
- Python scripting skills are a plus.
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Provides strategic and technical guidance to enterprise customers using Atlassian products and solutions. Partners with stakeholders to address business challenges, improve enterprise agility, map operating practices to product capabilities, and implement strategy and planning tools. Creates prescriptive solution content, supports adoption and enablement, advocates for customer needs internally, and identifies expansion opportunities. The role requires significant SaaS and customer-facing experience, expertise in enterprise strategy and Agile tools, AI integration familiarity, and up to 30% travel.
Top Skills:
Agentic AiAgileAlignAtlassianAzure DevopsFocusJira PlansMcpRallyRational Team ConcertRovoSaaSStrategy CollectionTalentVersionone
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and operate end-to-end full-stack features for Loom billing, subscriptions, integrations, and platform migrations. Develop responsive React interfaces, scalable backend APIs and microservices, payment and identity integrations, and reliable cloud-based systems. Responsibilities include observability, monitoring, testing, code reviews, documentation, security, performance optimization, and participation in Agile ceremonies and technical design reviews.
Top Skills:
AWSBitbucketCi/CdConfluenceCypressDockerGitJavaJavaScriptJestJIRAMicroservicesMochaMySQLNode.jsPostgresPythonReactRest ApisTypescript
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead technical strategy and development of Confluence AI experiences across frontend, backend, and AI integrations. Design scalable systems, apply generative AI, retrieval, agents, evaluation, and safeguards, and improve product quality, adoption, trust, and customer value. Drive complex initiatives from architecture through launch, partner cross-functionally, mentor engineers, establish quality practices, and guide experimentation and continuous improvement across Atlassian.
Top Skills:
Ai AgentsAutomated EvaluationExperimentationFull-Stack DevelopmentGenerative AiInformation RetrievalMachine LearningProduction Monitoring
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
