Cohere AI Logo

Cohere AI

Applied AI Engineer – Agentic Workflows

Reposted 9 Days Ago
In-Office or Remote
Hiring Remotely in Toronto, ON, CAN
Mid level
In-Office or Remote
Hiring Remotely in Toronto, ON, CAN
Mid level
Develop production-grade AI agents for enterprise customers. Design and build LLM-powered systems, integrating workflows, evaluation, and performance standards. Collaborate closely with customers and teams to ensure reliability and effectiveness in real-world applications.
The summary above was generated by AI

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany and Paris. Join us!

Who are we?

Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and Agents. We believe that our work is instrumental to the widespread adoption of AI.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers.

Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.

Join us on our mission and shape the future!

Why this role?

We’re a fast-growing startup building production-grade AI agents for enterprise customers at scale. We’re looking for Software Engineers with Applied AI experience who can own the design, build, and deployment of agentic workflows powered by Large Language Models (LLMs)—from early prototypes to production-grade AI agents, to deliver concrete business value in enterprise workflows.

In this role, you’ll work closely with customers on real-world business problems, often building first-of-their-kind agent workflows that integrate LLMs with tools, APIs, and data sources. While our pace is startup-fast, the bar is enterprise-high: agents must be reliable, observable, safe, and auditable from day one.

You’ll collaborate closely with customers, product, and platform teams, and help shape how agentic systems are built, evaluated, and deployed at scale.


What You’ll Do

Customer-Facing Technical Impact

  • Work closely with enterprise customers to translate high-value, ambiguous business problems into well-framed agentic problems with clear success criteria and evaluation methodologies.

  • Provide technical leadership across the full development and evaluation lifecycle, including post-deployment iteration, for agentic workflows.

  • Contribute to shared frameworks and patterns that enable consistent delivery across customers.

Agent Design, Build and Production launches

  • Lead the design, build, and delivery of LLM-powered agents that reason, plan, and act across tools and data sources with enterprise-grade reliability and performance.

  • Balance rapid iteration with enterprise requirements, evolving prototypes into stable, reusable solutions.

  • Define and apply evaluation and quality standards to measure success, failures, and regressions.

  • Debug real-world agent behavior and systematically improve prompts, workflows, tools, and guardrails.

Team Mentorship & Organizational Impact

  • Mentor engineers across distributed teams.

  • Drive clarity in ambiguous situations, build alignment, and raise engineering quality across the organization.

Required Skills & Experience

Technical Foundations & Applied AI

  • Production Engineering: Substantial experience building, shipping, and maintaining production-grade software (Python/TypeScript). You understand how to write clean, testable, observable and scalable code.

  • Agentic Architectures: Hands-on experience building agents that plan and execute multi-step tasks (ReAct, Plan-and-Execute) and interact with external APIs/tools.

  • The LLM Stack: Deep familiarity with Frontier Models (GPT, Claude, Gemini), RAG, vector databases (Pinecone, Weaviate, etc.), and orchestration frameworks (LangGraph, CrewAI, or custom state machines).

  • Rigorous Evaluation: Proven ability to move beyond "trial and error" by building robust evaluation frameworks to measure agent accuracy, safety, and latency.

Leadership & Impact

  • Stakeholder Mastery: Experience leading technical discussions with enterprise customers to translate ambiguous business needs into concrete technical specs.

  • Experience mentoring distributed teams and setting the architectural standards for AI/Agentic systems.

Additional Requirements
  • Strong written and verbal communication skills.

  • Ability and interest to travel up to 25%, flexible.

Why Join Us
  • Build production-grade AI agents used in real enterprise workflows.

  • Operate at scale while retaining end-to-end ownership.

  • Work on hard problems in agent design, evaluation, and reliability.

  • Shape shared platforms and standards, not just individual features.

  • Move fast with a high bar for quality, safety, and reliability.

Full-Time Employees at Cohere enjoy these Perks:
  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

  • Full health and dental benefits, including a separate budget for mental health.

  • RRSP matching, 401K, Pension Scheme.

  • 100% Parental Leave top-up for up to 6 months, for either parent.

  • Annual enrichment benefits:

    Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.

    Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)

  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

How and Where We Work:
  • Cohere is remote-friendly. We have offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more coming soon.

  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.

  • For those not near an office: a co-working benefit so you can work alongside others in your city.

  • Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.


We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

HQ

Cohere AI Toronto, Ontario, CAN Office

Toronto, Ontario, Canada

Similar Jobs

2 Hours Ago
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Cloud • Consumer Web • Productivity • Software • App development • Data Privacy
Design, build, and operate large-scale distributed storage systems ensuring durability, availability, and performance. Implement replication, erasure coding, and lifecycle management; write high-quality Go and Rust code; participate in on-call rotations; troubleshoot production issues; collaborate across networking, hardware, and capacity teams; own scoped projects and drive infrastructure architecture and reliability improvements.
Top Skills: C++CephDistributed Storage SystemsErasure CodingFile SystemsGfs/ColossusGoObservabilityProduction MonitoringReplication ProtocolsRustS3
2 Hours Ago
Easy Apply
Remote
Canada
Easy Apply
Senior level
Senior level
Cloud • Security • Software • Cybersecurity • Automation
Lead and grow the AMER Technical Architecture practice within Professional Services. Manage Technical Architects across presales and delivery, oversee scoping, staffing, and delivery quality, coach senior technical talent, support strategic customer conversations, and turn field learnings into repeatable delivery methods, playbooks, and standards.
Top Skills: AIDevsecopsGitlabInfrastructurePlatform EngineeringSecuritySite Reliability Engineering
2 Hours Ago
In-Office or Remote
CA
Senior level
Senior level
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Lead design, automation, and maintenance of cloud-based database infrastructure (primarily SQL Server and MySQL). Improve reliability with monitoring, HA/DR, automation, troubleshooting, on-call support, and mentoring of junior engineers while collaborating across teams.
Top Skills: AuroraAWSBashFailover ClusteringMySQLNew RelicOrchestratorPmmPythonRdsRubySQL ServerVividcortex

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account