Guidepoint Logo

Guidepoint

Senior AI Engineer

Posted One Month Ago
Be an Early Applicant
Hybrid
Toronto, ON, CAN
Senior level
Hybrid
Toronto, ON, CAN
Senior level
Build and productionize real-time conversational AI systems using voice, chat, LLM orchestration, retrieval, and multi-channel session management. Own services from architecture through Kubernetes/Azure deployment and operations. Develop evaluation infrastructure, tune LLM pipelines for quality, latency, and cost, integrate AI and voice vendors, and establish engineering practices for a growing team. Partner with product and compliance stakeholders to encode domain rules into reliable AI systems.
The summary above was generated by AI

Overview:

Guidepoint is investing in applied AI across its research platform. We're building conversational AI systems that interact with our global expert network at scale — combining real-time voice, LLM-driven orchestration, and retrieval over large proprietary datasets.

You'll be an early engineer on a new initiative: taking working prototypes to production and shaping the architecture as the product scope grows. This is a hands-on role with broad ownership, close to product and leadership.

This role is hybrid in our Toronto Office

What You'll Do:

  • Real-time conversational AI: voice- and chat-based agents with low-latency requirements, built on modern telephony and real-time media infrastructure.
  • LLM orchestration: agentic systems that pursue goals over multi-turn conversations, with hard behavioral guarantees enforced in code — not just prompts.
  • Multi-channel session management: stateful user interactions that move seamlessly across channels.
  • Retrieval and grounding: connecting LLM systems to large internal knowledge assets, with structured data flowing back.
  • Evaluation infrastructure: measuring conversational quality against human baselines and gating rollouts on metrics, not vibes.
  • Own services end-to-end: design, implementation, deployment (Kubernetes/Azure), and operations, including latency-sensitive real-time workloads.
  • Design and tune LLM pipelines: context engineering, structured outputs, model selection, cost/latency tradeoffs across vendors.
  • Build the eval loop and treat quality as a number: define metrics, run experiments, gate releases on them.
  • Integrate third-party AI and voice vendors behind clean abstractions so providers stay swappable.
  • Partner with product and compliance stakeholders to encode domain rules into the system.
  • Set engineering patterns for a growing team: code review, observability, incident habits.

What You Have:

  • 6+ years of software engineering, with 2+ years building LLM-powered products in production (not notebooks): orchestration, RAG/grounding, structured outputs, eval-driven iteration.
  • A Bachelor’s degree in Computer Science, Engineering, or a related technical field with 6+ years of professional experience; or a Master’s degree with 4+ years of professional experience in backend software engineering and Generative AI. This must include a proven track record of designing, building, and scaling distributed, production-grade system
  • Strong TypeScript or Python; comfortable working across both.
  • Real-time or streaming systems experience: WebSockets, WebRTC, audio pipelines, or comparable low-latency work.
  • Cloud-native production experience: containers, Kubernetes, CI/CD, observability. Azure a plus.
  • Familiarity with agent/LLM frameworks such as LangGraph, LangChain, or CrewAI — hands-on exposure is enough; we care that you know the landscape and when plain code beats a framework.
  • Working familiarity with vector databases and embedding-based retrieval.
  • Pragmatic product judgment: you scope prototypes, kill weak approaches with data, and ship.

Nice-to-have:

  • Voice AI: telephony platforms, conversational agent frameworks, STT/TTS, turn-taking/VAD.
  • Knowledge graphs or large-scale search/retrieval systems.
  • Regulated or compliance-sensitive domains (healthcare, finance).
  • Eval harnesses or LLM-as-judge systems.

What We Offer: 

The annual base salary range for this position is 175,000-210,000 CAD. Additionally, this position is eligible for an annual discretionary bonus based on performance.

You will also be eligible for the following benefits:

  • Paid time off  
  • Comprehensive benefits plan  
  • Company RRSP match  
  • Development opportunities through the LinkedIn Learning platform 

About Guidepoint: 

Guidepoint powers end-to-end research workflows for the world’s best research teams.

Backed by a global network of more than 2 million experts and over 1,600 employees, Guidepoint delivers real-time access to expertise, primary research, and actionable knowledge that help organizations make informed decisions. Through consultations, surveys, events, proprietary content, and AI-enabled tools, we support every stage of the decision-making process—from developing hypotheses and gathering insights to validating assumptions and building conviction for critical decisions.

At Guidepoint, our success relies on the diversity of our employees, experts, and clients, which enables us to foster meaningful connections and a broad range of perspectives. We are committed to creating an inclusive and welcoming environment where individuals of all backgrounds, identities, and experiences can contribute and succeed.

#LI-LG1

#LI-HYBRID

This job posting is for an existing vacancy.  The salary offered will be based on the successful candidate’s skills, experience, qualifications, and location.

Compensation
$175,000—$210,000 CAD

Guidepoint Toronto, Ontario, CAN Office

1 University Ave | Suite 11-111, Toronto, Canada, M5J 2P1

Similar Jobs

16 Days Ago
Easy Apply
Remote or Hybrid
Toronto, ON, CAN
Easy Apply
Senior level
Senior level
Artificial Intelligence • Marketing Tech • Software
Lead the architectural evolution of a large-scale recommendations platform into a distributed architecture. Design, build, operate, and optimize fault-tolerant backend services supporting AI-driven personalization. Collaborate with machine learning engineers and product stakeholders, own systems through deployment and incident response, champion engineering practices, and mentor team members.
Top Skills: Apache BeamApache FlinkApache KafkaSparkAWSAzureCi/CdDockerGitGithub ActionsGoogle Cloud PlatformGrpcKubernetesPython
23 Days Ago
Easy Apply
In-Office
Toronto, ON, CAN
Easy Apply
Senior level
Senior level
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Designs, builds, deploys, and operates production software and AI systems on AWS or GCP. Responsibilities include developing backend services and APIs, building RAG and inference platforms, managing Kubernetes and Terraform infrastructure, implementing CI/CD and observability, responding to incidents, and optimizing cloud and GPU costs. The role owns systems throughout their lifecycle while establishing reliability, governance, security, and cost controls for scalable AI capabilities.
Top Skills: AWSCi/CdFinops ToolingGCPGoIamJavaKubernetesLlmsNext.JsNode.jsPythonPyTorchRagReactTensorFlowTerraformTypescriptVector Databases
Yesterday
In-Office
Waterloo, ON, CAN
Senior level
Senior level
Fintech • Insurance • Financial Services
Build and scale cloud-native AI applications, APIs, microservices, distributed systems, agent workflows, retrieval-augmented pipelines, and real-time inference services. Design AI architectures involving prompt pipelines, vector storage, model orchestration, and evaluation. Support DevOps, security, governance, observability, compliance, and responsible AI practices while collaborating cross-functionally and mentoring engineers.
Top Skills: APIsAutogenAWSAzureCi/CdEmbeddingsGCPGithub ActionsGoJavaScriptKubernetesLangchainLanggraphMicroservicesMicrosoft Agent FrameworkPythonRetrieval-Augmented GenerationRustSemantic KernelTerraformTypescriptVector Search

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account