Guidepoint Logo

Guidepoint

Senior AI Engineer

Posted 12 Days Ago
Be an Early Applicant
Hybrid
Toronto, ON, CAN
Senior level
Hybrid
Toronto, ON, CAN
Senior level
Build and productionize real-time conversational AI systems using voice, chat, LLM orchestration, retrieval, and multi-channel session management. Own services from architecture through Kubernetes/Azure deployment and operations. Develop evaluation infrastructure, tune LLM pipelines for quality, latency, and cost, integrate AI and voice vendors, and establish engineering practices for a growing team. Partner with product and compliance stakeholders to encode domain rules into reliable AI systems.
The summary above was generated by AI

Overview:

Guidepoint is investing in applied AI across its research platform. We're building conversational AI systems that interact with our global expert network at scale — combining real-time voice, LLM-driven orchestration, and retrieval over large proprietary datasets.

You'll be an early engineer on a new initiative: taking working prototypes to production and shaping the architecture as the product scope grows. This is a hands-on role with broad ownership, close to product and leadership.

This role is hybrid in our Toronto Office

What You'll Do:

  • Real-time conversational AI: voice- and chat-based agents with low-latency requirements, built on modern telephony and real-time media infrastructure.
  • LLM orchestration: agentic systems that pursue goals over multi-turn conversations, with hard behavioral guarantees enforced in code — not just prompts.
  • Multi-channel session management: stateful user interactions that move seamlessly across channels.
  • Retrieval and grounding: connecting LLM systems to large internal knowledge assets, with structured data flowing back.
  • Evaluation infrastructure: measuring conversational quality against human baselines and gating rollouts on metrics, not vibes.
  • Own services end-to-end: design, implementation, deployment (Kubernetes/Azure), and operations, including latency-sensitive real-time workloads.
  • Design and tune LLM pipelines: context engineering, structured outputs, model selection, cost/latency tradeoffs across vendors.
  • Build the eval loop and treat quality as a number: define metrics, run experiments, gate releases on them.
  • Integrate third-party AI and voice vendors behind clean abstractions so providers stay swappable.
  • Partner with product and compliance stakeholders to encode domain rules into the system.
  • Set engineering patterns for a growing team: code review, observability, incident habits.

What You Have:

  • 6+ years of software engineering, with 2+ years building LLM-powered products in production (not notebooks): orchestration, RAG/grounding, structured outputs, eval-driven iteration.
  • Strong TypeScript or Python; comfortable working across both.
  • Real-time or streaming systems experience: WebSockets, WebRTC, audio pipelines, or comparable low-latency work.
  • Cloud-native production experience: containers, Kubernetes, CI/CD, observability. Azure a plus.
  • Familiarity with agent/LLM frameworks such as LangGraph, LangChain, or CrewAI — hands-on exposure is enough; we care that you know the landscape and when plain code beats a framework.
  • Working familiarity with vector databases and embedding-based retrieval.
  • Pragmatic product judgment: you scope prototypes, kill weak approaches with data, and ship.

Nice-to-have:

  • Voice AI: telephony platforms, conversational agent frameworks, STT/TTS, turn-taking/VAD.
  • Knowledge graphs or large-scale search/retrieval systems.
  • Regulated or compliance-sensitive domains (healthcare, finance).
  • Eval harnesses or LLM-as-judge systems.

What We Offer: 

The annual base salary range for this position is 175,000-210,000 CAD. Additionally, this position is eligible for an annual discretionary bonus based on performance.

You will also be eligible for the following benefits:

  • Paid time off  
  • Comprehensive benefits plan  
  • Company RRSP match  
  • Development opportunities through the LinkedIn Learning platform 

About Guidepoint: 

Guidepoint powers end-to-end research workflows for the world’s best research teams.

Backed by a global network of more than 2 million experts and over 1,600 employees, Guidepoint delivers real-time access to expertise, primary research, and actionable knowledge that help organizations make informed decisions. Through consultations, surveys, events, proprietary content, and AI-enabled tools, we support every stage of the decision-making process—from developing hypotheses and gathering insights to validating assumptions and building conviction for critical decisions.

At Guidepoint, our success relies on the diversity of our employees, experts, and clients, which enables us to foster meaningful connections and a broad range of perspectives. We are committed to creating an inclusive and welcoming environment where individuals of all backgrounds, identities, and experiences can contribute and succeed.

#LI-LG1

#LI-HYBRID

This job posting is for an existing vacancy.  The salary offered will be based on the successful candidate’s skills, experience, qualifications, and location.

Compensation
$175,000—$210,000 CAD

Guidepoint Toronto, Ontario, CAN Office

1 University Ave | Suite 11-111, Toronto, Canada, M5J 2P1

Similar Jobs

2 Days Ago
Hybrid
Toronto, ON, CAN
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design and develop AI capabilities for CrowdStrike’s cross-platform endpoint sensor across macOS, Linux, and Windows. Responsibilities include operationalizing machine learning models, building telemetry pipelines for training and inference, integrating features with core OS subsystems, debugging performance and memory issues, and leading architecture, delivery, mentoring, and cross-functional collaboration.
Top Skills: CC++Data PipelinesEbpfLinuxMachine LearningmacOSOn-Device InferenceSwiftWindowsWindows Driver DevelopmentWindows Os Kernel
3 Days Ago
Easy Apply
Remote or Hybrid
CA
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Architect and own marketing data infrastructure, including Databricks pipelines, Gold Layer tables, semantic models, and trusted analytics foundations. Lead cross-functional data initiatives, translate ambiguous business needs into scalable solutions, improve reliability and quality, and mentor engineers. Build and monitor production LLM and agent systems, automate workflows with AI, and deliver high-quality Python and SQL while validating AI-generated code. Partner with Marketing, Sales, BI, Data Science, and R&D teams.
Top Skills: Ai AgentsBigQueryClaude CodeCursorData WarehousesDatabricksDbtEtl/EltLakehousesLlmsMarketing AutomationMartechPythonSalesforceSemantic LayersSnowflakeSQLStreamlitWeb Analytics
9 Days Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Information Technology • Security • Social Impact • Software
Lead the evaluation, training, fine-tuning, and production integration of machine learning and large language models. Build prompt engineering and model evaluation pipelines, optimize Elasticsearch-backed AI workflows, benchmark commercial and open-source models, and monitor production performance. Collaborate with product, engineering, and security teams to deliver safe, scalable AI capabilities while identifying improvements to data pipelines and engineering processes.
Top Skills: Amazon BedrockAmazon SagemakerAnthropicElasticsearchHugging FaceMeta LlmsMistralOpenaiPythonPyTorchScikit-LearnTensorFlow

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account