The role involves building AI search agents, creating RAG pipelines, optimizing vector search technologies, and automating evaluation processes.
Job Responsibilities
1. Building AI search agents- including ReAct, planning, and multi-agent architectures via custom implementation or frameworks like LangGraph, Dify, or CrewAI.
2. Building end-to-end RAG pipelines from ingestion, chunking, embeddings, and hybrid vector search, ideally using Opensearch.
3. Operating and monitoring vector/hybrid indexes (e.g. OpenSearch) in production environments.
4. Implement grounding and citation to link generated answers back to their exact source passages.
5. Automate evaluation using synthetic QA, retrieval-hit-rate tracking, and model-critique loops to continuously measure accuracy and detect drift.
6. Orchestrating external tools or knowledge bases and monitoring latency and cost at production scale.
Qualifications
1. Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
2. 3+ years of experience in developing AI systems, with a focus on retrieval-augmented generation (RAG).
3. Proven track record in building and optimizing end-to-end RAG pipelines.
4. Experience with AI search agent development using frameworks like ReAct, LangGraph, Dify, or CrewAI.
5. Hands-on experience with OpenSearch or similar vector search technologies.
6. Proficiency in Python and relevant machine learning frameworks (e.g., PyTorch, TensorFlow).
7. Strong understanding of data ingestion, chunking, embeddings, and hybrid vector search techniques.
8. Experience with monitoring and managing production environments.
9. Knowledge of grounding and citation techniques in AI-generated content.
10. Familiarity with synthetic QA datasets and evaluation metrics.
Top Skills
Crewai
Dify
Langgraph
Opensearch
Python
PyTorch
TensorFlow
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Principal Platform Architect guides customers in their digital transformation journey through the ServiceNow platform, ensuring alignment between technology solutions and business objectives while providing governance and technical expertise.
Top Skills:
AICloud Application TechnologyServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Architects guide customers through digital transformation by providing architectural guidance, optimizing platform strategies, and ensuring successful project delivery with a focus on ServiceNow solutions.
Top Skills:
AICloud Application TechnologyServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Principal Platform Architect is responsible for advising clients on establishing a technical foundation in the ServiceNow platform and driving effective digital transformation. This role includes managing technical governance, developing customer roadmaps, and guiding teams in delivering technical solutions.
Top Skills:
AICloud ApplicationsServicenow Platform
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
