Extreme Networks
Senior AI/ML Engineer – Generative AI & Autonomous Agents (10034, 10035) Toronto, Canada - Hybrid
Seeking a Senior AI/ML Engineer to design and develop AI-native systems using Generative AI and multi-agent frameworks for real-time networking solutions. Responsibilities include modeling agent behaviors, developing LLM-driven agents, building ML models, and collaborating on AI projects.
At Extreme Networks, we create effortless networking experiences that empower people and organizations to advance. As part of our growing AI Competence Center, we are seeking a Senior AI/ML Engineerwith expertise in Generative AI, multi-agent systems, and LLM-based application development.
In this role, you will help build the next generation of AI-native systems that combine traditional machine learning, generative models, and autonomous agents. Your work will power intelligent, real-time decisions for network design, optimization, security, and support.
Key Responsibilities
- Design and implement the business logic and modeling that governs agent behavior, including decision-making workflows, tool usage, and interaction policies.
- Develop and refine LLM-driven agents using prompt engineering, retrieval-augmented generation (RAG), fine-tuning, or function calling.
- Understand and model the domain knowledge behind each agent: engage with network engineers, learn the operational context, and encode this understanding into effective agent behavior.
- Apply traditional ML modeling techniques (classification, regression, clustering, anomaly detection) to enrich agent capabilities.
- Contribute to the data engineering pipeline that feeds agents, including data extraction, transformation, and semantic chunking.
- Build modular, reusable AI components and integrate them with backend APIs, vector stores, and network telemetry pipelines.
- Collaborate with other AI engineers to create multi-agent workflows, including planning, refinement, execution, and escalation steps.
- Translate GenAI prototypes into production-grade, scalable, and testable services in collaboration with platform and engineering teams.
- Work with frontend developers to design agent experiences and contribute to UX interactions with human-in-the-loop feedback.
- Stay up to date on trends in LLM architectures, agent frameworks, evaluation strategies, and GenAI standards.
Qualifications
- Master’s or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
- 5+ years of experience in ML/AI engineering, including 2+ years working with transformer models or LLM systems.
- Strong knowledge of ML fundamentals, with hands-on experience building and deploying traditional ML models.
- Solid programming skills in Python, with experience integrating AI modules into cloud-native microservices.
- Experience with LLM frameworks (e.g., LangChain, AutoGen, Semantic Kernel, Haystack), and vector databases (e.g., FAISS, Weaviate, Pinecone).
- Familiarity with prompt engineering techniques for system design, memory management, instruction tuning, and tool-use chaining.
- Strong understanding of RAG architectures, including semantic chunking, metadata design, and hybrid retrieval.
- Hands-on experience with data preprocessing, ETL workflows, and embedding generation.
- Proven ability to work with cloud platforms like AWS or Azure for model deployment, data storage, and orchestration.
- Excellent collaboration and communication skills, including cross-functional work with product managers, network engineers, and backend teams.
Nice to Have
- Experience with LLMOps tools, open-source agent frameworks, or orchestration libraries .
- Familiarity with Docker, Docker Compose, and container-based development environments.
- Background in enterprise networking, SD-WAN, or network observability tools.
- Contributions to open-source AI or GenAI libraries.
Top Skills
AWS
Azure
Docker
Genai Standards
Llm Frameworks
Python
Vector Databases
Extreme Networks Ontario, CAN Office
55 Commerce Valley Drive West, Suite 300 , ON , Canada, L3T 7V9
Extreme Networks Markham, Ontario, CAN Office
55 Commerce Valley Dr W, Markham, Ontario, Canada, L3T 7V9
Similar Jobs
Food • Retail • Agriculture • Manufacturing
Lead AI-driven marketing transformation by managing product deployments, engaging with teams, and ensuring best practices for AI adoption and ROI.
Top Skills:
AdtechAIAnalyticsCdpCRMMarketing AutomationMartechMlNlpPredictive Analytics
Food • Retail • Agriculture • Manufacturing
The Sr. Analyst supports the Revenue Management team through financial analysis, modeling, and reporting, focusing on revenue growth initiatives and collaborating with cross-functional teams.
Top Skills:
Circana Supply TrackExcelMicrosoft PowerpointOnestreamPower BISAP
Food • Retail • Agriculture • Manufacturing
The Director of Digital Technology Operations manages operational activities, leads strategic projects, prepares executive communications, and fosters stakeholder engagement to ensure digital technology excellence.
Top Skills:
ExcelPowerPoint
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

