Extreme Networks
Senior AI/ML Engineer – Generative AI & Autonomous Agents (10034, 10035) Toronto, Canada - Hybrid
Seeking a Senior AI/ML Engineer to design and develop AI-native systems using Generative AI and multi-agent frameworks for real-time networking solutions. Responsibilities include modeling agent behaviors, developing LLM-driven agents, building ML models, and collaborating on AI projects.
At Extreme Networks, we create effortless networking experiences that empower people and organizations to advance. As part of our growing AI Competence Center, we are seeking a Senior AI/ML Engineerwith expertise in Generative AI, multi-agent systems, and LLM-based application development.
In this role, you will help build the next generation of AI-native systems that combine traditional machine learning, generative models, and autonomous agents. Your work will power intelligent, real-time decisions for network design, optimization, security, and support.
Key Responsibilities
- Design and implement the business logic and modeling that governs agent behavior, including decision-making workflows, tool usage, and interaction policies.
- Develop and refine LLM-driven agents using prompt engineering, retrieval-augmented generation (RAG), fine-tuning, or function calling.
- Understand and model the domain knowledge behind each agent: engage with network engineers, learn the operational context, and encode this understanding into effective agent behavior.
- Apply traditional ML modeling techniques (classification, regression, clustering, anomaly detection) to enrich agent capabilities.
- Contribute to the data engineering pipeline that feeds agents, including data extraction, transformation, and semantic chunking.
- Build modular, reusable AI components and integrate them with backend APIs, vector stores, and network telemetry pipelines.
- Collaborate with other AI engineers to create multi-agent workflows, including planning, refinement, execution, and escalation steps.
- Translate GenAI prototypes into production-grade, scalable, and testable services in collaboration with platform and engineering teams.
- Work with frontend developers to design agent experiences and contribute to UX interactions with human-in-the-loop feedback.
- Stay up to date on trends in LLM architectures, agent frameworks, evaluation strategies, and GenAI standards.
Qualifications
- Master’s or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
- 5+ years of experience in ML/AI engineering, including 2+ years working with transformer models or LLM systems.
- Strong knowledge of ML fundamentals, with hands-on experience building and deploying traditional ML models.
- Solid programming skills in Python, with experience integrating AI modules into cloud-native microservices.
- Experience with LLM frameworks (e.g., LangChain, AutoGen, Semantic Kernel, Haystack), and vector databases (e.g., FAISS, Weaviate, Pinecone).
- Familiarity with prompt engineering techniques for system design, memory management, instruction tuning, and tool-use chaining.
- Strong understanding of RAG architectures, including semantic chunking, metadata design, and hybrid retrieval.
- Hands-on experience with data preprocessing, ETL workflows, and embedding generation.
- Proven ability to work with cloud platforms like AWS or Azure for model deployment, data storage, and orchestration.
- Excellent collaboration and communication skills, including cross-functional work with product managers, network engineers, and backend teams.
Nice to Have
- Experience with LLMOps tools, open-source agent frameworks, or orchestration libraries .
- Familiarity with Docker, Docker Compose, and container-based development environments.
- Background in enterprise networking, SD-WAN, or network observability tools.
- Contributions to open-source AI or GenAI libraries.
Top Skills
AWS
Azure
Docker
Genai Standards
Llm Frameworks
Python
Vector Databases
Extreme Networks Ontario, CAN Office
55 Commerce Valley Drive West, Suite 300 , ON , Canada, L3T 7V9
Extreme Networks Markham, Ontario, CAN Office
55 Commerce Valley Dr W, Markham, Ontario, Canada, L3T 7V9
Similar Jobs
eCommerce • Fintech • Real Estate • Software • PropTech
The Data Scientist will lead analytical initiatives, conduct A/B tests, develop statistical models, and communicate insights to enhance pricing strategies.
Top Skills:
AirflowDaskDbtNumpyPandasPysparkPythonQuicksightRedshiftScikit-LearnSnowflakeSparkSQLStatsmodelsTableau
Cloud • Information Technology • Security • Software • Cybersecurity
Drive new business for Cloudflare by identifying target accounts, increasing sales, managing negotiations, and developing strategic relationships.
Top Skills:
Cloud SolutionsCyber SecurityIaasNetworkingPaasSaaS
Marketing Tech • Mobile • Software
The Platform & Automation Engineer will design, build, and maintain integrations using Tray.io, develop scalable automations, support platform enhancements, and oversee data governance. The role requires strong API and integration skills, with a focus on improving business process efficiencies.
Top Skills:
JavaScriptJSONPythonRestful ApisSalesforceTray.Io
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.



.jpg)