Optimize, compress, and distill large language and vision models for on-device inference. Build pipelines for distillation and hardware-specific compilation, and benchmark performance across NPU/GPU architectures.
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.
Responsibilities:
- Compress and optimize large language and vision models for on-device inference.
- Develop pipelines for model distillation and hardware-specific compilation.
- Benchmark performance across various NPU/GPU architectures.
Qualifications:
- Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
- Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
- Strong C++ and Python skills.
Similar Jobs
Agency • Artificial Intelligence • Blockchain • Web3
Run adversarial tests on language and multimodal models, build guardrails and real-time filters for autonomous tool use, and support RLHF alignment and constitutional AI development to ensure safe AI deployment.
Top Skills:
Adversarial MlGuardrailsJailbreak TaxonomiesLlmsMultimodal AgentsPrompt EngineeringReal-Time FilteringRed-Teaming FrameworksRlhf
Cloud • Security • Software • Cybersecurity • Automation
Designs, operates, and improves production Kubernetes platforms across cloud environments. Manages ArgoCD GitOps workflows, Terraform infrastructure, CI/CD integrations, platform reliability, observability, security controls, and developer enablement. Collaborates with application teams to onboard services, create self-service tooling and documentation, respond to incidents, and improve platform availability and performance.
Top Skills:
ArgocdAWSAzureBashCiliumCrossplaneDnsExternal Secrets OperatorGCPGithub ActionsGitlab CiGitopsGoGrafanaHelmIngressIstioKubernetesKyvernoLinkerdLoad BalancingLokiOpa/GatekeeperOpentelemetryPrometheusPythonSealed SecretsService MeshTektonTerraformVault
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and operate end-to-end full-stack features for Loom billing, subscriptions, integrations, and platform migrations. Develop responsive React interfaces, scalable backend APIs and microservices, payment and identity integrations, and reliable cloud-based systems. Responsibilities include observability, monitoring, testing, code reviews, documentation, security, performance optimization, and participation in Agile ceremonies and technical design reviews.
Top Skills:
AWSBitbucketCi/CdConfluenceCypressDockerGitJavaJavaScriptJestJIRAMicroservicesMochaMySQLNode.jsPostgresPythonReactRest ApisTypescript
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
