Build and operate scalable, secure cloud infrastructure for real-time AI services. Improve reliability with SLOs, observability, capacity planning, and failure testing. Implement IaC, CI/CD, deployment safety, secrets and vulnerability management. Partner with product and AI teams, diagnose distributed failures, reduce cost, and automate platform patterns to enable faster, safer releases.
Palona’s AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience.
We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona’s AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.
Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching.
What you will own:- Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications.
- Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention.
- Build deployment and release systems that make production changes fast, repeatable, auditable, and safe.
- Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production.
- Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities.
- Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries.
- Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity.
- Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations.
- Build internal tooling and paved paths that let engineers ship and operate services with less manual work.
- Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment.
Requirements
- 3+ years industrial experience in relevant technical domain.
- Strong software engineering fundamentals and experience building or operating production distributed systems.
- Hands-on experience with a major cloud platform; AWS experience is especially relevant.
- Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging.
- Ability to write reliable automation and services in Python or another modern programming language.
- Sound judgment around availability, latency, scalability, security, and cost tradeoffs.
- A track record of taking ambiguous operational problems from diagnosis through durable resolution.
- Clear communication during architecture reviews, launches, and incidents.
- AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems.
Benefits
- Competitive Salary and Stock Option Plan.
- Medical, dental, vision, retirement, leave, and disability benefits as applicable.
- Family Leave
- Short Term & Long Term Disability
- Paid time off and company holidays.
- Learning and development support.
Similar Jobs
Database
Build and operate production backend services supporting Supabase AI products, including the MCP server. Responsibilities include service architecture, deployments, scaling, authentication and authorization, observability, reliability targets, on-call incident response, rate limiting, capacity management, and API evolution. The role requires strong TypeScript or Go skills, production backend experience, distributed-systems debugging, and collaboration with Platform and SRE teams in a fully remote environment.
Top Skills:
Ci/CdDockerGoGrafanaInfrastructure As CodeJwtLogflareMcpNode.jsOauthOidcOpentelemetryPostgresTypescript
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Provides technical pre-sales and consulting expertise for commercial customers migrating and modernizing infrastructure on Azure. Designs secure, scalable hybrid and cloud architectures, leads assessments, migration plans, proofs of concept, and technical decision-making. Advises stakeholders on Windows, Linux, Oracle, networking, security, containers, Azure-native services, and AI-powered infrastructure. Collaborates with account teams, partners, and engineering to remove blockers, build business cases, develop implementation roadmaps, and generate customer value.
Top Skills:
AksAzureAzure ArcAzure CopilotAzure MigrateAzure NetworkingContainersGithub CopilotInfrastructure As CodeLinuxOraclePaasRvtoolsSQL ServerVMwareVpnWindows Server
Information Technology • Other
Develop and maintain software tools and infrastructure supporting machine learning and AI workflows. Build backend services, APIs, automation tools, and integrations; support large-scale experiments, evaluation, and data processing. Debug issues, improve reliability and performance, collaborate with researchers and engineers, gather user feedback, provide technical support, and write clean, tested code.
Top Skills:
Ai AgentsCloud InfrastructureDatabasesDistributed SystemsDockerGitLarge Language ModelsLinuxMachine LearningPythonReactRest ApisTypescript
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
