Design, build, and maintain a scalable internal LLM agent framework and backend services in Python. Ensure observability and reliability via metrics, tracing, and monitoring. Collaborate with ML/NLP teams to adapt the framework for customers, build automated LLM evaluation pipelines, and support integrations and parallel processing for production systems.
Description
We are now expanding our team and are looking for a skilled, goal-oriented backend developer to help us grow. You'll work on services, APIs, databases, and integrations with external systems, collaborating closely with a small, hands-on, technically strong team that moves fast and makes decisions without unnecessary bureaucracy.
Requirements- 6+ years of production experience with Python
- At least 2 years of hands-on experience with async Python (FastAPI, aiohttp, or similar frameworks) in production
- Ability to debug issues across service boundaries
- Strong product mindset, understanding the "why" behind requests and making technical decisions that align with product and business goals.
- Able to navigate ambiguity, adapt quickly to changing priorities, and deliver results despite evolving requirements and limited upfront specifications.
- Open to using AI tools in daily development and troubleshooting
Nice to have:
- Experience with AI Tracing Tools like LangSmith
- Develop and maintain the internal LLM agent framework with focus on scalability, processing, and parallelism
- Ensure system observability and reliability using metrics, tracing and monitoring tools
- Adapt the framework for specific customer use cases and collaborate closely with ML/NLP teams
- Build and support automated LLM evaluation pipelines
- Design backend services using Python () and modern cloud-native architecture.
- The team has built award-winning AI products for tech corporations: devices, voice assistants, products that are actually in the world
- Cutting-edge tech stack: Speech Technologies, NLP, Generative AI (LLMs, diffusion models), voice-first agentic architecture with privacy-first and on-premises deployment
- High engineering bar and real ownership: the team cares about what actually works in production, not what looks good in a demo, and you'll see the impact of your work directly
- Fast career progression: a senior-heavy team and a high volume of real problems means you grow faster than you would anywhere else
- Startup pace with enterprise stability: real clients, real revenue, no bureaucracy
- Fully remote across Europe
- 21 vacation days + public holidays + 5 sick days
- Private English lessons via Preply
- Company-paid subscriptions to top AI tools (ChatGPT, Claude, Cursor, and others)
Similar Jobs
Fintech • Mobile • Payments • Software
Design, build, ship, and support backend services and end-to-end features focused on reliability, scalability, and performance. Debug production issues, write and debug SQL, follow testing best practices, collaborate in a remote team, participate in on-call, and contribute to architecture and roadmap decisions.
Top Skills:
PostgresPythonReactSdksSQL
Big Data • Healthtech • Software • Biotech
Build and operate distributed backend services and genomic reasoning engines that combine whole genome bioinformatics with AI. Design scalable data models, retrieval and vector search systems, and deterministic guardrails to ensure scientifically accurate, explainable genomic AI for production use.
Top Skills:
SparkAws SqsBullmqClinvarDbsnpDuckdbGnomadHgvs NomenclatureLlm ApisPostgresQdrantRabbitMQRedisTranscript DatabasesTypescriptVcfVector Databases
Information Technology • Software • Travel • Hospitality
Senior backend engineer responsible for building and owning high-scale hotel integrations (channel managers, PMS) from code to production. Work includes designing resilient API adapters, optimizing performance and cost for 600M daily requests, debugging live incidents, and shipping new integrations with high ownership in a low-process environment.
Top Skills:
APIsChannel Manager IntegrationsGoProperty Management Systems (Pms)
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
