SecurityScorecard Logo

SecurityScorecard

Principal AI Architect

Posted One Month Ago
Be an Early Applicant
Remote
Hiring Remotely in CAN
Expert/Leader
Remote
Hiring Remotely in CAN
Expert/Leader
Lead the system architecture for production agentic AI capabilities, including orchestration, state and memory, tool integration, reliability, and guardrails. Write technical design reviews and standards, prototype architectural decisions, and partner with Data Science and engineering teams. Influence technical direction, review architectures, mentor senior engineers, promote AI-assisted development, and communicate trade-offs to executives and customers.
The summary above was generated by AI

About SecurityScorecard:

SecurityScorecard is the global leader in cybersecurity ratings, with over 12 million companies continuously rated, operating in 64 countries. Founded in 2013 by security and risk experts Dr. Alex Yampolskiy and Sam Kassoumeh and funded by world-class investors, SecurityScorecard’s patented rating technology is used by over 25,000 organizations for self-monitoring, third-party risk management, board reporting, and cyber insurance underwriting; making all organizations more resilient by allowing them to easily find and fix cybersecurity risks across their digital footprint. 

Headquartered in New York City, our culture has been recognized by Inc Magazine as a "Best Workplace,” by Crain’s NY as a "Best Places to Work in NYC," and as one of the 10 hottest SaaS startups in New York for two years in a row. Most recently, SecurityScorecard was named to Fast Company’s annual list of the World’s Most Innovative Companies for 2023 and to the Achievers 50 Most Engaged Workplaces in 2023 award recognizing “forward-thinking employers for their unwavering commitment to employee engagement.”  SecurityScorecard is proud to be funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV and Riverwood Capital.

About the Role:

SecurityScorecard is hiring a Principal Software Architect to lead the system design of our agentic AI capabilities and serve as a technical anchor for engineering teams building the next generation of our platform. This is an individual contributor role reporting to the Chief Architect, alongside a Front-end Architect and a Data-focused Architect, and partnering closely with engineering leadership, Product, and Data Science.

We're looking for someone who can go deep technically and also move a room: an architect whose designs get adopted because they're well-reasoned and well-communicated, not just handed down.

You will lead the system design for how agentic features are built, integrated, and operated reliably at production scale, working in close partnership with our Data Science team, who bring the model and ML depth. Your focus is the system: orchestration, state and memory, tool boundaries, failure semantics, and how all of it composes with the wider platform. 

Like the rest of our architecture function, you'll prototype to prove out decisions rather than implement full solutions, and you'll set direction through Technical Design Reviews (TDRs), and standards. Deep data-engineering specialization isn't required, but you should be comfortable reasoning about data flows, storage decisions, and how agentic systems consume and act on data.

This role follows a hybrid work model based on proximity to our office locations. Employees who live within 75 miles of our Midtown NYC or Downtown Austin office are required to work onsite 1–2 days per week. Employees who live outside a 75-mile radius of both offices are eligible for fully remote work.

What You'll Do
  • Own the system design for our agentic capabilities: orchestration, context and state, tool boundaries, and reliability patterns for non-deterministic systems
  • Write the TDRs, design docs, and standards that set architectural direction for agentic work across teams
  • Prototype to validate architectural decisions before teams commit to them at scale
  • Partner with Data Science so that agent and model work composes cleanly with existing platform services, from APIs and event streaming through to storage
  • Review TDRs from across engineering, giving teams substantive feedback on architecture and risk, not only on AI work
  • Build consensus across engineering teams and get them genuinely aligned, not merely compliant
  • Help drive the shift to AI-assisted and agentic development across engineering, shaping how engineers design, review, and iterate in an AI-native workflow
  • Mentor senior and staff engineers on agentic system design and measurably elevate the technical bar
  • Communicate architectural decisions and their trade-offs clearly to executives and customers

Required Qualifications:

  • 10+ years of software engineering experience, including significant time as a senior, staff, or principal-level architect or technical lead designing production systems
  • Deep expertise in distributed systems: service boundaries, consistency models, event-driven architecture, API design (REST; gRPC familiarity a plus), and operating systems reliably at scale
  • Hands-on experience building, prototyping, and architecting agentic or LLM-powered systems in production, not just demos: agent loop design, context engineering, MCP and tool/function-calling integration, RAG architectures, memory and state management, and reliability and guardrail patterns for non-deterministic systems
  • Working knowledge of data engineering fundamentals, including data modeling, pipeline design, and streaming vs. batch, sufficient to make informed architectural calls without deep specialization in the domain
  • A track record of influence without authority: presenting a technical direction to skeptical engineers and earning genuine buy-in, and giving rigorous design review feedback on systems you didn't build yourself
  • Strong technical writing and mentorship: TDRs, design docs, and decision records that teams can act on without hand-holding, plus a history of raising the technical bar around you
  • Ability to communicate complex architectural decisions clearly to executives and customers
  • Comfort operating as a senior individual contributor, driving outcomes through prototyping and technical credibility

Preferred Qualifications:

  • Familiarity with multi-agent orchestration patterns (supervisor and sub-agent architectures, agent handoffs), which our use cases are likely to grow toward
  • Experience with our stack or comparable technologies: Node.js/TypeScript, PostgreSQL, ClickHouse, Kafka, AWS, Kubernetes
  • Experience leading AI-assisted or agentic development adoption across an engineering organization; given the scope of this work at SecurityScorecard, this carries significant weight
  • Experience partnering closely with data science or ML teams on productionizing their work
  • Cybersecurity industry background
Our Tech Stack

Our platform runs on Node.js and TypeScript, with a React Microfrontend Architecture and PostgreSQL and ClickHouse for storage. We use Kafka for event streaming, and our infrastructure runs on AWS with Kubernetes, Terraform, Helm, and ArgoCD. We are actively expanding our AI/ML infrastructure. You do not need to have used every tool here, but you should be comfortable reasoning across a stack of this kind and making principled architectural trade-offs within it.

Benefits:

Specific to each country, we offer a competitive salary, stock options, Health benefits, and unlimited PTO, parental leave, tuition reimbursements, and much more!

Actual compensation for the position is based on a variety of factors, including, but not limited to affordability, skills, qualifications and experience, and may vary from the range. In addition to base salary, employees may also be eligible for annual performance-based incentive compensation awards and equity, among other company benefits.

  • For candidates based in New York, the estimated total compensation range for this position is $270,000 - $330,000 USD (base salary plus bonus).
  • For candidates based in Austin and all other U.S. locations, the estimated total compensation range for this position is $240,000 - $300,000 USD (base salary plus bonus).
  • For candidates based in Canada, the estimated total compensation range for this position is $250,000 - $350,000 CAD (base salary plus bonus). 

SecurityScorecard is committed to Equal Employment Opportunity and embraces diversity. We believe that our team is strengthened through hiring and retaining employees with diverse backgrounds, skill sets, ideas, and perspectives. We make hiring decisions based on merit and do not discriminate based on race, color, religion, national origin, sex or gender (including pregnancy) gender identity or expression (including transgender status), sexual orientation, age, marital, veteran, disability status or any other protected category in accordance with applicable law. 

We also consider qualified applicants regardless of criminal histories, in accordance with applicable law. We are committed to providing reasonable accommodations for qualified individuals with disabilities in our job application procedures. If you need assistance or accommodation due to a disability, please contact [email protected].

Any information you submit to SecurityScorecard as part of your application will be processed in accordance with the Company’s privacy policy and applicable law. 

SecurityScorecard does not accept unsolicited resumes from employment agencies.  Please note that we do not provide immigration sponsorship for this position.   #LI-DNI

Similar Jobs

One Month Ago
In-Office or Remote
4 Locations
Expert/Leader
Expert/Leader
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software
Lead the architecture and end-to-end delivery of enterprise IVR, routing, conversational AI, generative AI, and agentic virtual agent solutions. Responsibilities include developing bots, designing integrations, optimizing speech experiences, leading Agile delivery, establishing testing and deployment practices, advising customers, delivering training, and providing technical leadership. The role requires extensive experience with Dialogflow, Lex, enterprise APIs, architecture, software development, and customer-facing technical consulting.
Top Skills: Agentic AiAgileAmazon LexAPIsAsrC#DtmfGenerative AiGenesys CloudGoogle DialogflowIvrJavaNluPHP
2 Months Ago
Remote
Canada
Expert/Leader
Expert/Leader
Hardware • Information Technology • Software
Lead architecture and performance exploration for next-generation AI inference accelerators. Build analytical models and simulation frameworks, define subsystem interfaces and roadmaps, and drive hardware/software co-design with compiler, runtime, ML, and silicon teams to optimize latency, throughput, memory, interconnects, power, and cost for evolving LLMs and transformer-based workloads.
Top Skills: Ai AcceleratorAsicCompilerGpu ArchitectureHardware/Software Co-DesignInterconnectsKv-CacheLarge Language Models (Llms)Linear/Sub-Quadratic AttentionMemory SystemsMoePerformance ModelingSimulation FrameworksSocSparse ModelsState-Space ModelsTransformer Models
2 Months Ago
In-Office or Remote
CA
Senior level
Senior level
Automotive • Other
Lead technical engagements with robotics customers to design and integrate voice AI into mobile robots, own POCs and technical evaluations, clear deployment roadblocks, collaborate with sales/product/services, and feed customer learnings into the product. Travel across Europe for onsite evaluations (20–30%).
Top Skills: Agentic OrchestrationCloud-Edge Hybrid ArchitecturesEmbedded SystemsErpFoundation ModelsMoveit 2Nav2Onboard ComputeRobops PlatformsRobot Vendor SdksRos 2SlamVda 5050Wms

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account