RSM US LLP Logo

RSM US LLP

AI Risk & Controls Testing Specialist

Reposted 10 Days Ago
Be an Early Applicant
In-Office
Toronto, ON
Mid level
In-Office
Toronto, ON
Mid level
Perform structured control testing (ITGCs, business process, regulatory) and evaluate AI-generated testing outputs. Draft prompts, validate AI accuracy, document workpapers, identify gaps, and escalate issues to engagement leadership in a regulated financial services environment.
The summary above was generated by AI

We are the leading provider of professional services to the middle market globally, our purpose is to instill confidence in a world of change, empowering our clients and people to realize their full potential. Our exceptional people are the key to our unrivaled, inclusive culture and talent experience and our ability to be compelling to our clients. You’ll find an environment that inspires and empowers you to thrive both personally and professionally. There’s no one like you and that’s why there’s nowhere like RSM.

AI Risk & Controls Testing Specialist

Location: Toronto, ON (On-Site at Client Office)

About the Opportunity

RSM is seeking a detail-oriented, analytically strong Temporary AI Risk & Controls Testing Specialist to support a client engagement in a regulated financial services environment.

This role combines traditional internal audit and risk-testing expertise with the structured evaluation of AI-generated outputs. You will play a key role in assessing the reliability, accuracy, and control alignment of AI-supported testing activities, ensuring outputs meet professional and regulatory standards.

This position requires on-site presence in Toronto in accordance with client requirements.

Responsibilities

Risk & Control Testing Execution

  • Perform structured testing of IT General Controls (ITGCs), business process controls, and regulatory compliance controls
  • Evaluate control design and operating effectiveness
  • Assess whether testing procedures appropriately address stated control objectives and underlying risks
  • Identify gaps, inconsistencies, or unsupported conclusions

AI Output Evaluation & Validation

  • Use AI tools to execute control testing activities within defined protocols
  • Draft, refine, and vary prompts to assess consistency and robustness of AI responses
  • Critically evaluate AI-generated:
    • Testing procedures
    • Evidence requests
    • Testing conclusions
  • Independently assess outputs for accuracy, completeness, and alignment with control intent
  • Classify AI performance (accurate, partially accurate, inaccurate, incomplete)
  • Escalate ambiguities, limitations, or systemic issues to engagement leadership

Documentation & Reporting

  • Prepare clear, defensible workpapers documenting:
    • Testing performed
    • Evidence reviewed
    • Results and exceptions
    • Evaluation of AI performance
  • Assess audit evidence for relevance, sufficiency, and appropriateness
  • Summarize testing outcomes objectively and in accordance with quality standards

Required Qualifications

  • Experience performing or supporting control testing (SOX, internal audit, operational risk, compliance, or similar)
  • Foundational understanding of risk management and internal control frameworks
  • Familiarity with:
    • IT General Controls
    • Business process controls
    • Regulatory compliance environments
  • Strong professional judgment and critical thinking skills
  • Ability to independently evaluate automated or AI-generated outputs
  • Strong written documentation skills suitable for audit workpapers
  • Proficiency in Excel, Word, and structured tracking tools
  • Ability to work on-site in Toronto
  • Experience within financial services or other regulated industries
  • Exposure to model risk management or validation frameworks
  • Experience working with AI-enabled tools in a professional environment
  • Ability to operate effectively in protocol-driven and quality-controlled environments
  • Adhere strictly to confidentiality, data privacy, and information security requirements
  • Follow defined testing protocols and engagement quality standards
  • Collaborate effectively with RSM engagement teams, client stakeholders, and model risk functions

At RSM, we offer a competitive benefits and compensation package for all our people. We offer flexibility in your schedule, empowering you to balance life’s demands, while also maintaining your ability to serve clients. Learn more about our total rewards at https://rsmcanada.com/careers/life-at-rsm/rewards-and-benefits.html.

RSM does not tolerate discrimination and/or harassment based on race; colour; creed; sincerely held religious beliefs, practices or observances; sex (including pregnancy or disabilities related to nursing); gender (including gender identity and/or gender expression); sexual orientation; national origin; ancestry; familial or marital status; age; physical or mental disability; citizenship; political affiliation; medical condition (including family and medical leave); domestic violence victim status; past, current or prospective service in the Canadian uniformed service; Canadian Military/Veteran status; pre-disposing genetic characteristics or any other characteristic protected under applicable provincial employment legislation.   

Accommodation for applicants with disabilities is available upon request in connection with the recruitment process and/or employment/partnership. RSM is committed to providing equal opportunity and reasonable accommodation for people with disabilities. If you require a reasonable accommodation to complete an application, interview, or otherwise participate in the recruiting process, please call us at 800-274-3978 or send us an email at [email protected].

At RSM, an employee’s pay at any point in their career is intended to reflect their experiences, performance, and skills for their current role. The salary range (or starting rate for interns and associates) for this role represents numerous factors considered in the hiring decisions including, but not limited to, education, skills, work experience, certifications, location, etc. As such, pay for the successful candidate(s) could fall anywhere within the stated range.

Compensation Range: $59 - $89 per hour

Top Skills

Ai Tools
Ai-Enabled Tools
Excel
Structured Tracking Tools
Word

Similar Jobs

An Hour Ago
In-Office
Ottawa, ON, CAN
Mid level
Mid level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
The role involves designing and developing Cloud Native Control-Plane functions, ensuring operational performance, and collaborating in a DevOps environment with a focus on SRE principles.
Top Skills: AWSAzureCi/CdCloud NativeCloud-Based DatabasesDockerGoogle Cloud PlatformGrpcKubernetesRestful ApisTerraform
An Hour Ago
Hybrid
Toronto, ON, CAN
Mid level
Mid level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Associate Engineer - AI position involves designing scalable software systems, developing LLM solutions, collaborating with teams, and ensuring code quality. Responsibilities include utilizing cloud platforms, implementing DevOps practices, and engaging in the entire software development lifecycle.
Top Skills: AWSAzureCloudFormationDatabricksDockerJavaScriptKubernetesNext JsPythonReact JsTailwind CssTerraform
An Hour Ago
Hybrid
Toronto, ON, CAN
Senior level
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Senior Associate Data Engineer designs, builds, and maintains data systems, focusing on efficient data processing and architecture. Responsibilities include optimizing ETL processes, ensuring data quality, and providing technical guidance to junior engineers while collaborating with cross-functional teams.
Top Skills: Apache NifiAWSAzureHadoopInformaticaJavaKafkaPythonScalaSnowflakeSparkTalend

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account