Auditing machine learning algorithms

A white paper for public auditors

by the Supreme Audit Institutions of Finland, Germany, the Netherlands, Norway and the UK

27 april 2023

Abstract

This paper discusses audits of machine learning (ML) algorithms by Supreme Audit Institutions (SAIs). The paper aims to help SAIs and individual auditors to perform audits on ML algorithms that have been applied by government agencies. It is designed for auditors with some knowledge of quantitative methods. Expert level knowledge of ML-models is not assumed.

We include an audit catalogue - a set of guidelines including suggested audit topics based on risks, as well as methodology to perform audit tests. The paper is accompanied by an Excel helper tool that sums up and guides through different parts of the audit.

---

First version: 14.10.2020. auditingalgorithms.net is maintained by The Office of the Auditor General of Norway (Riksrevisjonen). For inquiries, please contact machinelearning@riksrevisjonen.no.