Source · Select Committees · Public Accounts Committee

Recommendation 3

3

No single body is responsible for upholding modelling and evaluation standards and monitoring their implementation.

Recommendation
No single body is responsible for upholding modelling and evaluation standards and monitoring their implementation. Within departments, ultimate responsibility for upholding standards and securing improvements lies with that department’s accounting officer. Supporting the accounting officer, the departmental directors of analysis own the application of the Analysis Functional Standard in their departments. Neither HM Treasury nor the Analysis Function 6 Use of evaluation and modelling in government currently monitor if accounting officers are discharging their responsibilities nor how well standards have been upheld. While HM Treasury is an important user of departments’ models, it does not comprehensively scrutinise and challenge a department’s quality assurance arrangements for the models it uses. To address this gap the Analysis Function intends to strengthen the governance framework for the Analysis Functional Standard, including introducing a self-assessment framework to assess performance against the standard. The Function told us it believes it does not currently have enough resources for this, but intends to request additional funding from HM Treasury. Recommendations: The Analysis Function, under the responsibility of the UK Statistics Authority, should: • put in place an appropriate assessment framework to monitor departments’ implementation of the Analysis Functional Standard; • act on areas for improvement identified through its assessment framework; and • agree with HM Treasury the funding it will provide for these roles. HM Treasury should set out how it plans to gain confidence that the outputs it uses from departments’ business critical models have been quality assured appropriately.
Government Response Not Addressed
HM Government Not Addressed
3.1 The government agrees with the Committee’s recommendation. Target implementation date: March 2023 3.2 The Government Analysis Function is currently in the process of piloting the assessment framework which will allow departments to monitor their implementation of the Analysis Functional Standard. Piloting will ensure the framework will help departments to understand what is working well and where changes are needed. The aim is to finalise the framework over the Summer 2022, so that departments will have sufficient time to conduct the assessment during the remainder of the financial year. 8 3.3 Departments will be asked to identify what changes they are planning to make based on the feedback from the assessment framework by the end of 2022-23, so that the Government Analysis Function can monitor the impact that the Framework is having and understand where further action may be required. 3.4 Working with HM Treasury, and reflecting on the recommendations from the Committee, the ONS is considering the future scope of the Analysis Function and the work it undertakes to support wider government analytical capability. 3.5 HM Treasury will also build on its current training offer and ensure that staff who use outputs from other departments are able to confidently assure that these outputs have been quality assured with modelling standards consistent with the Aqua Book and Analysis Functional Standard.