This box is not visible in the printed version.
The principles that we and the Advisory Board for Safer Gambling (ABSG) think should be included in evaluations of multi-operator self-exclusion schemes.
Published: 17 May 2021
Last updated: 1 November 2021
This version was printed or saved on: 2 December 2023
Online version: https://www.gamblingcommission.gov.uk/licensees-and-businesses/guide/multi-operator-self-exclusion-schemes-moses-evaluation-and-impact-assessment
These principles set out the features that we, and the Advisory Board for Safer Gambling (ABSG) consider should be included in effective evaluations of multi-operator self-exclusion schemes.
We have developed the principles with the National Responsible Gambling Strategy and the Evaluation Protocol in mind to support those that administer the schemes when they commission evaluation in this area.
We expect that those undertaking an evaluation will devise a methodology that is consistent with these principles. They are subject to revision in the light of new information, including experience from pilots.
These principles cover how the sample for interviews should be sourced, how reflective it should be of the scheme user population as a whole, and how data should be analysed and refreshed.
Interview sample should be as representative as possible of all scheme users Schemes should have an option for individuals to be re-contacted for research purposes. This option is presented at the end of the registration process and it is made clear to customers that it is fine for them to say no (this is an example of an approach that could be piloted).
Data should be extrapolated and weighted where scheme user information is available. Sample size for interview needs to be sufficiently robust to allow for this.
Data should be refreshed following initial impact assessment to provide an assessment of scheme impact over time.
These principles are designed to safe-guard the scheme user as far as possible and ensure the interview is not an uncomfortable experience for them.
Research should be conducted according to established ethical standards for social research, having regard to the specific circumstances of the gambling sector. To support this, we will establish an expert group to provide advice and oversight about methods and ethics.
Researchers should only conduct interviews when they have obtained informed consent.
Telephone interviews should be the preferred approach, with consideration given to how best to administer sensitive questions.
Researchers should state at the start of the interview that if respondents do not wish to answer any questions they do not have to.
Researchers should advise the respondent that if they want to talk to anyone further about any of the issues raised they can contact a range of support agencies, and signpost the respondent to these if they are interested.
These principles set out what data needs to be fed into the impact evaluation to ensure it is robust:
During a discussion with ABSG, we also identified a number of areas of interest which are not core to conducting a robust impact evaluation but could be valuable to understand further: