Skip page header and navigation

Quality Metrics pilot

About Quality Metrics

Quality Metrics was a pilot project that used self, peer and public assessment to capture the quality of art and cultural work.

The Quality Metrics are a set of statements, developed by arts and cultural organisations. During the Quality Metrics Pilot they helped organisations understand what people value about their work, as well as allowing them to benchmark against similar organisations. They are open source and free for anyone to use.

The core quality metrics

Self, peer and public:

  • Concept: it was an interesting idea
  • Presentation: it was well produced and presented
  • Distinctiveness: it was different from things I’ve experienced before
  • Challenge: it was thought-provoking
  • Captivation: it was absorbing and held my attention
  • Enthusiasm: I would come to something like this again
  • Local impact: it is important that it’s happening here
  • Relevance: it has something to say about the world in which we live
  • Rigour: it was well thought through and put together

Self and peer only:

  • Originality: it was ground-breaking
  • Risk: the artists/curators really challenged themselves
  • Excellence: it is one of the best examples of its type that I have seen
Read next section

Quality Metrics pilot

The Quality Metrics were developed through two pilots, led by arts and cultural organisations and supported with funding from the Arts Council.

The first pilot was led by eight cultural organisations from Manchester. It focused on developing the framework, testing the concept, and formulating an initial set of metrics. Download the reports from this pilot below.

The second pilot was funded by Nesta, the Arts Council and the Arts and Humanities Research Council. The application requested funding towards a national pilot to further develop the metrics, the online platform and the technology that supports them.

Read previous section
Read next section

National testing

Testing the Quality Metrics

150 of our National Portfolio Organisations and Major Partner Museums signed up to test the Quality Metrics in 2015/16.

400 evaluations were completed over the course of the trial, with 20,000 audience responses, 1,035 peer responses and 1,357 self-responses.

You can read about the trial and experience of participating organisations on the project website.

Download the reports and independent evaluation below and read our response to find out about our future intentions for the work.

Aggregated dataset

The project produced a large aggregate dataset, which was analysed and results published in the Quality Metrics National Test Report.

An anonymised version of the dataset is available to download below. For the purposes of anonymity, some of the detail in the raw data set has been excluded.

The dataset has been provided to enable interested parties to explore the findings from the trial beyond the analysis provided in the report.

Culture Counts have produced an introductory guide to using the data, which you can download below. Arts Council England is unable to provide further support for those wishing to interrogate the data.

Read previous section
Read next section

Participatory metrics

Metrics for participatory work

Alongside the Quality Metrics, we are continuing to support the sector to develop a set of participatory metrics.

The aim is to develop a set of metrics suitable for all participatory work, which closely align with our Quality Principles to ensure they are suitable for work by, with and for children and young people.

Download the reports from the two participatory metrics pilots below. 

Children and young people

Our Quality Principles project aims to increase the quality of work by, with and for children and young people. Click the link below to find out more.

Read previous section
Read next section

Language testing

Arts Council England commissioned Shared IntelligenceThe Mighty Creatives and Sarah Pickthall to test the understanding and appropriateness of the Quality and Participatory Metric statements amongst diverse groups.

The report found that the majority of statements were well understood by people in all groups and offers suggestions for alternate statements and considerations when working with particular groups.

Download the report below.

Read previous section
Read next section

Next steps

In January 2018 we advertised an invitation to tender for a supplier to use the principles of the Quality Metrics framework to develop and implement a toolkit. In September 2018, the Impact and Insight Toolkit will begin rolling out to our National Portfolio Organisations.  This toolkit will provide National Portfolio Organisations and the Arts Council with insight into what audiences, participants, peers, artists and creative practitioners think about the work being produced across the national portfolio.

Read previous section