- Title
- When rating systems do not rate: evaluating ERA's performance
- Creator
- Henman, Paul; Brown, Scott D.; Dennis, Simon
- Relation
- Australian Universities' Review Vol. 59, Issue 1, p. 58-68
- Relation
- http://www.aur.org.au/archive
- Publisher
- National Tertiary Education Union
- Resource Type
- journal article
- Date
- 2017
- Description
- In 2015, the Australian Government’s Excellence in Research for Australia (ERA) assessment of research quality declined to rate 1.5 per cent of submissions from universities. The public debate focused on practices of gaming or ‘coding errors’ within university submissions as the reason for this outcome. The issue was about the in/appropriate allocation of research activities to Fields of Research. This paper argues that such practices are only part of the explanation. With the support of statistical modelling, unrated outcomes are shown to have also arisen from particular evaluation practices within the discipline of Psychology and the associated Medical and Health Sciences Research Evaluation Committee. Given the high stakes nature of unrated outcomes and that the evaluation process breaches public administration principles by being not appealable nor appropriately transparent, the paper concludes with recommendations for the strengthening ERA policy and procedures to enhance trust in future ERA processes.
- Subject
- higher education policy; universities; research performance; performance assessment; performance measurement; Excellence in Research for Australia; ERA; Australian Research Council; ARC; public administration
- Identifier
- http://hdl.handle.net/1959.13/1399823
- Identifier
- uon:34682
- Identifier
- ISSN:0818-8068
- Language
- eng
- Full Text
- Reviewed
- Hits: 2378
- Visitors: 2462
- Downloads: 203
| Thumbnail | File | Description | Size | Format | |||
|---|---|---|---|---|---|---|---|
| View Details Download | ATTACHMENT02 | Publisher version (open access) | 573 KB | Adobe Acrobat PDF | View Details Download |