Group of Eight Quality Verification System (Go8 QVS)

In the context of the changing higher-education regulatory environment, which will be proportionate and risk-based, the Go8 Vice-Chancellors have agreed to introduce "a process of external, discipline-led, academic peer review of final year undergraduate student outcomes, in each program or majors of large programs, at all levels of achievement across Go8 institutions".

The Go8 QVS is to provide public assurance and confidence that learning outcomes are comparable across grades and in line with world leading universities. The process will promote discussion on best practice in teaching and learning across institutions and improve cross institutional understanding. The primary focus of the QVS is to assist Go8 universities in maintaining and improving their academic standards.

Reviewers are required to be senior academics (at Level D or above), who are of high academic standing and who have a good understanding of assessment practices.

The key features of the Go8 QVS include:

• a focus on assessment in a sample of final year subjects in undergraduate programs;
• benchmarking for comparing grades awarded in similar programs across Go8 universities;
• senior discipline-specific academics will conduct the review and will have an understanding of academic standards in similar universities around the world; and
• flexibility to complement other quality assurance mechanisms within Go8 universities.

More information [staff only] is contained in the Guidelines or view a presentation by the Go8.

2011 Pilot

The Go8 QVS was piloted in 2011, during which each Go8 university participated in the review of two or more of the following fields of education during semester 1: Physics, History, Psychology, Accounting and Chemistry. The table below shows 2011 reviews by university and field of education.

Table 1.  QVS reviews by university and field of education, 2011 pilot

UWA	Monash	Melbourne	Adelaide	ANU	Sydney	UQ	UNSW
Physics	Physics	Physics	Physics	Physics
History		History	History	History	History	History	History
Psychology					Psychology
Accounting	Accounting	Accounting			Accounting	Accounting	Accounting
					Chemistry	Chemistry

The disciplines reviewed in 2011 at the University of Adelaide (UA) were History (2 courses) and Physics. A stratified random sample of 5% of student assessment for each of these courses was verified by reviewers at another Go8.

The 2011 pilot found that academic standards were comparable across Go8 universities.  An analysis of the fit between grades actually awarded and grades deemed appropriate by reviewers found a close match, with relatively few assessment items being marked above or below the levels that reviewers deemed appropriate.

Regarding the effectiveness of the QVS at monitoring and maintaining standards, reviewers' comments were mostly positive, though several noted that it would be premature to make an informed, final judgement at this early stage in the project's life.

Among the features of the QVS identified as the 'best aspects' of the project by reviewers were:

• its basic administrative properties (flexibility – including choice of units etc for review, and timing and scope; the 'openness' of the process; limited administrative burden; small sample of work to examine; efficient use of electronic forms);
• its reliance on academic expertise and judgement; and – most importantly –
• its contribution to reflection and discussion on teaching and learning practice.

Go8 QVS in 2012

The viability and effectiveness of the Go8 QVS project was demonstrated through the 2011 pilot and as a result the Go8 determined to continue the process in 2012. It was resolved at the meeting of the Go8 Academic Policy Committee held 6 March that the discipline fields be expanded this year to include: Physics, History, Psychology, Accounting, Chemistry, Economics and Philosophy. The following disciplines at the University will be participating this year:

• Accounting
• Chemistry
• Economics
• Philosophy
• Psychology.

Go8 QVS at the University of Adelaide

View project outcomes data. (UA staff only)

Learning and Quality Support (LQS) staff have met with the disciplines to be included in the 2012 QVS. These disciplines have nominated the course or courses to be reviewed and will be copying and de-identifying an appropriate sample of student assessment throughout the review period. LQS will forward these sample assessments and supporting material to the reviewing institution selected by the Go8.

In 2011, there was agreement with the grades awarded for Physics and one of the History courses reviewed. The other History course reviewed attracted some difference of opinion, mainly where the reviewer believed the grades awarded for research essays was too high. It should be noted that History courses at the University are designated as advanced level (level 2 or 3) and a course might therefore be undertaken by a majority of second year rather than final year students.

Contacts

For additional information on the Go8 QVS at the University of Adelaide please email:

• Ms Kim Davidson, Director, Learning and Quality Support, or
• Ms Jess Raeburn, Learning and Quality Support Officer.