Over the past several months, I have been working to gather information to support OUSA’s upcoming policy paper on accountability. I’ve been sifting through data, position papers, and accountability policy over the course of the last two months, and I’m excited to share my perspective as well as some preliminary findings in this post.
In principle, accountability mechanisms in the university sector exist in order to ensure that publicly funded institutions are adhering to public goals and priorities. The question of whether or not institutions should be held to such ends is relatively uncontroversial; virtually every stakeholder agrees that there should be some sort of meaningful accountability mechanism in place. How those mechanisms take shape, however, has been the subject of vigorous debate within the sector.
As far as I’ve been able to gather, there are two questions around which the debate seems to focus. First, for what should universities be held accountable? Universities fill a variety of different roles that differ between and within institutions. Moreover, these roles are valued differently across the sector. The current government, for example, is interested in economic return on its investment and ensuring that students can get jobs after graduation. Faculty associations tend to take a different perspective, placing more emphasis on the development of students as critical thinkers and engaged citizens. Ultimately, the indicators that governments require institutions to track will need to account for this variety of perspectives.
While the first question is theoretical in nature, the second question is more technical. Once the measures of accountability are decided, how are we to hold the universities accountable? In other words, how can we measure a given institution’s progress toward achieving public goals? This question requires us to conceptualize our accountability mechanisms such that they might be meaningfully and significantly measured. This is no small task, in large part because the various mandates of our public universities are enormously complex and not easily quantifiable. For example, how can critical thinking be accurately measured and reported? There are some promising practices in place in peer jurisdictions – for example, the Collegiate Learning Assessment in the US – but no one tool can accurately capture critical thinking in all its complexity.
Nor are labour market outcomes easily quantifiable. As part of the current accountability framework, for example, all universities are required to report seven-year graduation rates, employment rates, and OSAP default rates. These rates are known as Key Performance Indicators (KPIs). The first two of these indicators are tied to performance funding for the institutions. Universities must meet a benchmark of at least 10% below the sector average in order to be eligible for the funding; if eligible, their funding is calculated using a formula that takes both their performance and relative size into account. However, this fund has been decreasing as a proportion of total operating funding since its inception; in 2010-2011, performance funding comprised 0.7% of total Ministry funding.
Moreover, the current KPIs are meant to show prospective students their chances of finding employment after graduation, but end up painting a misleading picture. While they provide employment statistics both 6 months and two years after graduation, they provide no information about the type of work the graduate is doing, if the graduate is overqualified for this work, nor their salary, three factors which would be of interest to students hoping to evaluate a return on their investment in post-secondary education. As such, there is reason to question the extent to which KPIs serve as effective tools to keep universities accountable for these labour market objectives.
Another tool used to hold universities accountable is dedicated funding, consisting of enveloped funds for particular initiatives. Dedicated funding comprises approximately 15% of total Ministry funding to universities, and funds specific initiatives such as Aboriginal action plans, grants for safety on campus, and grants to support credit transfer infrastructure. Envelopes are structured and dispersed differently (with different reporting requirements), but each is targeted for a specific purpose. This approach has an intuitive appeal: set priorities, and then provide the funds for those priorities to be carried out directly. However, the consequence of partitioning funding is that there is less discretion and flexibility on the part of university boards to react to the unique needs of their institution. Envelope funding, like all measures, cannot be viewed as a panacea to the challenge of university accountability.
Thus far the debate has been limited to the above questions. There is a third question, however, which has been largely glossed over: To whom should universities be held accountable? The answer has been so far assumed: since the public funds universities, universities must be held accountable to the public. The government serves as the public’s representative in this formulation of accountability. But if all those who fund institutions are those to whom institutions must be held accountable – you get what you pay for, so to speak – then there is no reason that institutions should not also be held accountable to their students. Tuition fees have risen exponentially in the last two decades, now comprising upwards of 45% of operating funding. And yet there has been no serious discussion about how universities can be held accountable in equal measure to the public at large and to their students. As the government embarks on re-negotiating its Multi-Year Accountability Agreements and on negotiating new institutional mandate agreements, this paper will hopefully explore different models of accountability in hopes of helpfully engaging in this dialogue.
In sum: there are three questions which should guide sector discussions of accountability. They are:
- To whom should universities be held accountable?
- For what should universities be held accountable?
- How should universities be held accountable for the above?
This paper shall seek to provide a student perspective on each of the three questions in turn.
-Chris Rudnicki
OUSA Research Intern