Office of Strategic Value, Transformative Outcomes, and Evidentiary Imagination
Executive Summary
The University is committed to demonstrating the profound impact of its activities across research, teaching, engagement, innovation, and institutional transformation.
However, recent discussions have highlighted a significant challenge:
Many of the University’s most important impacts cannot be easily measured.
Rather than accepting this limitation, the University has developed a new framework to ensure that all unmeasurable impacts can be appropriately measured through advanced interpretive methodologies.
Introducing:
The Framework for Measurably Unmeasurable Impact (FMUI)
1. The Problem of Measurement
Traditional measurement approaches have historically focused on measurable outcomes.
While useful, this approach fails to capture:
subtle influence,
emergent significance,
transformative resonance,
and impacts that have not yet occurred but may eventually become important.
The FMUI addresses this gap by recognising that some impacts are too valuable to measure directly.
They must therefore be measured indirectly through indicators of their possible existence.
2. Categories of Impact
The University now recognises five primary impact categories.
Category One: Visible Impact
Impact that can be demonstrated through:
numbers,
outputs,
outcomes,
evidence.
This category remains important but is considered incomplete.
Category Two: Invisible Impact
Impact that cannot currently be observed but is believed to exist.
Evidence may include:
stakeholder confidence,
institutional narratives,
perceived momentum,
strategic alignment.
Category Three: Emergent Impact
Impact that has not yet happened but is expected to arise through future conditions.
Assessment criteria include:
plausibility,
optimism,
narrative coherence.
Category Four: Transformative Impact
Impact so significant that conventional measurement frameworks are considered inadequate.
Successful identification requires demonstrating that:
"Something meaningful appears to be happening."
Category Five: Absence of Impact
The impact generated by deciding not to pursue activities that may have produced undesirable impacts.
This category is currently under review.
3. The Impact Measurement Process
All units seeking to demonstrate impact must complete the:
Unquantifiable Value Assessment Matrix (UVAM)
The UVAM requires applicants to assess:
| Question | Response Required |
|---|---|
| What impact occurred? | Narrative description |
| How do we know? | Interpretive evidence |
| Can it be measured? | If yes, explain why this is insufficient |
| If not measurable, how significant is it? | Substantive reflection |
4. The Impact Confidence Index
To ensure consistency, all claims of impact will receive an Impact Confidence Index (ICI).
Scores range from:
ICI 1:
"We have evidence."
to
ICI 5:
"We have a strong feeling supported by extensive strategic reflection."
ICI 5 is considered the preferred level for transformative initiatives.
5. Impact Dashboards
A new Impact Dashboard will provide real-time visibility of institutional impact.
Metrics will include:
degree of stakeholder resonance,
depth of engagement,
strength of narrative alignment,
potential for future significance,
emotional sustainability of outcomes.
A traffic-light system will be used:
Green: Impact evident.
Amber: Impact emerging.
Blue: Impact conceptually significant but empirically unavailable.
Purple: Impact exceeds current measurement paradigms.
6. Reporting Requirements
Annual impact reports must include:
Quantitative evidence where available.
Qualitative evidence where possible.
Interpretive evidence where necessary.
Confidence that the absence of evidence does not indicate absence of impact.
7. Managing Negative Findings
Occasionally, evaluation may fail to identify measurable impact.
This should not be interpreted as failure.
Possible explanations include:
impact has not yet emerged;
impact emerged but was insufficiently recognised;
impact occurred at a level beyond conventional detection;
measurement itself created barriers to impact visibility.
All four possibilities should be explored equally.
8. Conclusion
The University remains committed to demonstrating meaningful impact.
The FMUI ensures that activities which generate measurable outcomes can be recognised alongside activities whose outcomes are:
developing,
anticipated,
intangible,
transformational,
or awaiting suitable conceptual frameworks.
In this way, the University can confidently demonstrate that its impact is not limited by what can be measured.
Indeed:
The inability to measure impact should never prevent us from evidencing it.
Appendix A
Following publication of this framework, several stakeholders requested clarification regarding the distinction between impact and the appearance of impact.
A Working Group has been established to explore whether this distinction represents:
an important analytical category,
an unnecessary binary,
or an opportunity for further impact generation.
The Working Group’s impact will be assessed using the FMUI framework.