Monash University
Evaluating the creative impact of a prototype workshop kit
Paper Giant worked with Monash University to help them evaluate the Portable Art Connections Toolkit (PACT). PACT is an artkit designed by Monash researchers for use in facilitated sessions with young people interested in creative activities.
Outcomes
A theory of change that outlines Monash’s ultimate goal and the pathways that will lead to it
An evaluation framework with questions designed to measure progress against desired outcomes
A set of survey questions to be sent out to people who ordered the artkit
Services
- Social innovation
- Monitoring and evaluation
Sectors
Defining and evaluating success
In collaboration with Monash researchers over a series of workshops and engagements, we developed a Theory of Change by identifying both the project’s ultimate goal and intermediate outcomes that would show it was on the right path.
Paper Giant helped the researchers develop an evaluation strategy for PACT. We developed a set of evaluation questions aligned with the project’s key desired outcomes, along with hypotheses about how the artkit can be used.
The evaluation framework includes details on both how the artkit will contribute to each key outcome, and how Monash can determine when that outcome has been reached.
A set of instructions for the kit that was created as part of the project
Collecting data
We worked with Monash to develop ways to test whether the prototype was effective. We identified supporting evidence and assumptions to test along the change pathways, then prioritised outcomes and hypotheses to include in the evaluation strategy. We used these to develop a survey for facilitators to use as the main evaluation method for the pilot.
The survey responses can be analysed and used to establish:
- Types of artkit users
- Barriers to use
- Process and impacts of use
We included suggestions for data collection methods, and other useful data that could be collected apart from the survey.
