Evidence and Evaluation

Pre-conference workshops

31 August – 1 September 2009

A series of high quality workshops are planned for the Monday and Tuesday proceeding the main period of the conference. Workshops will focus on developing particular evaluation knowledge, techniques and practices aiming to:

Full Day Workshop Registration – entitlements apply to day of attendance only

Half Day Workshop Registration – entitlements apply to day of attendance only

Minimum and maximum numbers for workshops attendees applies to each workshop. Workshops will only go ahead if minimum numbers are reached by Monday 3 August 2009. Should a workshop be cancelled a refund will be made unless you attend an alternative workshop. Please indicate your first and second preference workshops on the registration form. 

Workshop Information

Monday 31 August – Full Day workshops

8.30am – 4.30pm

$390 member / $533 non-member 

Workshop A

Problem solving in program evaluation through effective negotiation

Anne Markiewicz

This workshop provides participants with an overview of the political and stakeholder influenced context of evaluation. It presents a model for problem solving developed specifically for the evaluation context based on principles of negotiation. This model provides a useful framework for understanding the challenges, resolving conflict, and most importantly, achieving a credible evaluation. 

Workshop B

Using photographs in evaluation: Data collection, reporting and empowerment

Associate Professor Rosalind Hurworth, Dr Pamela St Leger, Diane McDonald, Deborah Rodes

This workshop will demonstrate how photography has enhanced data management and reporting in education, health, urban development, international development, and tourism projects. Participants will explore visual techniques such as photo-interviewing, photo-elicitation, reflexive photography, and photo-language. There will also be opportunities for discussion about how photography can be used in evaluation.Participants are encouraged to bring a digital still camera. 

Monday 31 August – Half Day Workshops

$210 member / $353 non-member 

AM: 8.30am – 12.30pm

Workshop C - Due to unforeseen circumstances, Workshop C has been cancelled.

 

Workshop D

Developing reliable and valid questionnaires

Dr Zita Unger

Reliable and valid questionnaires are central to quality data and confidence in evaluation results. This workshop is designed for people responsible for developing surveys or those wishing to extend their experience with item construction. Enjoy an engaging, practical, “how to” session with plenty of exercises and discussion. 

Workshop E

Establishing a Counterfactual – Evaluation for policy making

Dr Philip Davies

This workshop will review different methods for determining the likely impact of a policy initiative compared with pursing an alternative policy, or doing nothing at all. It will cover randomised controlled trials, regression discontinuity analysis. Matched comparison designs, difference-of-differences and interrupted time series analysis. Examples will be given. 

PM: 1.30pm – 5.30pm

Workshop F

Using social network diagrams in evaluations and action research: A hands-on introduction

Associate Professor Malcolm Alexander

Social Network Analysis (SNA) explores intra-organisational settings and wider networks of human connectivity. This workshop explains principles for collecting network data, presenting network diagrams and calculating metrics. I locate SNA within a mixed methods framework and discuss possible applications in process and ‘science-based’ evaluations. Demonstrations use NetDraw (free from www.analytichech.com)Participants are requested to bring their own laptop with NetDraw loaded if possible. 

Workshop G - This workshop is now full

Using multiple approaches to needs analysis to provide evidence of program effectiveness

Jerome Winston

Participants demonstrate how conventional definitions of program effectiveness encourage “goal displacement” and “data gaming”. Participants then develop skills in using alternative approaches to reporting program effectiveness by applying Australian and international frameworks that link needs analysis, program effectiveness and evaluation of program objectives and targets. Needs analysis workbook is provided.  

Tuesday 1 September – Full Day workshops

8.30am – 4.30pm

$390 member / $533 non-member 

Workshop I

Concept mapping for evaluation: A mixed methods, participatory approach

Mary Kane, Dr William Trochim

Concept mapping is a well-tested, mixed methods methodology that integrates familiar qualitative group processes with multivariate statistical analyses to help a group describe and organise its thinking on a topic. Through lectures and practical applications, this workshop will introduce key principles of stakeholder participation in planning and evaluation. 

Workshop J

Advanced applications of program theory

Dr Stewart Donaldson

Lecture, exercises, and discussion will help you to develop and use program theory to gather credible and actionable evidence in evaluation practice, and to facilitate the engagement of diverse stakeholder groups. New cases and examples of technology enhanced interactive conceptual frameworks displaying theories of change will be presented and discussed. 

Workshop K

The use of participatory methods for research and advocacy on violence against women

Dr Mary Ellsberg

This full day workshop will present an overview of participatory techniques for researching sensitive topics. Participants will learn about a wide variety of tools, gain an understanding of the specific methodological and ethical considerations for using participatory methods, and have an opportunity to practice and adapt tools for specific circumstances. 

Workshop  L- This workshop is now full

Making MERI: How to build a monitoring, evaluation, reporting and improvement (MERI) framework

Dr Jessica Dart, Kate Nichols 

Increasingly, organisations are asking managers to develop monitoring and evaluation plans, collect evidence and demonstrate impact. The objectives of this workshop are to introduce participants to a practical learning-focused approach to developing a monitoring and evaluation framework, with an emphasis on program logic, evaluation questions, mixed-methods design and effective reporting strategies. 

Workshop M - This workshop is now full

Using purposeful program theory and logic models for evidence-based policy and practice

Professor Patricia Rogers

Tuesday 1 September – Half Day Workshops

$210 member / $353 non-member 

AM: 8.30am – 12.30pm

Workshop H

Improving survey quality: Assessing and increasing survey reliability to improve quality of evidence

Dr Amy Germuth

The purpose of the workshop is to help participants improve the reliability of surveys by a) developing better survey questions, b) understanding issues related to response options, and c) learning how to assess survey reliability using factor analysis and Cronbach’s alpha. 

Workshop N

An introduction to the Most Significant Change (MSC) technique

Tracey Delaney 

PM: 1.30pm – 5.30pm

Workshop O

Applying responsive evaluation techniques to support program delivery

Dr John Owen

The aims of this workshop are for participants to; come to grips with a protocol for undertaking responsive evaluations, understand some basic concepts underlying this protocol, and gain knowledge of some key techniques for using the protocol. The workshop will be pitched at participants who are responsible for managing program delivery and/or have some knowledge of evaluation fundamentals.