Research Brief
The intention of this research is to identify appropriate approaches to the monitoring and evaluation (M&E) of international police capacity building operations of the Australian Federal Police. Whilst the AFP has a long history of involvement in offshore policing initiatives, the recent development of the International Deployment Group (IDG – section within the AFP structure) facilitates for the first time a dedicated unit for offshore policing. Given the temporary and reactive nature of previous deployments, the AFP has so far not developed a comprehensive performance management framework and is in the process of addressing this need.
Capacity building operations are notoriously difficult to measure. Therefore, establishing meaningful and effective performance management frameworks, indicators, and general measurements of ‘success’ in relation to capacity building is crucial as it impacts upon the approach and consequent effectiveness of capacity building itself. Poorly designed indicators can potentially undermine the process of capacity building as they can reduce local ownership, distort behaviour and divert resources. Concepts of success and the manner in which it is measured impacts upon funding arrangements, international standing and legitimacy, short and long-term stability and security – both regionally and ‘in country’, and have an enormous impact upon the lives of citizens within partner countries as well as their system of governance.
This area of research is particularly interested in the ‘soft issues’ of capacity building, participatory approaches and the manner in which performance management can contribute to or potentially undermine local ownership and will. The initial stages of this research will provide a comprehensive literature review on the subject of performance management indicators and monitoring and evaluation processes, particularly in the field of policing, international policing and capacity building. The literature review will also include a summary of international exogenous police capacity building operations, in the interests of providing an understanding of operational context.
This research will look at the current approaches of leading development agencies and the security sector reform (SSR) and capacity building strategies of the United Kingdom, United States, Canada, European Union (as well as Europe generally) and the African Union. Included in the literature review will be the research findings of academic institutions, think tanks and working groups on the subject of performance management, SSR and capacity building generally.
A comparative analysis between current AFP/IDG practice and international trends will be undertaken, locating the IDG in an international context. A primary source document analysis will be conducted to assess and analyse current reporting requirements of the AFP, and the IDG in particular. This document analysis will include external reporting and accountability requirements such as Portfolio Budget Statements and Annual Reports (including budget submissions etc), as well as internal monitoring and evaluation processes in relation to past and current mandate specific operations. Case studies too will be utilised for this purpose – addressing ‘in country’ public perceptions, partner governments priorities and the attitudes and opinions of relevant regional bodies (ie. Pacific Island Forum). External and independent reports and assessments in relation to operation performance will also be taken into consideration.
Interviews, consultation and working group discussions are proposed in the interests of gaining further insight into current practices, perceived problems and potential recommendations for improvements. Such interviews will include (but not limited to) Australian Government officials – primarily AFP personnel and AusAID representatives, as well as police officers operating in the field (including those members from participating Pacific Island police forces).
Drawing from the above research findings, draft performance management indicators and processes for monitoring and evaluation will be developed. Such indicators will be tested through field trips and case studies. Further refinement and re-evaluation will be conducted in light of field-testing results. The final thesis will make recommendations for monitoring and evaluation processes and performance management indicators in international police capacity building operations.