As this book is intended to be a practical guide rather than an academic publication, we took the decision to remove academic references from the text, except where we have directly drawn from specific documents. The following books, articles, reports, blogs and presentations have, over the years, informed the development of ROMA.


APSC (Australian Public Service Commission) (2009) ‘Delivering Performance and Accountability, Contemporary Government Challenges’. Canberra: APSC.


Andrews, M. (2013) The Limits of Institutional Reform in Development: Changing the Rules for Realistic Solutions. Cambridge: Cambridge University Press.


Andrews, M., Pritchett, L. and Woolcock, M. (2012) ‘Escaping Capability Traps through Problem-driven Iterative Adaptation’. Working Paper 299. Washington, DC: CGD.


Bakewell, O. and Garbutt, A. (2004) The Use and Abuse of the Logical Framework Approach. Stockholm: Sida.


Barder, O. (2009) ‘Beyond Planning: Markets and Networks for Better Aid.’ Washington, DC: CGD.


Baser, H. and Morgan, P. (2008) ‘Capacity, Change and Performance.’ Discussion Paper 59B. Maastricht: ECDPM.


Baumgartner, F. and Jones, B. (1993) Agendas and Instability in American Politics. Chicago, Il: University of Chicago Press


Beynon, P. and Fisher C. (2013) ‘Learning about Reflecting on Knowledge: An Approach for Embedding Reflective Practice in an Action Research Team’. Practice Paper In Brief 9. Brighton: IDS.


Bhadwal, S. (2008) ‘Understanding Adaptive Policy Mechanisms through Participatory Irrigation Management in Maharashtra, India’. India: The Energy and Resources Institute.


Booth, D. (2012) ‘Development as a Collective Action Problem: Addressing the Real Challenges of African Governance’. London: Africa Power and Politics Programme.


Brock, J. (2004) ‘Public Management: Where Do We Go from Here? Or, What Do We Know and When Did We Know It?’ Journal of Policy Analysis and Management 23(3): 617-631.


Brondizio, E., Ostrom, E. and Young, O. (2009) ‘Connectivity and the Governance of Multilevel Social-ecological Systems: The Role of Social Capital’. Annual Review of Environment and Resources 34: 253-278.


Brown, V. (2007) ‘Collective Decision-making Bridging Public Health, Sustainability Governance, and Environmental Management’, in C. Soskolne (ed.) Sustaining Life on Earth: Environmental and Human Health through Global Governance. New York: Lexington Books.


Coffman, J. and Reid, E. (2007) ‘Unique Methods in Advocacy Evaluation’. Cambridge, MA: Innovation Network.


CommGAP (2008) ‘Coalition Building’. Washington, DC: World Bank


Collier, D. (2011) ‘Understanding Process Tracing’. Political Science and Politics 44(4): 823-830.


Collier, P. (2007) The Bottom Billion: Why the Poorest Countries Are Failing and What Can Be Done about It. Oxford: Oxford University Press.


Court, J. and Young, J. (2003) Bridging Research and Policy: Insights from 50 Case Studies. London: ODI.


Court, J., Hovland I. and Young, J (2005) Bridging Research and Policy in Development. Rugby: ITDG publishing.


Datta, A. (2011) ‘Lessons from Deliberative Public Engagement Work: A Scoping Study’. Working Paper 338. London: ODI.


Datta, A. (2013) ‘Developing Capacities in Complex Environments – Experiences from Vietnam’. Blog post, Supporting Think Tanks Series. Onthinktanks, 17 June.


de Weijer, F. (2012) ‘Rethinking Approaches to Managing Change in Fragile States’. Boston, MA: Harvard Kennedy School.


Delvaux, B. and Mangez, E. (2008) ‘Towards a Sociology of the Knowledge–Policy Relation’. Knowledge and Policy Project funded by the European Commission within the Sixth Framework Program.


Deprez, S. (2008) ‘Development of a Planning, Learning & Accountability System for Sustainable Agriculture Chain Development in Eastern Indonesia’. Submission to EASY-ECO Conference, Vienna.


Earl, S., Carden F. and Smutylo T. (2001) Outcome Mapping: Building Learning and Reflection into Development Programs. Ottawa: IDRC


Folke, C., Hahn, T., Olsson, P. and Norberg, J. (2005) ‘Adaptive Governance of Socio-ecological Systems’. Annual Review of Environment and Resources 30: 441-473.


Friedrich, C. (1940) ‘Public Policy and the Nature of Administrative Responsibility’. Public Policy 1: 3-24.


Funnell, S.C. and Rogers, P.J. (2011) Purposeful Program Theory. San Francisco, CA: Jossey-Bass.


Gaventa, J. (2006) ‘Finding the Spaces for Change: A Power Analysis’. IDS Bulletin 37(6): 23-33.


Geyer, R. (2006) ‘Is There Anything to Fear from the Politics of Complexity’. Lancaster: University of Lancaster.


Gladwell, M. (2000) The Tipping Point: How Little Things Can Make a Big Difference. London: Abacus Books.


Green, D. (2013) ‘The Limits of Institutional Reform in Development: A Big New Book by Matt Andrews’. Blog post. From Poverty to Power: How Active Citizens and Effective States Can Change the World, 13 May.


Grindle, M. (2004) Despite the Odds: The Contentious Politics of Education Reform. Princeton, NJ: Princeton University Press.


Guijt, I. (2008) ‘Seeking Surprise: Rethinking Monitoring for Collective Learning in Rural Resource Management’. Wageningen: Wageningen University.


Gunderson, L.H. and Holling, C.S. (eds) (2001) Panarchy: Understanding Transformations in Human and Natural Systems. Washington, DC: Island Press.


Haas, P. (1992) ‘Introduction to Epistemic Communities and International Policy Coordination’. International Organization 46(1): 1-35.


Hall, P. (1993) ‘Policy Paradigms, Social Learning and the State: the Case of Economic Policy-making in Britain’. Comparative Politics 25(3): 275-296.


Hallsworth, M. (2011) ‘System Stewardship: The Future of Policy Making?’ Working Paper. London: Institute for Government.


Harris, D. and Wild, L. (2013) ‘Finding Solutions: Making Sense of the Politics of Service Delivery’. London: ODI.


Hatfield-Dodds, S., Nelson, R. and Cook, D. (2007) ‘Adaptive Governance: An Introduction, and Implications for Public Policy’. 51st Annual Conference of the Australian Agricultural and Resource Economics Society, Queenstown, 13-16 February.


Heclo, H. (1978) ‘Issue Networks and the Executive Establishment’, in A. Kind (ed.) The New American Political System. Washington, DC: American Enterprise Institute for Public Policy Research.


Hovland, I. (2005) ‘Planning Tools: How to Write a Communications Strategy’. London: ODI.


Hovland, I. (2007) ‘Making a Difference: M&E of Policy Research’. Working Paper 281. London: ODI.


Hummelbrunner, R. and Jones, H. (2013) ‘A Guide to Planning and Strategy Development in the Face of Complexity’. London: ODI.


Huyse, H. and Ambrose, K. (2009) ‘Considerations for Learning-oriented Monitoring and Evaluation with Outcome Mapping’. OM Ideas 2. Outcome Mapping Learning Community.


Jones, H. (2006) ‘A Defence of Free Will’. Masters Thesis, University of Oxford.


Jones, H. (2009) ‘Policy Making as Discourse: A Review of Recent Knowledge-to-Policy Literature’. Emergent Working Paper. London: ODI and IKM.


Jones, H. (2011a) ‘Taking Responsibility for Complexity: How Implementation Can Achieve Results in the Face of Complex Problems’. London: ODI.


Jones, H. (2011b) ‘A Guide to Monitoring and Evaluating Policy Influence’. Background Note. London: ODI.


Jones, H., Jones, N., Shaxson, L. and Walker, D. (2012) Knowledge, Policy and Power in International Development: A Practical Guide. Bristol: The Policy Press.


Keck, M. and Sikkink, K. (1998) Activists Beyond Borders: Advocacy Networks in International Politics. Ithaca, NY: Cornell University Press.


Kingdon, J. (1984) Agendas, Alternatives and Public Policies. Boston, MA, and Toronto: Little Brown and Company.


Klein, N. (2007) The Shock Doctrine: The Rise of Disaster Capitalism. Toronto: Knopf Canada.


Krznaric, R. (2007) ‘How Change Happens: Inter-disciplinary Perspectives for Human Development’. Research Report. Oxford: Oxfam GB.


Kurtz, C.F. and Snowden, D. (2003) ‘The New Dynamics of Strategy: Sense-making in a Complex and Complicated World’. IBM Systems Journal 42(3): 462-483.


Lasswell, H. (1956) The Decision Process: Seven Categories of Functional Analysis. College Park, MD: University of Maryland Press


Lee, K.N. (1993) ‘Compass and Gyroscope: Integrating Science and Politics for the Environment’, in Guijt (2008).


Leeuwis, C. and Pyburn, R. (2002) ‘Social Learning for Rural Resource Management’, in C. Leeuwis and R. Pyburn (eds) Wheelbarrows Full of Frogs: Social Learning in Rural Resource Management. Assen: Koninklijke Van Gorcum.


Lindquist, E. (2001) ‘Discerning Policy Influence: Framework for a Strategic Evaluation of IDRC-supported Research’. Ottawa: IDRC.


Lipsky, M. (1983) Street-level Bureaucracy. New York: Russell Sage Foundation.


McFarland, D. and Gomez, C. (2013) Organisational Analysis. Stanford, CA: Stanford University.


Mcloughlin, C., with Batley, R. (2012) ‘The Effects of Sector Characteristics on Accountability Relationships in Service Delivery’. Working Paper 350. London: ODI.


Meagher, L.R (2012) Rural Economy and Land Use Programme: Societal and Economic Impact Evaluation. Swindon: ESRC.


Michaels, S. (2009) ‘Matching Knowledge Brokering Strategies to Environmental Policy Problems and Settings’. Environmental Science and Policy 12: 994-1011.


Molle, F. (2008) ‘Nirvana Concepts, Narratives and Policy Models: Insights from the Water Sector’. Water Alternatives 1(1): 131-156.


Mouffe, C. (1992) Dimensions of Radical Democracy: Pluralism, Citizenship, Community. London and New York: Verso.


Natsios, A. (2010) The Clash of the Counter-bureaucracy and Development. Washington, DC: CGD.


Nielson, S. (2001) ‘Knowledge Utilization and Public Policy Processes: A Literature Review, IDRC-supported Research and Its Influence on Public Policy’. Ottawa: IDRC Evaluation Unit.


ODI (Overseas Development Institute) (2012) ‘RAPID Outcome Assessment Guidance Note’. London: ODI.


Ostrom, E. (1990) Governing the Commons: The Evolution of Institutions for Collective Action. Cambridge: Cambridge University Press.


Ostrom, E. (2005) Understanding Institutional Diversity. Princeton, NJ: Princeton University Press.


Pal, G. (2007) ‘Is There a Universal Self-serving Attribution Bias?’ Psychological Studies 52(1): 85-89.


Patton, M. (2008) ‘Advocacy Impact Evaluation’. Journal of MultiDisciplinary Evaluation 5(9): 1-10.


Polanyi, M. (1966) The Tacit Dimension. Chicago, IL: University of Chicago Press.


Pollard, A. and Court, J. (2005) ‘How Civil Society Organisations Use Evidence to Influence Policy Processes: A Literature Review’. Working Paper 249. London: ODI.


Patton, M. (2012) Essentials of Utilization-Focused Evaluation. Thousand Oaks. CA: SAGE Publications, Inc.


PoGo (Politics and Governance Programme) (2012) ‘A Framework for Problem-focussed Political Economy Analysis’. London: ODI.


Pritchett, L., Woolcock, M. and Andrews, M. (2010) ‘Capability Traps? The Mechanisms of Persistent Implementation Failure’. Working Paper 234. Washington, DC: CGD.


Pross, P. (1986) Group Politics and Public Policy. Toronto: Oxford University Press.


Ramalingam, B. and Jones, H., with Reba, T. and Young, J. (2008) ‘Exploring the Science of Complexity: Ideas and Implications for Development and Humanitarian Work’. Working Paper 285. London: ODI.


Reeler, D. (2001) ‘Unlearning – Facing up to the Real Challenge of Learning’. Cape Town: CDRA.


Rogers, E. (2003) Diffusion of Innovations. Fifth Edition. New York: Free Press.


Rogers, P. (2008) ‘Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions’. Evaluation 14(1): 29-48.


Ruitenbeek, J. and Cartier, C. (2001) ‘The Invisible Wand: Adaptive Co-management as an Emergent Strategy in Complex Bio-economic Systems’. Occasional Paper 34. Jakarta: CIFOR.


Sabatier, P. and Jenkins-Smith, H. (eds) (1993) Policy Change and Learning: An Advocacy Coalition Approach. Boulder, CO: Westview Press.


Schiffer, E. (2007) ‘Manual: NetMap Toolbox’. Washington, DC: IFPRI.


Scriven, M. (2008) ‘A Summative Evaluation of RCT Methodology & An Alternative Approach to Causal Research’. Journal of MultiDisciplinary Evaluation 5(9): 11-24.


Shaxson, L. (2009) ‘Making Sense of Wicked Issues: Do Policy-makers Have a Suitable Toolkit?’ Presentation to DEFRA.


Shaxson, L. (2011) ‘Improving the Impact of Development Research through Better Research Communications and Uptake’. Report from AusAID, DFID and UKCDS-funded workshop, London, 29-30 November.


Simon, H.A. (1956) ‘Rational Choice and the Structure of the Environment’. Psychological Review 63(2): 129-138.


Snowden, D. and Boone, M. (2007) ‘A Leader’s Framework for Decision Making’. Harvard Business Review 85(11): 68-76.


Stacey, R. (1993) Complexity and Creativity in Organisations. San Francisco, CA: Berret-Koehler.


Stackowiak, S. (2007) ‘Pathways for Change: 6 Theories of How Policy Change Happens’. Seattle, WA: Organisational Research Services.


Starling, S. (2010) ‘Monitoring and Evaluating Advocacy: Lessons from Oxfam GB’s Climate Change Campaign’. Development in Practice 20(2): 277-286.


Steven, D. (2007) Evaluation and the New Public Diplomacy’. Future of Public Diplomacy 842nd Wilton Park Conference, 2 March.


Stone, D. (1996) Capturing the Political Imagination: Think Tanks and the Policy Process. London: Routledge.


Sundet, G. (2008) ‘Following the Money: Do Public Expenditure Tracking Surveys Matter?’ Bergen: Chr. Michelsen Institute.


Thorpe, S., Fize, D. and Marlot, C. (1996) ‘Speed of Processing in the Human Visual System’. Nature 381: 520-522.


van Eeten, M. (1999) ‘“Dialogues of the Deaf” on Science in Policy Controversies’. Science and Public Policy 26(3): 185-192.


Vogel, I. (2012) ‘Review of the Use of “Theory of Change” in International Development’. London: DFID.


Watson, S. and Pierce, J. (2008) ‘Monitoring Policy Dialogue: Lessons from a Pilot Study’. Evaluation Report WP27. London: DFID.


Weiss, C. (1977) ‘Research for Policy’s Sake: The Enlightenment Function of Social Research’. Policy Analysis 3(4): 531-545.


Wilson, J. (1980) ‘The Politics of Regulation’, in J. Wilson (ed.) The Politics of Regulation. New York: Basic Books.


Young, E. and Quinn, L. (2012) Making Research Evidence Matter: A Guide to Policy Advocacy in Transition Countries. Budapest: Open Society Foundations.


Young, J. and Mendizabal, E. (2009) ‘Helping Researchers Become Policy Entrepreneurs’. Briefing Paper. London: ODI.