Evaluating Public Policy in Practice: A Critical Systematic Literature Review of Methods, Trends, and Gaps, from 2015 to 2023
DOI:
https://doi.org/10.33701/jtp.v17i1.5166Keywords:
Public Policy Evaluation, Systematic Literature Review, Policy Evaluation Methods, PRISMAAbstract
This study conducts a systematic literature review of recent developments in policy and program evaluation from 2015 to 2023, examining methods, approaches, challenges, and future research directions. Following PRISMA guidelines, a search of the Scopus and Science Direct databases yielded 58 relevant articles. Key findings indicate a shift towards mixed-methods approaches, agent-based simulation, and stated preference techniques, although studies predominantly originate from developed countries and focus on social, environmental, and health issues. Bibliometric analysis shows that 62.9% of the articles appeared in Scopus Q1 journals. Evaluation effectiveness is significantly influenced by internal factors (e.g., program design, data quality) and external factors (e.g., political context, financial support). While evaluations impact decision-making and policy improvement, challenges remain in utilizing and generalizing results. Crucially, this review identifies gaps, including methodological limitations, a scarcity of studies on vulnerable groups, and a lack of standardized indicators. This study contributes to the advancement of policy evaluation methodologies by, for example, highlighting the need for strategic integration of qualitative and quantitative data within mixed-methods designs, going beyond mere combination to achieve nuanced understanding. It also emphasizes the critical importance of adapting systems thinking approaches, using for example, process tracing and agent-based modelling to specific developing country contexts, providing a pathway for more relevant and impactful evaluations. This research underscores the need for participatory, adaptive, and evidence-focused evaluation approaches that explicitly consider causal mechanisms, and recommends a concerted effort to develop comprehensive mixed-methods research, prioritize studies in developing countries, and build capacity for implementing these advanced methodologies.
Downloads
Download data is not yet available.
References
Adams, B. E. (2016). Assessing the Merits of Decentralization: A Framework for Identifying the Causal Mechanisms Influencing Policy Outcomes. Politics and Policy, 44(5), 820–849. Scopus. https://doi.org/10.1111/polp.12172
Ben-Dor, G., Ogulenko, A., Klein, I., Ben-Elia, E., & Benenson, I. (2024). Simulation-based policy evaluation of monetary car driving disincentives in Jerusalem. Transportation Research Part A: Policy and Practice, 183, 104061. https://doi.org/10.1016/j.tra.2024.104061
Bi, X., Nie, H., Zhang, G., Hu, L., Ma, Y., Zhao, X., Yuan, Y., & Wang, G. (2023). Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision. Information Processing & Management, 60(2), 103242. https://doi.org/10.1016/j.ipm.2022.103242
Bundi, P., & Trein, P. (2022). Evaluation use and learning in public policy. Policy Sciences, 55(2), 283–309. Scopus. https://doi.org/10.1007/s11077-022-09462-6
Caffrey, L., & Munro, E. (2017). A systems approach to policy evaluation. Evaluation, 23(4), 463–478. Scopus. https://doi.org/10.1177/1356389017730727
Cerutti, A. K., Contu, S., Ardente, F., Donno, D., & Beccaro, G. L. (2016). Carbon footprint in green public procurement: Policy evaluation from a case study in the food sector. Food Policy, 58, 82–93. https://doi.org/10.1016/j.foodpol.2015.12.001
Dunn, W. N. (2018). Public policy analysis: An integrated approach (Sixth Edition). Routledge, Taylor & Francis Group.
Feng, K., & Jiang, Z. (2021). State Capacity and Innovation Policy Performance: A Comparative Study on Two Types of Innovation Projects in China. Review of Policy Research, 38(4), 427–453. Scopus. https://doi.org/10.1111/ropr.12420
Fischer, F., Miller, G., & Sidney, M. S. (Eds.). (2007). Handbook of public policy analysis: Theory, politics, and methods. CRC/Taylor & Francis.
Fontaine, G. (2020). The contribution of policy design to realist evaluation. Evaluation, 26(3), 296–314. Scopus. https://doi.org/10.1177/1356389020902496
Fynn, J. F., Milton, K., Hardeman, W., & Jones, A. P. (2022). A model for effective partnership working to support programme evaluation. Evaluation, 28(3), 284–307. Scopus. https://doi.org/10.1177/13563890221096178
Garcés-Velástegui, P. (2022). Using the Capability Approach and Fuzzy Set Qualitative Comparative Analysis in Development Policy Evaluation. Journal of Comparative Policy Analysis: Research and Practice, 24(2), 179–197. Scopus. https://doi.org/10.1080/13876988.2019.1699277
Gatta, V., & Marcucci, E. (2016). Stakeholder-specific data acquisition and urban freight policy evaluation: Evidence, implications and new suggestions. Transport Reviews, 36(5), 585–609. https://doi.org/10.1080/01441647.2015.1126385
Green, J., Roberts, H., Petticrew, M., Steinbach, R., Goodman, A., Jones, A., & Edwards, P. (2015). Integrating quasi-experimental and inductive designs in evaluation: A case study of the impact of free bus travel on public health. Evaluation, 21(4), 391–406. Scopus. https://doi.org/10.1177/1356389015605205
Griggs, D. M., & Crain-Dorough, M. (2021). Appreciative inquiry’s potential in program evaluation and research. Qualitative Research Journal, 21(4), 375–393. https://doi.org/10.1108/QRJ-06-2020-0059
Howlett, M. (2022). The Routledge Handbook of Policy Tools (1st ed.). Routledge. https://doi.org/10.4324/9781003163954
Hsieh, H.-S. (2020). Transport policy evaluation based on elasticity analysis with social interactions. Transportation Research Part A: Policy and Practice, 139, 273–296. https://doi.org/10.1016/j.tra.2020.07.011
Johnson, B. T., & Hennessy, E. A. (2019). Systematic reviews and meta-analyses in the health sciences: Best practice methods for research syntheses. Social Science & Medicine, 233, 237–251. https://doi.org/10.1016/j.socscimed.2019.05.035
Koudoumakis, P., Botzoris, G., & Protopapas, A. (2022). Cohesion policy evaluation: Guidelines for selection of appropriate methods. Regional Science Policy & Practice, 14(5), 1062–1085. https://doi.org/10.1111/rsp3.12524
Lakerveld, J., Woods, C., Hebestreit, A., Brenner, H., Flechtner-Mors, M., Harrington, J. M., Kamphuis, C. B. M., Laxy, M., Luszczynska, A., Mazzocchi, M., Murrin, C., Poelman, M., Steenhuis, I., Roos, G., Steinacker, J. M., Stock, C. C., van Lenthe, F., Zeeb, H., Zukowska, J., & Ahrens, W. (2020). Advancing the evidence base for public policies impacting on dietary behaviour, physical activity and sedentary behaviour in Europe: The Policy Evaluation Network promoting a multidisciplinary approach. Sustainable Food Systems for Healthy Diets in Europe and Central Asia, 96, 101873. https://doi.org/10.1016/j.foodpol.2020.101873
Li, H., Dong, X., Jiang, Q., & Dong, K. (2021). Policy analysis for high-speed rail in China: Evolution, evaluation, and expectation. Transport Policy, 106, 37–53. https://doi.org/10.1016/j.tranpol.2021.03.019
Lin, Q.-S., Hu, T.-J., & Zhou, X.-H. (2020). Estimating the daily trend in the size of the COVID-19 infected population in Wuhan. Infectious Diseases of Poverty, 9(1), 69. https://doi.org/10.1186/s40249-020-00693-4
Marra, M., & McCullagh, C. (2018). Feeling able to say it like it is: A case for using focus groups in programme evaluation with international cohorts. The International Journal of Management Education, 16(1), 63–79. https://doi.org/10.1016/j.ijme.2017.12.006
McConnell, A., Grealy, L., & Lea, T. (2020). Policy success for whom? A framework for analysis. Policy Sciences, 53(4), 589–608. Scopus. https://doi.org/10.1007/s11077-020-09406-y
McGough, D. J., Bedell, C., & Tinkler, B. (2018). Building a dangerous outpost in the green mountain state: A case study of educator preparation policymaking. Education Policy Analysis Archives, 26. Scopus. https://doi.org/10.14507/epaa.26.2848
Michener, G. (2015). Policy Evaluation via Composite Indexes: Qualitative Lessons from International Transparency Policy Indexes. World Development, 74, 184–196. https://doi.org/10.1016/j.worlddev.2015.04.016
Moradi, S., & Abdi, S. (2023). Open science-related policies in Europe. Science and Public Policy, 50(3), 521–530. Scopus. https://doi.org/10.1093/scipol/scac082
Moran, M., Rein, M., & Goodin, R. E. (Eds.). (2006). The Oxford handbook of public policy. Oxford University Press.
Nagel, S. S. (2002). Handbook of public policy evaluation. Sage.
Okamuro, H., & Nishimura, J. (2021). Effects of multilevel policy mix of public R&D subsidies: Empirical evidence from Japanese local SMEs. Science and Public Policy, 48(6), 829–840. Scopus. https://doi.org/10.1093/scipol/scaa075
Omori, S., & Tesorero, B. S. (2020). Why Does Polycentric Governance Work for Some Project Sites and Not Others? Explaining the Sustainability of Tramline Projects in the Philippines. Policy Studies Journal, 48(3), 833–860. Scopus. https://doi.org/10.1111/psj.12299
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Journal of Clinical Epidemiology, 134, 178–189. https://doi.org/10.1016/j.jclinepi.2021.03.001
Parr, S., & Churchill, H. (2020). The Troubled Families Programme: Learning about policy impact through realist case study research. Social Policy and Administration, 54(1), 134–147. Scopus. https://doi.org/10.1111/spol.12529
Pattyn, V., Álamos-Concha, P., Cambré, B., Rihoux, B., & Schalembier, B. (2022). Policy Effectiveness through Configurational and Mechanistic Lenses: Lessons for Concept Development. Journal of Comparative Policy Analysis: Research and Practice, 24(1), 33–50. Scopus. https://doi.org/10.1080/13876988.2020.1773263
Pattyn, V., & Brans, M. (2015). Organisational analytical capacity: Policy evaluation in Belgium. Special Issue on The Dynamics of Policy Capacity, 34(3), 183–196. https://doi.org/10.1016/j.polsoc.2015.09.009
Pham, T., Goto, D., & Tran, D. (2024). Child online safety education: A program evaluation combining a randomized controlled trial and list experiments in Vietnam. Computers in Human Behavior, 156, 108225. https://doi.org/10.1016/j.chb.2024.108225
Qi, D., & Wu, Y. (2018). Does welfare stigma exist in China? Policy evaluation of the Minimum Living Security System on recipients’ psychological health and wellbeing. Social Science & Medicine, 205, 26–36. https://doi.org/10.1016/j.socscimed.2018.03.041
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., & Group, P.-S. (2021). PRISMA-S: An extension to the PRISMA statement for reporting literature searches in systematic reviews. Journal of the Medical Library Association, 109(2). https://doi.org/10.5195/jmla.2021.962
Rist, R. C. (Ed.). (1999). Program evaluation and the management of government: Patterns and prospects across eight nations (1. paperback ed). Transaction Publishers.
Rothgang, M., & Lageman, B. (2021). The unused potential of process tracing as evaluation approach: The case of cluster policy evaluation. Evaluation, 27(4), 527–543. Scopus. https://doi.org/10.1177/13563890211041676
Sandberg, J. (2016). Between Poor Relief and Human Capital Investments—Paradoxes in Hybrid Social Assistance. Social Policy and Administration, 50(3), 316–335. Scopus. https://doi.org/10.1111/spol.12111
Sjöö, K., & Callerstig, A.-C. (2023). The challenges in integrating horizontal perspectives in sectoral policy evaluation. Policy Studies, 44(2), 174–194. Scopus. https://doi.org/10.1080/01442872.2021.2015312
Sun, C., Min, J., Li, J., & Cai, W. (2023). Public participation and policy evaluation in China’s smog governance. Environmental Impact Assessment Review, 100, 107052. https://doi.org/10.1016/j.eiar.2023.107052
Sun, D., Zhang, M., & Jung, D. (2023). Policy evaluation of economic – environmental tradeoffs in regulating industrial water use: An agent-based model. Journal of Environmental Management, 346, 118988. https://doi.org/10.1016/j.jenvman.2023.118988
Tam, W. W. S., Tang, A., Woo, B., & Goh, S. Y. S. (2019). Perception of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement of authors publishing reviews in nursing journals: A cross-sectional online survey. BMJ Open, 9(4), e026271. https://doi.org/10.1136/bmjopen-2018-026271
Trosvik, L., Takman, J., Björk, L., Norrman, J., & Andersson-Sköld, Y. (2023). A meta-evaluation of climate policy evaluations: Findings from the freight transport sector. Transport Reviews, 43(5), 867–887. https://doi.org/10.1080/01441647.2023.2175275
Uddin, M. K. (2023). NGOs’ approach to human rights and the challenges in Bangladesh. Development Policy Review, 41(3). Scopus. https://doi.org/10.1111/dpr.12667
van Sluisveld, M. A. E., Hof, A. F., van Vuuren, D. P., Boot, P., Criqui, P., Matthes, F. C., Notenboom, J., Pedersen, S. L., Pfluger, B., & Watson, J. (2017). Low-carbon strategies towards 2050: Comparing ex-ante policy evaluation studies and national planning processes in Europe. Environmental Science & Policy, 78, 89–96. https://doi.org/10.1016/j.envsci.2017.08.022
van Voorst, S., & Mastenbroek, E. (2019). Evaluations as a decent knowledge base? Describing and explaining the quality of the European Commission’s ex-post legislative evaluations. Policy Sciences, 52(4), 625–644. Scopus. https://doi.org/10.1007/s11077-019-09358-y
Vasilenko, S. A., Glassman, J. R., Kugler, K. C., Peskin, M. F., Shegog, R., Markham, C. M., Emery, S. T., & Coyle, K. K. (2019). Examining the Effects of an Adolescent Pregnancy Prevention Program by Risk Profiles: A More Nuanced Approach to Program Evaluation. Journal of Adolescent Health, 64(6), 732–736. https://doi.org/10.1016/j.jadohealth.2018.12.003
Vedung, E., & Vedung, E. (1997). Public policy and program evaluation (1. paperback print). Transaction Publ.
Xu, T. L., & Hu, Y. (2024). Towards sustainable prosperity? Policy evaluation of Jiangsu advanced manufacturing clusters. Technology in Society, 77, 102583. https://doi.org/10.1016/j.techsoc.2024.102583
Zenezini, G., & Marco, A. D. (2020). City logistics policy evaluation with system dynamics. The 11th International Conference on City Logistics, Dubrovnik, Croatia, 12th - 14th June 2019, 46, 253–260. https://doi.org/10.1016/j.trpro.2020.03.188
Ben-Dor, G., Ogulenko, A., Klein, I., Ben-Elia, E., & Benenson, I. (2024). Simulation-based policy evaluation of monetary car driving disincentives in Jerusalem. Transportation Research Part A: Policy and Practice, 183, 104061. https://doi.org/10.1016/j.tra.2024.104061
Bi, X., Nie, H., Zhang, G., Hu, L., Ma, Y., Zhao, X., Yuan, Y., & Wang, G. (2023). Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision. Information Processing & Management, 60(2), 103242. https://doi.org/10.1016/j.ipm.2022.103242
Bundi, P., & Trein, P. (2022). Evaluation use and learning in public policy. Policy Sciences, 55(2), 283–309. Scopus. https://doi.org/10.1007/s11077-022-09462-6
Caffrey, L., & Munro, E. (2017). A systems approach to policy evaluation. Evaluation, 23(4), 463–478. Scopus. https://doi.org/10.1177/1356389017730727
Cerutti, A. K., Contu, S., Ardente, F., Donno, D., & Beccaro, G. L. (2016). Carbon footprint in green public procurement: Policy evaluation from a case study in the food sector. Food Policy, 58, 82–93. https://doi.org/10.1016/j.foodpol.2015.12.001
Dunn, W. N. (2018). Public policy analysis: An integrated approach (Sixth Edition). Routledge, Taylor & Francis Group.
Feng, K., & Jiang, Z. (2021). State Capacity and Innovation Policy Performance: A Comparative Study on Two Types of Innovation Projects in China. Review of Policy Research, 38(4), 427–453. Scopus. https://doi.org/10.1111/ropr.12420
Fischer, F., Miller, G., & Sidney, M. S. (Eds.). (2007). Handbook of public policy analysis: Theory, politics, and methods. CRC/Taylor & Francis.
Fontaine, G. (2020). The contribution of policy design to realist evaluation. Evaluation, 26(3), 296–314. Scopus. https://doi.org/10.1177/1356389020902496
Fynn, J. F., Milton, K., Hardeman, W., & Jones, A. P. (2022). A model for effective partnership working to support programme evaluation. Evaluation, 28(3), 284–307. Scopus. https://doi.org/10.1177/13563890221096178
Garcés-Velástegui, P. (2022). Using the Capability Approach and Fuzzy Set Qualitative Comparative Analysis in Development Policy Evaluation. Journal of Comparative Policy Analysis: Research and Practice, 24(2), 179–197. Scopus. https://doi.org/10.1080/13876988.2019.1699277
Gatta, V., & Marcucci, E. (2016). Stakeholder-specific data acquisition and urban freight policy evaluation: Evidence, implications and new suggestions. Transport Reviews, 36(5), 585–609. https://doi.org/10.1080/01441647.2015.1126385
Green, J., Roberts, H., Petticrew, M., Steinbach, R., Goodman, A., Jones, A., & Edwards, P. (2015). Integrating quasi-experimental and inductive designs in evaluation: A case study of the impact of free bus travel on public health. Evaluation, 21(4), 391–406. Scopus. https://doi.org/10.1177/1356389015605205
Griggs, D. M., & Crain-Dorough, M. (2021). Appreciative inquiry’s potential in program evaluation and research. Qualitative Research Journal, 21(4), 375–393. https://doi.org/10.1108/QRJ-06-2020-0059
Howlett, M. (2022). The Routledge Handbook of Policy Tools (1st ed.). Routledge. https://doi.org/10.4324/9781003163954
Hsieh, H.-S. (2020). Transport policy evaluation based on elasticity analysis with social interactions. Transportation Research Part A: Policy and Practice, 139, 273–296. https://doi.org/10.1016/j.tra.2020.07.011
Johnson, B. T., & Hennessy, E. A. (2019). Systematic reviews and meta-analyses in the health sciences: Best practice methods for research syntheses. Social Science & Medicine, 233, 237–251. https://doi.org/10.1016/j.socscimed.2019.05.035
Koudoumakis, P., Botzoris, G., & Protopapas, A. (2022). Cohesion policy evaluation: Guidelines for selection of appropriate methods. Regional Science Policy & Practice, 14(5), 1062–1085. https://doi.org/10.1111/rsp3.12524
Lakerveld, J., Woods, C., Hebestreit, A., Brenner, H., Flechtner-Mors, M., Harrington, J. M., Kamphuis, C. B. M., Laxy, M., Luszczynska, A., Mazzocchi, M., Murrin, C., Poelman, M., Steenhuis, I., Roos, G., Steinacker, J. M., Stock, C. C., van Lenthe, F., Zeeb, H., Zukowska, J., & Ahrens, W. (2020). Advancing the evidence base for public policies impacting on dietary behaviour, physical activity and sedentary behaviour in Europe: The Policy Evaluation Network promoting a multidisciplinary approach. Sustainable Food Systems for Healthy Diets in Europe and Central Asia, 96, 101873. https://doi.org/10.1016/j.foodpol.2020.101873
Li, H., Dong, X., Jiang, Q., & Dong, K. (2021). Policy analysis for high-speed rail in China: Evolution, evaluation, and expectation. Transport Policy, 106, 37–53. https://doi.org/10.1016/j.tranpol.2021.03.019
Lin, Q.-S., Hu, T.-J., & Zhou, X.-H. (2020). Estimating the daily trend in the size of the COVID-19 infected population in Wuhan. Infectious Diseases of Poverty, 9(1), 69. https://doi.org/10.1186/s40249-020-00693-4
Marra, M., & McCullagh, C. (2018). Feeling able to say it like it is: A case for using focus groups in programme evaluation with international cohorts. The International Journal of Management Education, 16(1), 63–79. https://doi.org/10.1016/j.ijme.2017.12.006
McConnell, A., Grealy, L., & Lea, T. (2020). Policy success for whom? A framework for analysis. Policy Sciences, 53(4), 589–608. Scopus. https://doi.org/10.1007/s11077-020-09406-y
McGough, D. J., Bedell, C., & Tinkler, B. (2018). Building a dangerous outpost in the green mountain state: A case study of educator preparation policymaking. Education Policy Analysis Archives, 26. Scopus. https://doi.org/10.14507/epaa.26.2848
Michener, G. (2015). Policy Evaluation via Composite Indexes: Qualitative Lessons from International Transparency Policy Indexes. World Development, 74, 184–196. https://doi.org/10.1016/j.worlddev.2015.04.016
Moradi, S., & Abdi, S. (2023). Open science-related policies in Europe. Science and Public Policy, 50(3), 521–530. Scopus. https://doi.org/10.1093/scipol/scac082
Moran, M., Rein, M., & Goodin, R. E. (Eds.). (2006). The Oxford handbook of public policy. Oxford University Press.
Nagel, S. S. (2002). Handbook of public policy evaluation. Sage.
Okamuro, H., & Nishimura, J. (2021). Effects of multilevel policy mix of public R&D subsidies: Empirical evidence from Japanese local SMEs. Science and Public Policy, 48(6), 829–840. Scopus. https://doi.org/10.1093/scipol/scaa075
Omori, S., & Tesorero, B. S. (2020). Why Does Polycentric Governance Work for Some Project Sites and Not Others? Explaining the Sustainability of Tramline Projects in the Philippines. Policy Studies Journal, 48(3), 833–860. Scopus. https://doi.org/10.1111/psj.12299
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Journal of Clinical Epidemiology, 134, 178–189. https://doi.org/10.1016/j.jclinepi.2021.03.001
Parr, S., & Churchill, H. (2020). The Troubled Families Programme: Learning about policy impact through realist case study research. Social Policy and Administration, 54(1), 134–147. Scopus. https://doi.org/10.1111/spol.12529
Pattyn, V., Álamos-Concha, P., Cambré, B., Rihoux, B., & Schalembier, B. (2022). Policy Effectiveness through Configurational and Mechanistic Lenses: Lessons for Concept Development. Journal of Comparative Policy Analysis: Research and Practice, 24(1), 33–50. Scopus. https://doi.org/10.1080/13876988.2020.1773263
Pattyn, V., & Brans, M. (2015). Organisational analytical capacity: Policy evaluation in Belgium. Special Issue on The Dynamics of Policy Capacity, 34(3), 183–196. https://doi.org/10.1016/j.polsoc.2015.09.009
Pham, T., Goto, D., & Tran, D. (2024). Child online safety education: A program evaluation combining a randomized controlled trial and list experiments in Vietnam. Computers in Human Behavior, 156, 108225. https://doi.org/10.1016/j.chb.2024.108225
Qi, D., & Wu, Y. (2018). Does welfare stigma exist in China? Policy evaluation of the Minimum Living Security System on recipients’ psychological health and wellbeing. Social Science & Medicine, 205, 26–36. https://doi.org/10.1016/j.socscimed.2018.03.041
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., & Group, P.-S. (2021). PRISMA-S: An extension to the PRISMA statement for reporting literature searches in systematic reviews. Journal of the Medical Library Association, 109(2). https://doi.org/10.5195/jmla.2021.962
Rist, R. C. (Ed.). (1999). Program evaluation and the management of government: Patterns and prospects across eight nations (1. paperback ed). Transaction Publishers.
Rothgang, M., & Lageman, B. (2021). The unused potential of process tracing as evaluation approach: The case of cluster policy evaluation. Evaluation, 27(4), 527–543. Scopus. https://doi.org/10.1177/13563890211041676
Sandberg, J. (2016). Between Poor Relief and Human Capital Investments—Paradoxes in Hybrid Social Assistance. Social Policy and Administration, 50(3), 316–335. Scopus. https://doi.org/10.1111/spol.12111
Sjöö, K., & Callerstig, A.-C. (2023). The challenges in integrating horizontal perspectives in sectoral policy evaluation. Policy Studies, 44(2), 174–194. Scopus. https://doi.org/10.1080/01442872.2021.2015312
Sun, C., Min, J., Li, J., & Cai, W. (2023). Public participation and policy evaluation in China’s smog governance. Environmental Impact Assessment Review, 100, 107052. https://doi.org/10.1016/j.eiar.2023.107052
Sun, D., Zhang, M., & Jung, D. (2023). Policy evaluation of economic – environmental tradeoffs in regulating industrial water use: An agent-based model. Journal of Environmental Management, 346, 118988. https://doi.org/10.1016/j.jenvman.2023.118988
Tam, W. W. S., Tang, A., Woo, B., & Goh, S. Y. S. (2019). Perception of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement of authors publishing reviews in nursing journals: A cross-sectional online survey. BMJ Open, 9(4), e026271. https://doi.org/10.1136/bmjopen-2018-026271
Trosvik, L., Takman, J., Björk, L., Norrman, J., & Andersson-Sköld, Y. (2023). A meta-evaluation of climate policy evaluations: Findings from the freight transport sector. Transport Reviews, 43(5), 867–887. https://doi.org/10.1080/01441647.2023.2175275
Uddin, M. K. (2023). NGOs’ approach to human rights and the challenges in Bangladesh. Development Policy Review, 41(3). Scopus. https://doi.org/10.1111/dpr.12667
van Sluisveld, M. A. E., Hof, A. F., van Vuuren, D. P., Boot, P., Criqui, P., Matthes, F. C., Notenboom, J., Pedersen, S. L., Pfluger, B., & Watson, J. (2017). Low-carbon strategies towards 2050: Comparing ex-ante policy evaluation studies and national planning processes in Europe. Environmental Science & Policy, 78, 89–96. https://doi.org/10.1016/j.envsci.2017.08.022
van Voorst, S., & Mastenbroek, E. (2019). Evaluations as a decent knowledge base? Describing and explaining the quality of the European Commission’s ex-post legislative evaluations. Policy Sciences, 52(4), 625–644. Scopus. https://doi.org/10.1007/s11077-019-09358-y
Vasilenko, S. A., Glassman, J. R., Kugler, K. C., Peskin, M. F., Shegog, R., Markham, C. M., Emery, S. T., & Coyle, K. K. (2019). Examining the Effects of an Adolescent Pregnancy Prevention Program by Risk Profiles: A More Nuanced Approach to Program Evaluation. Journal of Adolescent Health, 64(6), 732–736. https://doi.org/10.1016/j.jadohealth.2018.12.003
Vedung, E., & Vedung, E. (1997). Public policy and program evaluation (1. paperback print). Transaction Publ.
Xu, T. L., & Hu, Y. (2024). Towards sustainable prosperity? Policy evaluation of Jiangsu advanced manufacturing clusters. Technology in Society, 77, 102583. https://doi.org/10.1016/j.techsoc.2024.102583
Zenezini, G., & Marco, A. D. (2020). City logistics policy evaluation with system dynamics. The 11th International Conference on City Logistics, Dubrovnik, Croatia, 12th - 14th June 2019, 46, 253–260. https://doi.org/10.1016/j.trpro.2020.03.188
Downloads
Published
2025-08-16
How to Cite
Ananda, R., & Umanto, U. (2025). Evaluating Public Policy in Practice: A Critical Systematic Literature Review of Methods, Trends, and Gaps, from 2015 to 2023. TRANSFORMASI: Jurnal Manajemen Pemerintahan, 17(1), 35–58. https://doi.org/10.33701/jtp.v17i1.5166
Issue
Section
Articles
