logic model
{{short description|Method of depicting causal relationships}}
{{multipleissues|
{{refimprove|date=February 2025}}
{{essay like|date=February 2025}}
{{copyedit|date=February 2025}}
{{original research|date=February 2025}}}}
File:Example_of_a_logic_model.png
Logic models are hypothesized descriptions of the causal chains in certain plans, used to show programmes of action and the results desired from them. They lead from inputs to outputs and then outcomes. Logic models can be considered a visualisation of the desired relationship between action and change in the area being evaluated. A basic narrative logic model is as follows: Input- teachers trained on child asthma, Output- children develop better skills to deal with asthma, Outcome- asthmatic children are healthier. They are typically used in professional settings however can be relevant outside of the workplace for personal projects.
Logic models usually take form in a graphical depiction of the "if-then" causal relationships between the various elements leading to the outcome but rarely can be found being used in narrative form instead. The core of a logic model is the graphical or narrative depiction, but it also comprises relevant theories, evidences, assumptions and beliefs that support the model and the various processes behind it.{{Cite journal |vauthors=Renger R |date=2002 |title=A Three-Step Approach to Teaching Logic Models |journal=American Journal of Evaluation |volume=23 |issue=4 |pages=493–503 |doi=10.1016/s1098-2140(02)00230-8}}{{cite encyclopedia |last=Frechtling|first=Joy A. | name-list-style = vanc |chapter=Logic Models|date=2015 |encyclopedia=International Encyclopedia of the Social & Behavioral Sciences|pages=299–305|publisher=Elsevier|doi=10.1016/b978-0-08-097086-8.10549-5|isbn=978-0-08-097087-5 }}
Logic models are implemented by the administrative branch of employees in a workplace to plan and execute interventions, schemes and programs.{{cite book|chapter=Logic Model |title=Encyclopedia of Evaluation|publisher=Sage Publications, Inc.|doi=10.4135/9781412950558.n321|isbn=978-0-7619-2609-2|year=2005}} They are typically employed in the public sector but are also prevalent in private firms where they are used to organize and conduct literature reviews or for employee training purposes.{{cite journal | vauthors = Anderson LM, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, Baker P, Francis D, Tugwell P | title = Using logic models to capture complexity in systematic reviews | journal = Research Synthesis Methods | volume = 2 | issue = 1 | pages = 33–42 | date = March 2011 | pmid = 26061598 | doi = 10.1002/jrsm.32 | s2cid = 34282960 }}{{cite journal | vauthors = Kneale D, Thomas J, Harris K | title = Developing and Optimising the Use of Logic Models in Systematic Reviews: Exploring Practice and Good Practice in the Use of Programme Theory in Reviews | journal = PLOS ONE | volume = 10 | issue = 11 | pages = e0142187 | date = 2015-11-17 | pmid = 26575182 | pmc = 4648510 | doi = 10.1371/journal.pone.0142187 | bibcode = 2015PLoSO..1042187K | doi-access = free }} The domains of application for logic models are various; waste management,{{Cite book|url=https://www.epa.gov/sites/production/files/2015-09/documents/eval-wastewise-program.pdf|title=Evaluation of the WasteWise Program|last=Industrial Economics, Incorporated (IEc) Evaluation Team|publisher=EPA's Office of Policy, Economics, and Innovation|year=2010 }} poultry inspection,{{Cite book |title=Development of a logic model and an evaluation framework of the Canadian Food Inspection Agency's Modernized Poultry Inspection Program|others=Canada. Health Canada. Food Safety Assessment Program|year=2003|isbn=978-0-662-35161-0|location=[Ottawa]|oclc=905371520}} business education,{{cite journal | vauthors = Hense J, Kriz WC, Wolfe J | title = Putting theory-oriented evaluation into practice: A logic model approach for evaluating SIMGAME. | journal = Simulation & Gaming | date = February 2009 | volume = 40 | issue = 1 | pages = 110–33 | doi=10.1177/1046878107308078 | s2cid = 61673390 | url = https://epub.ub.uni-muenchen.de/12921/12/oa_12921.pdf }} heart disease and stroke prevention{{cite journal | vauthors = Sitaker M, Jernigan J, Ladd S, Patanian M | title = Adapting logic models over time: the Washington State Heart Disease and Stroke Prevention Program experience | journal = Preventing Chronic Disease | volume = 5 | issue = 2 | pages = A60 | date = April 2008 | pmid = 18341795 | pmc = 2396971 }} are but a few common examples. Since they are used in many contexts for different purposes, the typical components, complexity and levels of detail in logic models varies depending on the literature they are found in (compare for example the W.K. Kellogg Foundation{{Cite book|url=https://www.wkkf.org/resource-directory/resource/2006/02/wk-kellogg-foundation-logic-model-development-guide|title=W.K. Kellogg Foundation Logic Model Development Guide|last=W.K. Kellogg Foundation|publisher=W.K. Kellogg Foundation|year=1998 |location=Battle Creek}} presentation of the logic model, mainly aimed for evaluation, with the numerous types of logic models found in the intervention mapping framework{{cite book | vauthors = Eldredge LK, Markham CM, Ruiter RA, Kok G, Parcel GS | title = Planning health promotion programs: an intervention mapping approach. | publisher = John Wiley & Sons | date = 2016 |isbn=978-1-119-03556-5 |edition=Fourth|location=San Francisco, CA|oclc=914256995 }}).
History of logic models
Citing Funnell and Rogers's account (2011),{{Cite book | vauthors = Funnell SC, Rogers PJ | title = Purposeful program theory: Effective use of theories of change and logic models | publisher = John Wiley & Sons | date = February 2011 |isbn=978-0-470-47857-8|edition=1st |location=San Francisco, CA|oclc=660161852}} Joy A. Frechtling's (2015) encyclopedia article traces logic model underpinnings to the 1950s. Patricia J. Rogers's (2005) encyclopedia article instead traces it back to Edward A. Suchman's (1967) book{{Cite book | vauthors = Suchman E | title = Evaluative Research: Principles and Practice in Public Service and Social Action Progr. |location=New York | publisher = Russell Sage Foundation | date = December 1968 |isbn=978-0-87154-863-4 |oclc=712569}} about evaluative research. Both encyclopedia articles and LeCroy (2018){{Cite journal|last=LeCroy|first=Craig Winston | name-list-style = vanc |date=2018-06-25|title=Logic Models |journal=Encyclopedia of Social Work |doi= 10.1093/acrefore/9780199975839.013.1273 |isbn=9780199975839 }} mention increasing interest, usage and publications about the subject.
Uses of the logic model
=Program planning=
One of the most important uses of the logic model is for program planning. It is suggested to use the logic model to focus on the intended outcomes of a particular program. The guiding questions change from "what is being done?" to "what needs to be done"? McCawley suggests that by using this new reasoning, a logic model for a program can be built by asking the following questions in sequence:
- What is the current situation that we intend to impact?
- What will it look like when we achieve the desired situation or outcome?
- What behaviors need to change for that outcome to be achieved?
- What knowledge or skills do people need before the behavior will change?
- What activities need to be performed to cause the necessary learning?
- What resources will be required to achieve the desired outcome?{{Cite book|url=https://www.d.umn.edu/~kgilbert/educ5165-731/Readings/The%20Logic%20Model.pdf|title=The logic model for program planning and evaluation|last=McCawley|first=Paul F. | name-list-style = vanc |publisher=University of Idaho Extension|year=1995 }}
By placing the focus on ultimate outcomes or results, planners can think backward through the logic model to identify how best to achieve the desired results. Here it helps managers to 'plan with the end in mind', rather than just consider inputs (e.g. budgets, employees) or the tasks that must be done.
Testing the logic of the logic model is an important step in development. If you there is something the program wants to include, how will they do it? That should link to an earlier step in the logic model.{{Cite web |last=Center for Community Health and Evaluation |title=Measuring What Matters Toolkit: How to develop and use evaluation to help communities measure what matters. |url=https://www.cche.org/index.php/our-work/tools-and-resources/measuring-what-matters-tool |access-date=2025-05-19 |website=www.cche.org}}
=Evaluation=
The logic model is often used in government or not-for-profit organizations, where the mission and vision are not focused on achieving a financial benefit. Traditionally, government programs were described only regarding their budgets. It is easy to measure the amount of money spent on a program, but this is a poor indicator of outcomes. Likewise it is relatively easy to measure the amount of work done (e.g. number of workers or number of years spent), but the workers may have just been 'spinning their wheels' without getting very far in terms of ultimate results or outcomes.
However, nature of outcomes varies. To measure the progress toward outcomes, some initiatives may require an ad hoc measurement instrument. In addition, in programs such as in education or social programs, outcomes are usually in the long-term and may requires numerous intermediate changes (attitudes, social norm, industry practices, etc.) to advance progressively toward the outcomes.
By making clear the intended outcomes and the causal pathways leading to them, a program logic model provides the basis upon which planners and evaluators can develop a measurement plan and adequate instruments. Instead of only looking at the outcome progress, planners can open the "black box" and examine if the intermediate outcomes progress as planned. In addition, the pathways of numerous outcomes are still largely misunderstood due their complexity, their unpredictability and lack of scientific / practical evidences. Therefore, with proper research design, one may not only assess the progress of intermediate outcomes, but evaluate as well if the program theory of change is accurate, i.e. is successful change of an intermediate outcomes provokes the hypothesized subsequent effects in the causal pathway. Finally, outcomes may easily be achieved through processes independent of the program and an evaluation of those outcomes would suggest program success when in fact external outputs were responsible for the outcomes.{{Cite book | first1 = Peter H | last1 = Rossi | first2 = Mark W | last2 = Lipsey | first3 = Howard E | last3 = Freeman | name-list-style = vanc |title=Evaluation : a systematic approach |date=2004|publisher=Sage |isbn=978-0-7619-0894-4|edition=7th |location=Thousand Oaks, CA |oclc=52706526 }}
Various types of logic models
= The Inputs → Activities → Outputs → Outcomes template =
Many authors and guides use the following template when speaking about logic model:{{cite book | last1=McLaughlin |first1=John A. |last2=Jordan |first2=Gretchen | name-list-style = vanc |title=Using Logic Models |date=2015-10-14 |work=Handbook of Practical Program Evaluation |pages=62–87 |publisher=John Wiley & Sons, Inc. |doi=10.1002/9781119171386.ch3 |isbn=978-1-119-17138-6}}
class="wikitable" style="width: 75%" |
style="width: 25%;" | Inputs
! style="width: 25%;" | Activities ! style="width: 25%;" | Outputs ! style="width: 25%;" | Outcomes/impacts |
---|
align="center" | what resources go into a program
| align="center" | what activities the program undertakes | align="center" | what is produced through those activities | align="center" | the changes or benefits that result from the program |
align="center" | e.g. money, staff, equipment
| align="center" | e.g. development of materials, training programs | align="center" | e.g. number of booklets produced, workshops held, people trained | align="center" | e.g. increased skills/ knowledge/ confidence, leading in longer-term to promotion, new job, etc. |
Many refinements and variations{{Which|date=October 2018}} have been added to the basic template. For example, many versions of logic models set out a series of outcomes/impacts, explaining in more detail the logic of how an intervention contributes to intended or observed results.{{cite book | vauthors = Weiss CH | date = 1972 | title = Evaluation Research. Methods for Assessing Program Effectiveness. | url = https://archive.org/details/evaluationresear00weis | url-access = registration | publisher = Prentice-Hall, Inc. | location = Englewood Cliffs, New Jersey | isbn = 9780132921930 }} Others often distinguish short-term, medium-term and long-term results, and between direct and indirect results.
= Intervention mapping logic models =
{{Main|Intervention mapping}}
File:Logic Model of the Problem for Management information Decision Support Epilepsy Tool.jpg
The intervention mapping approach of Bartholomew et al. makes an extensive use of the logic model through the whole life-cycle of a health promotion program. Since this method can start from as far as a vague desired outcome (author's example is a city whose actors decide to address "health issues" of the city), planners go through various steps in order to develop effective interventions and properly evaluate them. There are distinguishable but closely interwoven logic models with different purposes that can be developed through the process:
- Logic model of the problem, which is a graphical depiction of at-risk population and its social environment behaviors (factors) leading to the health problem and their respective causal pathways (attitudes, beliefs, skills, etc.). This may include as well at-risk population physical environment related causes such as pollutants or lack of physical activity infrastructure and their respective causes, i.e. environmental agents behaviors leading to the physical environment causes and their respective causal pathways;
- Once the most relevant behaviors and causal pathways are identified, planners develop a logic model of change. This is a model of behavioral changes (performance objectives) that should happen and their corresponding necessary changes higher up in the cause-effects chain.
- Finally, a logic model of the intervention is developed. This model describes the various activities that will happen and the cascades of effects they are expected to cause toward the desired outcome.
Evaluators thereafter use the logic model of the intervention to design a proper evaluation plan to assess implementation, impact and efficiency.
= Progressive Outcomes Scale Logic Models (POSLM) =
File:Sample POSLM logic model.png
The Progressive Outcomes Scale Logic Model (POSLM) approach was developed by Quisha Brown in response to the racial wealth gap [exacerbated by the COVID-19 pandemic] to aid organizations in the immediate need to add a racial equity focus when developing program logic models. More testing and research is needed in order to verify the validity of this model.
The POSLM approach makes use of the logic model with a strong focus on tracking progressive improvement towards racial disparity outcomes. To measure the progress towards outcomes, this type of logic model states short, intermediate and long-term outcomes as "stage 1", "stage 2" and "stage 3. Each stage is uniquely defined and used to depict the percentage of KPIs achieved at each stage or the percentage of people who reach each stage as they progress on pre-identified Key Performance Indicators (KPI). These KPIs are specific to the racial disparity issues which the population served identifies with (i.e. low reading, financial literacy, unemployment, etc). In an effort to prevent the logic model itself from being cluttered with an overwhelming number of KPIs, the KPIs are arranged by category and only the category is displayed on the logic model. The extensive list of KPIs are an appendix to the logic model. Organizations identify the KPIs and corresponding outcomes by first conducting a needs assessment and/or community focus groups. This helps to ensure that the logic model remains focused on improving the real-time needs of people to remove racial barriers. The POSLM can help to make more clear the intended outcomes and the casual pathways leading to them; both of which help to connect and compose a logical companion "if, then" theory of change statement. Again, more research is needed and currently being conducted as more nonprofits, philanthropic and governments use this model.
See also
References
{{Reflist}}
{{commonscat}}
Further reading
{{refbegin}}
- {{cite book | vauthors = Hernandez M, Hodges S | chapter = Crafting logic models for systems of care: Ideas into action. | title = National Evaluation of the Comprehensive Community Mental Health Services and their Families Program | date = July 2003 | chapter-url = http://cfs.fmhi.usf.edu/TREAD/CMHseries/IdeasIntoAction.html }}
- {{cite journal | vauthors = Alter C, Murty S | date = 1997 | title = Logic modeling: A tool for teaching practice evaluation. | journal = Journal of Social Work Education | volume = 33 | issue = 1 | pages = 103–117 | doi = 10.1080/10437797.1997.10778856 }}
- {{Cite book |title=The logic model guidebook : better strategies for great results | first1 = Lisa Wyatt | last1 = Knowlton | first2 = Cynthia C | last2 = Phillips | last3 =Phillips | first3 = Cynthia | name-list-style = vanc |date=2013|publisher=SAGE C.|isbn=978-1-4522-1675-1|edition=2nd|location=Los Angeles|oclc=791492618}}
- {{cite journal | vauthors = Conrad KJ, Randolph FL | date = 1999 | title = Creating and using logic models: Four perspectives. | journal = Alcoholism Treatment Quarterly | volume = 17 | issue = 1–2 | pages = 17–32 | doi = 10.1300/J020v17n01_02 }}
- {{cite journal | vauthors = Hernandez M | date = 2000 | title = Using logic models and program theory to build outcome accountability. | journal = Education and Treatment of Children | volume = 23 | issue = 1 | pages = 24–41 }}
- {{cite journal | vauthors = Julian DA | date = 1997 | title = The utilization of the logic model as a system level planning and evaluation device. | journal= Evaluation and Program Planning | volume = 20 | issue = 3 | pages = 251–257 | doi = 10.1016/S0149-7189(97)00002-5 }}
- {{cite journal | vauthors = McLaughlin JA, Jordan GB | date = 1999 | title = Logic models: A tool for telling your program's performance story. | journal = Evaluation and Program Planning | volume = 22 | issue = 1 | pages = 65–72 | doi = 10.1016/S0149-7189(98)00042-1 }}
- {{cite journal | vauthors = Stinchcomb JB | date = 2001 | title = Using logic modeling to focus evaluation efforts: Translating operational theories into practical measures. | journal = Journal of Offender Rehabilitation | volume = 33 | issue = 2 | pages = 47–65 | doi = 10.1300/J076v33n02_04 | s2cid = 141946096 }}
- {{cite web | vauthors = McCawley PF | date = 2001 | title = The Logic Model for Program planning and Evaluation. | work = University of Idaho Extension. | url = http://www.uiweb.uidaho.edu/extension/LogicModel.pdf | archive-url = https://web.archive.org/web/20101117070740/http://www.uiweb.uidaho.edu/extension/LogicModel.pdf | archive-date = 17 November 2010 }}
- {{cite journal | vauthors = Savitz S, Matthews M, Weilant S | date = 2017 | title = Assessing Impact to Inform Decisions: A Toolkit on Measures for Policymakers | journal = RAND | url = https://www.rand.org/pubs/tools/TL263.html }}
- {{cite web | work = Innovation Network's Point K Logic Model Builder | date = 2006 | title = A set of three online evaluation tools that includes a Logic Model Builder | url = http://www.innonet.org/index.php?section_id=4&content_id=16 | url-access=registration }}
- {{cite journal | vauthors = Unrau YA | date = 2001 | title = Using client exit interviews to illuminate outcomes in program logic models: A case example. | journal = Evaluation and Program Planning | volume = 24 | issue = 4m | pages = 353–361 | doi = 10.1016/S0149-7189(01)00029-5 }}
{{refend}}
{{DEFAULTSORT:Logic Model}}