LEAP Consulting featured in New York Times!

The New York Times featured LEAP Consulting's work with the Global Impact Investing Network (GIIN)!

This involved updating and creating new social impact metrics for GIIN's tool IRIS+. The tool will allow global investors to create a targeted social impact portfolio aligned to their social and environmental interests.

Huge shout out to GIIN for creating this amazing tool for the field. LEAP is humbled to be involved in this amazing work.

Evaluating System Interventions is Complex But Necessary - And Transformative

Originally published here.

In recent decades, “systems thinking” has become more commonplace in both the public and private sectors and has been proven to be a more effective way to solve complex societal problems. Along with the shift to more comprehensive systems-level interventions, there has also been a need to design systems-level monitoring and evaluation efforts that allow us to examine large-scale impact and progress towards short- and long-term goals. As an evaluator of system change, I am lucky to have the opportunity to work with agents of systems change in South Dakota who are changing the landscape of STEM research and education infrastructure with support from the National Science Foundation (NSF).

1.png

STEM research, innovation, and education are high priority issues for South Dakota. The South Dakota EPSCoR (Established Program to Stimulate Competitive Research) program aims to develop and increase the state’s STEM research infrastructure and capacity. Their mission is to build science, technology, engineering, and math (STEM) education, increase science literacy, and drive science-based economic development across the state through a partnership of public, private and tribal higher education communities, K-12 education, the state government, and the private sector.

The South Dakota EPSCoR program has several philosophical orientations that underpin how the program approaches change-making in the state. All of SD EPSCoR’s change-making is rooted in a network orientation approach, which translates to efforts that primarily target change through building institutional collaborations and networks, rather than the use of single interventions that target individual-level change (i.e. change among a single organization or entity as opposed to the larger system). As a fundamental principle, the network orientation concept asserts that building infrastructure and fostering collaboration are drivers for creating higher-level and more long-term systemic changes in South Dakota.

2.png

The South Dakota EPSCoR program is rightfully complex, thus the evaluation of this initiative needed to be set up in a way that was able to evaluate this complexity. The multi-year evaluation required four evaluative streams, described below as Systems Change Capacities, Early Changes, Systems Changes, and Population Change, all of which provided data to understand SD EPSCoR’s progress towards state-level change.

3.png

As South Dakota EPSCoR’s Lead Evaluator (at LEAP Consulting), I had the pleasure of presenting evaluation findings for the final year of the program to The South Dakota Research, Excellence: A Critical Hallmark (REACH) Committee this past week. The REACH Committee provides independent and unbiased coordination of South Dakota’s EPSCoR grant from NSF, as well as other STEM-related initiatives in the state.  Also in attendance was the core EPSCoR project team.

4.jpg

LEAP Consulting’s presentation introduced several themes that emerged over the 5-year evaluation. These themes, outlined below, demonstrate how evaluations that are well-positioned to evaluate systems change can become powerful tools to increase a project's impact.

  1. Developing a Theory of Change, and revising that Theory of Change throughout the program, was important to maintain a clear perspective of how the program components work together to elicit impact.

  2. Distinguishing between early changes, systems changes, and population-level changes was important for explicating what changes we expect to see more concretely. Ensuring each level of change with a distinctive evaluative approach, yet reporting on them collectively was important to paint a clear picture of the system change underway.

For example, an early change may involve piloting an internship program within a single university, a systems change may involve scaling that same internship program state-wide, and a population-level change may involve the project's contribution to STEM graduate rates in South Dakota.

3. Reflecting critically on program sustainability and the capacities needed to sustain a state-level, outcome-producing infrastructure were important for planning future program activities.

Again, using the example of a state-wide internship program. How would this program be funded beyond the EPSCoR grant in the state?

It was evident throughout this presentation and discussion that the systems approach to the evaluation of SD EPSCoR’s program activities helped the REACH Committee and the EPSCoR program team think more concretely about the impact that EPSCoR has had at all levels over the life of the program. These conversations are critical for future planning of program activities, especially related to the sustainability of the change that program components have had in promoting STEM research, innovation, and education across the state. By using a systems approach to evaluation, LEAP Consulting was better able to account for and monitor the complexities of this type of work in achieving large scale goals, such as changing the landscape of STEM state-wide.

LEAP Consulting specializes in systems approaches to evaluation as used in the South Dakota EPSCoR evaluation. LEAP helps nonprofits, foundations, public institutions and funders across the United States achieve greater impact through meaningful evaluations and strategic support. We are social change strategists who offer evaluation, systems, placemaking, and community engagement expertise in a variety of formats. Learn more about our areas of support here. Want to get in touch about your program or next project? Click here.

References

1, 2, 3 http://orsimpact.com/DirectoryAttachments/10262018_111513_477_CI_Study_Report_10-26-2018.pdf

https://www.cdc.gov/dhdsp/pubs/docs/April_2011_CB.pdf

Innovating Social Impact with GIIN and IRIS+

linkedin-article-image.png

LEAP Consulting is excited to announce a new partnership with the Global Impact Investing Network. In the next few months we’ll be working with a GIIN taskforce to update and create new social impact metrics for their new project, IRIS+.

A part of this work will be incorporating public feedback into new core metric sets that will be used by global investors to create a comprehensive portfolio of their social and environmental interests. Metric sets are used to systematically target and track investments across industries and sectors, providing a powerful way to measure and understand impact

Each core metric set will include indicators across the 5 dimensions of impact: What, Who, How Much, Contribution, and Risk of the impact. These collect information about the outcomes targets, the extent of the outcome, and any unintended outcomes set in their local context. 

Metric sets also align with the United Nations 17 Sustainable Development Goals to allow investors to create targeted social impact portfolios.

Data that are systematically collected and in alignment with other change efforts are crucial to communicating and understanding performance through common language and enables future benchmarking.

LEAP is looking forward to a collaboration with GIIN, sharing our expertise and learning more about the social impact world. 

What experiences and knowledge do you have in social impact measurement?

We would love to hear from you! Contact us.

FSG Collaboration at American Evaluation Association conference

LEAP Consulting is excited to be taking part in the American Evaluation Association's Annual Conference. LEAP will be acting as a session chair and presenting their paper entitled "Monitoring and reporting in systems change initiatives: Framework for tracking and reporting progress in an adaptive environment". Additionally LEAP will be collaborating with our FSG colleague Katelyn Mac on a paper about scaling social innovation. More specifically this presentation will talk about how to foster strategic learning through evaluation to support strategies that scale. 

hghghg.jpg