Evaluating How Activities Contribute to a Particular Policy Changing policies takes time and so does policy evaluation. In the context of sexual violence prevention, evaluating policy work often means evaluating how particular activities contribute to the development or implementation of a particular policy, whether that be an organizational policy or public policy. Use the following charts1 with your team to identify potential measures for evaluating your policy activities. Space is provided to add ideas unique to your own work. The chart is broken out into 3 sections: measuring capacity to implement policy efforts, measuring factors supporting policy efforts, and measuring visibility of the policy efforts. Measuring Capacity to Implement or Maintain Policy Efforts Outcomes Indicators Possible Data Sources • % of organizations that receive TTA to improve policies • # of outreach calls with employers to discuss benefit/policy • # of new trainings developed • # of stakeholders completing training • # of TTA requests received • # of implementers who receive training/ materials on policy • % of stakeholders reporting comprehension of policy • % of trained employers reporting increased understanding of policy Increased training and technical assistance (TTA) on policy issue Increase in knowledge/ understanding of policy issue among stakeholders Document/record review to gather information on communications and events Training/Presentation tracker to measure provision of TTA Event and contact management database to capture engagement and attendance Partner/Stakeholder surveys to assess changes in knowledge or understanding Examples adapted from the DELTA Impact Program. www.nsvrc.org | prevention@nsvrc-respecttogether.org | (877) 739-3895 National Sexual Violence Resource Center acronym logo Measuring Capacity to Implement or Maintain Policy Efforts Outcomes Indicators Possible Data Sources • % of organizations reporting readiness to participate in policy activities • % of staff reporting increased resources dedicated to policy effort Increase in capacity to implement/sustain policy efforts Partner/Stakeholder surveys to assess organizational capacity and resources Measuring Factors Contributing to Policy Change/Implementation Outcomes Indicators Possible Data Sources • # of organizations or stakeholders attending trainings • # of organizations completing surveys • # of endorsements for policy efforts • % of organizations receiving professional development related to policy/procedure • # of organizations completing internal policy scans or assessments • % of organizations reporting readiness to participate in policy activities • % of staff reporting increased resources dedicated to policy effort • # of organizations requesting TTA • # of organizations identifying needs or receiving recommendations • # of resources accessed/downloaded Increased stakeholder/ partner engagement Increased stakeholder/ partner capacity building Increase in capacity to implement/sustain policy efforts Increased use of resources and tools Training logs and surveys of local employers Surveys or assessment tools of employers and/or organizations, or school Partner/Stakeholder surveys to assess organizational capacity and resources Request logs or other tracking sheets Analytics for website visits or downloads Measuring Factors Contributing to Policy Change/Implementation Outcomes Indicators Possible Data Sources • # of organizations reporting structural change (e.g. creation of a lactation room, onsite day-care, etc.) • # oof benefit claims filed with employers • % of employees reporting change in workplace climate • % change in organizational policy scorecard tool Changed policies and procedures implemented Surveys of employers and/or organizations Local, state or territory administrative data • # of new or revised policies • % of trained organizations’ reporting change in policies after training Improved policies and procedures Surveys of employers and/or organizations Continual policy scans Measuring Visibly and Attention Paid to Policy Efforts Outcomes Indicators Possible Data Sources • # of earned media coverage on issue (i.e. interviews, stories, etc.) • # press releases released on issue • # times policy scan cited in partner publications/reports • # comments on posts on issue as proxy for level of public engagement • # instances of policy scan findings/ materials on coalition or member organizations’ website(s) • # individuals who engaged (commented, liked, shared) with posts on issue • # of times issue mentioned in decision maker meetings or reports • # of times issue mentioned by decision makers in the media and on social media • # of times issue are a focal issue during meetings • Proportion of meetings with issue on agenda Increase in attention paid to issue on traditional media Increase in public attention paid to issue on social media Increase in discussion on issue by statewide leadership or policymakers Media analytics and document review to measure coverage of issue Social media analytics and content analysis to assess engagement, impressions, and reach Document review and observations to evaluate frequency and nature of discussion of issue Measuring Visibly and Attention Paid to Policy Efforts Outcomes Indicators Possible Data Sources © 2023 National Sexual Violence Resource Center, A division of Respect Together. All rights reserved. National Sexual Violence Resource Center acronym logo